2024-09-15T20:33:17.482 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T20:33:17.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T20:33:17.596 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610 branch: main description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-low-osd-mem-target} rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} email: ceph-qa@ceph.com first_in_suite: false job_id: '7905610' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: debug cephsqlite: 20 debug client: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 3 ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true bluestore write v2: false bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - POOL_APP_NOT_ENABLED - do not have an application enabled sha1: fc3e0bff7468fd55478adbae7f75508b749124b6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: fc3e0bff7468fd55478adbae7f75508b749124b6 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 7498493279982dfe87f00616198a5967475f6169 owner: scheduled_teuthology@teuthology priority: 101 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2855 sha1: fc3e0bff7468fd55478adbae7f75508b749124b6 sleep_before_teardown: 0 subset: 17936/100000 suite: rados suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_7498493279982dfe87f00616198a5967475f6169/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7498493279982dfe87f00616198a5967475f6169 targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5DJem3xaL5BQyjkNVysNd8GGqR2RpCKi04S54npsF5amdMF6g2d/A9M/CmsLpn82tihb2W8uPvrJ1QKtr0HCA= smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJvNlgP4OqkAPyq8F1T7NJax+DML0Pm4N21Iw9HPbcOhVzoMTR7z9KEIXBIlknkRK+sUeqwJmh57LKP5/83BZe0= tasks: - install: extra_system_packages: deb: - sqlite3 rpm: - sqlite-devel - ceph: null - exec: client.0: - ceph osd pool create cephsqlite - ceph auth get-or-create client.libcephsqlite mon 'profile simple-rados-client-with-blocklist' osd 'allow rwx pool=cephsqlite' >> /etc/ceph/ceph.keyring - exec: client.0: - ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr - workunit: clients: client.0: - rados/test_libcephsqlite.sh cephsqlite env: CEPH_ARGS: --id libcephsqlite --no-log-to-stderr teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_20:00:16 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T20:33:17.596 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7498493279982dfe87f00616198a5967475f6169/qa; will attempt to use it 2024-09-15T20:33:17.597 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7498493279982dfe87f00616198a5967475f6169/qa/tasks 2024-09-15T20:33:17.597 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T20:33:17.598 INFO:teuthology.task.internal:Checking packages... 2024-09-15T20:33:17.623 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'fc3e0bff7468fd55478adbae7f75508b749124b6' 2024-09-15T20:33:17.623 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T20:33:17.623 INFO:teuthology.packaging:ref: None 2024-09-15T20:33:17.624 INFO:teuthology.packaging:tag: None 2024-09-15T20:33:17.624 INFO:teuthology.packaging:branch: main 2024-09-15T20:33:17.624 INFO:teuthology.packaging:sha1: fc3e0bff7468fd55478adbae7f75508b749124b6 2024-09-15T20:33:17.624 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-15T20:33:17.821 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4930-gfc3e0bff-1jammy 2024-09-15T20:33:17.823 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T20:33:17.830 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T20:33:17.830 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T20:33:17.836 INFO:teuthology.task.internal:Saving configuration 2024-09-15T20:33:17.849 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T20:33:17.856 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T20:33:17.879 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 20:27:52.493619', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDRCxFbn2UDBsOwCa0dqGU1rTkb6e8BKJ6T9/R9h12yK'} 2024-09-15T20:33:17.901 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 20:27:52.492283', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIB4XyC3v0g5vv7nhQ6CXfjegLnfiwZqf32snAq0KyJ1m'} 2024-09-15T20:33:17.901 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T20:33:17.907 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-15T20:33:17.907 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-15T20:33:17.907 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T20:33:17.963 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8ac03f7010>, signals=[15]) 2024-09-15T20:33:17.963 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T20:33:17.970 INFO:teuthology.task.internal:Opening connections... 2024-09-15T20:33:17.970 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:33:17.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T20:33:18.054 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-15T20:33:18.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T20:33:18.130 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T20:33:18.136 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-09-15T20:33:18.141 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-09-15T20:33:18.141 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-09-15T20:33:18.190 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-15T20:33:18.190 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Ubuntu" 2024-09-15T20:33:18.190 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="22.04" 2024-09-15T20:33:18.190 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-15T20:33:18.190 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_CODENAME=jammy 2024-09-15T20:33:18.190 INFO:teuthology.orchestra.run.smithi052.stdout:ID=ubuntu 2024-09-15T20:33:18.190 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE=debian 2024-09-15T20:33:18.190 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-15T20:33:18.190 INFO:teuthology.orchestra.run.smithi052.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-15T20:33:18.190 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-15T20:33:18.190 INFO:teuthology.orchestra.run.smithi052.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-15T20:33:18.190 INFO:teuthology.orchestra.run.smithi052.stdout:UBUNTU_CODENAME=jammy 2024-09-15T20:33:18.191 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-09-15T20:33:18.212 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-15T20:33:18.217 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-15T20:33:18.217 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-15T20:33:18.264 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-15T20:33:18.264 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2024-09-15T20:33:18.264 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="22.04" 2024-09-15T20:33:18.264 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-15T20:33:18.264 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=jammy 2024-09-15T20:33:18.264 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2024-09-15T20:33:18.264 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2024-09-15T20:33:18.264 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-15T20:33:18.264 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-15T20:33:18.264 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-15T20:33:18.264 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-15T20:33:18.265 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=jammy 2024-09-15T20:33:18.265 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-15T20:33:18.358 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T20:33:18.367 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T20:33:18.380 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T20:33:18.380 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-09-15T20:33:18.382 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-15T20:33:18.387 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T20:33:18.392 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T20:33:18.392 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-09-15T20:33:18.432 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-15T20:33:18.443 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T20:33:18.497 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T20:33:18.513 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-15T20:33:18.513 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-15T20:33:18.513 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T20:33:18.514 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T20:33:18.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:33:18.518 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-15T20:33:18.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:33:18.520 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-15T20:33:18.568 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-56-generic 2024-09-15T20:33:18.569 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.15.0-56-generic 2024-09-15T20:33:18.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2024-09-15T20:33:18.570 INFO:teuthology.orchestra.run.smithi052.stdout:5.15.0-56-generic 2024-09-15T20:33:18.571 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.15.0-56-generic 2024-09-15T20:33:18.571 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get clean 2024-09-15T20:33:18.687 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2024-09-15T20:33:18.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-15T20:33:18.823 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-15T20:33:18.865 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-15T20:33:18.940 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T20:33:18.970 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T20:33:19.022 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-15T20:33:19.039 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-15T20:33:19.052 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-15T20:33:19.081 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-15T20:33:19.110 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-15T20:33:19.148 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-15T20:33:19.150 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-15T20:33:19.150 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-15T20:33:19.151 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-15T20:33:19.171 INFO:teuthology.orchestra.run.smithi052.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-15T20:33:19.174 INFO:teuthology.orchestra.run.smithi052.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-15T20:33:19.174 INFO:teuthology.orchestra.run.smithi052.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-15T20:33:19.181 INFO:teuthology.orchestra.run.smithi052.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-15T20:33:19.184 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-15T20:33:19.185 INFO:teuthology.orchestra.run.smithi052.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-15T20:33:19.187 INFO:teuthology.orchestra.run.smithi052.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-15T20:33:19.187 INFO:teuthology.orchestra.run.smithi052.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-15T20:33:19.187 INFO:teuthology.orchestra.run.smithi052.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-15T20:33:19.187 INFO:teuthology.orchestra.run.smithi052.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-15T20:33:19.190 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-15T20:33:19.192 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-15T20:33:19.192 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-15T20:33:19.193 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-15T20:33:19.202 INFO:teuthology.orchestra.run.smithi052.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-15T20:33:19.215 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-15T20:33:19.220 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-15T20:33:19.220 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-15T20:33:19.228 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-15T20:33:19.234 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-15T20:33:19.236 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-15T20:33:19.236 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-15T20:33:19.236 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-15T20:33:19.236 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-15T20:33:19.282 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-15T20:33:19.379 INFO:teuthology.orchestra.run.smithi052.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-15T20:33:19.408 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-15T20:33:19.518 INFO:teuthology.orchestra.run.smithi052.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-15T20:33:19.548 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-15T20:33:19.837 INFO:teuthology.orchestra.run.smithi052.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-15T20:33:19.868 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-15T20:33:19.872 INFO:teuthology.orchestra.run.smithi052.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-15T20:33:19.886 INFO:teuthology.orchestra.run.smithi052.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-15T20:33:19.887 INFO:teuthology.orchestra.run.smithi052.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-15T20:33:19.900 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-15T20:33:19.915 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-15T20:33:19.916 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-15T20:33:19.957 INFO:teuthology.orchestra.run.smithi052.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-15T20:33:19.958 INFO:teuthology.orchestra.run.smithi052.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-15T20:33:19.973 INFO:teuthology.orchestra.run.smithi052.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-15T20:33:19.974 INFO:teuthology.orchestra.run.smithi052.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-15T20:33:19.996 INFO:teuthology.orchestra.run.smithi052.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-15T20:33:20.018 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-15T20:33:20.019 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-15T20:33:20.024 INFO:teuthology.orchestra.run.smithi052.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-15T20:33:20.030 INFO:teuthology.orchestra.run.smithi052.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-15T20:33:20.031 INFO:teuthology.orchestra.run.smithi052.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-15T20:33:20.032 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-15T20:33:20.032 INFO:teuthology.orchestra.run.smithi052.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-15T20:33:20.033 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-15T20:33:20.061 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-15T20:33:20.083 INFO:teuthology.orchestra.run.smithi052.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-15T20:33:20.084 INFO:teuthology.orchestra.run.smithi052.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-15T20:33:20.084 INFO:teuthology.orchestra.run.smithi052.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-15T20:33:20.085 INFO:teuthology.orchestra.run.smithi052.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-15T20:33:20.087 INFO:teuthology.orchestra.run.smithi052.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-15T20:33:20.088 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-15T20:33:20.093 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-15T20:33:20.094 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-15T20:33:20.095 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-15T20:33:20.110 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-15T20:33:20.111 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-15T20:33:20.165 INFO:teuthology.orchestra.run.smithi052.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-15T20:33:20.165 INFO:teuthology.orchestra.run.smithi052.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-15T20:33:20.165 INFO:teuthology.orchestra.run.smithi052.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-15T20:33:20.166 INFO:teuthology.orchestra.run.smithi052.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-15T20:33:20.167 INFO:teuthology.orchestra.run.smithi052.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-15T20:33:20.177 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-15T20:33:20.178 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-15T20:33:20.180 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-15T20:33:20.180 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-15T20:33:20.180 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-15T20:33:20.191 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-15T20:33:20.192 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-15T20:33:20.193 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-15T20:33:25.558 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 16.0 MB in 2s (7,471 kB/s) 2024-09-15T20:33:25.758 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 16.0 MB in 2s (7,361 kB/s) 2024-09-15T20:33:27.104 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-15T20:33:27.114 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-15T20:33:27.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T20:33:27.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T20:33:27.190 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-15T20:33:27.196 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-15T20:33:27.397 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-09-15T20:33:27.397 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-09-15T20:33:27.402 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-15T20:33:27.403 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-15T20:33:27.575 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T20:33:27.575 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T20:33:27.575 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T20:33:27.576 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T20:33:27.576 INFO:teuthology.orchestra.run.smithi052.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-15T20:33:27.576 INFO:teuthology.orchestra.run.smithi052.stdout: python2.7-minimal 2024-09-15T20:33:27.576 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T20:33:27.577 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2024-09-15T20:33:27.578 INFO:teuthology.orchestra.run.smithi052.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T20:33:27.578 INFO:teuthology.orchestra.run.smithi052.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-15T20:33:27.578 INFO:teuthology.orchestra.run.smithi052.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-15T20:33:27.579 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2024-09-15T20:33:27.579 INFO:teuthology.orchestra.run.smithi052.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-15T20:33:27.579 INFO:teuthology.orchestra.run.smithi052.stdout:Recommended packages: 2024-09-15T20:33:27.579 INFO:teuthology.orchestra.run.smithi052.stdout: thermald 2024-09-15T20:33:27.590 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T20:33:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T20:33:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T20:33:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T20:33:27.591 INFO:teuthology.orchestra.run.smithi081.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-15T20:33:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: python2.7-minimal 2024-09-15T20:33:27.592 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T20:33:27.593 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-09-15T20:33:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T20:33:27.593 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-15T20:33:27.594 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-15T20:33:27.595 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-09-15T20:33:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-15T20:33:27.595 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-09-15T20:33:27.595 INFO:teuthology.orchestra.run.smithi081.stdout: thermald 2024-09-15T20:33:27.621 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2024-09-15T20:33:27.621 INFO:teuthology.orchestra.run.smithi052.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T20:33:27.621 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-15T20:33:27.621 INFO:teuthology.orchestra.run.smithi052.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-15T20:33:27.622 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages will be upgraded: 2024-09-15T20:33:27.623 INFO:teuthology.orchestra.run.smithi052.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-15T20:33:27.644 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-09-15T20:33:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-15T20:33:27.644 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-15T20:33:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-15T20:33:27.645 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2024-09-15T20:33:27.645 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-15T20:33:27.674 INFO:teuthology.orchestra.run.smithi052.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T20:33:27.674 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 113 MB of archives. 2024-09-15T20:33:27.674 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-15T20:33:27.674 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-15T20:33:27.824 INFO:teuthology.orchestra.run.smithi081.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T20:33:27.824 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 113 MB of archives. 2024-09-15T20:33:27.824 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-15T20:33:27.825 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-15T20:33:28.231 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-15T20:33:28.361 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-15T20:33:29.169 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-15T20:33:29.169 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-15T20:33:29.170 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-15T20:33:29.195 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-15T20:33:29.300 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-15T20:33:29.323 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-15T20:33:29.545 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-15T20:33:29.731 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 113 MB in 2s (66.9 MB/s) 2024-09-15T20:33:29.901 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-15T20:33:31.722 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-15T20:33:31.722 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-15T20:33:31.723 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-15T20:33:31.905 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-15T20:33:31.909 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T20:33:31.965 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:32.058 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-15T20:33:32.137 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-15T20:33:32.529 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 113 MB in 4s (25.3 MB/s) 2024-09-15T20:33:32.700 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-15T20:33:34.150 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-15T20:33:34.163 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T20:33:34.251 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:34.720 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-15T20:33:34.740 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T20:33:34.778 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:34.802 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-15T20:33:34.808 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T20:33:34.977 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:37.353 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-15T20:33:37.375 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T20:33:37.501 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:37.990 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-15T20:33:38.010 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T20:33:38.048 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:41.780 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T20:33:41.899 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T20:33:42.232 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T20:33:42.352 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T20:33:42.672 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-15T20:33:42.695 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-15T20:33:42.730 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T20:33:45.243 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T20:33:45.344 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T20:33:45.727 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T20:33:45.856 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T20:33:46.159 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-15T20:33:46.182 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-15T20:33:46.217 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T20:33:48.148 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-15T20:33:48.185 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T20:33:48.223 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:52.212 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T20:33:52.343 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T20:33:52.676 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T20:33:52.792 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-15T20:33:52.798 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:52.829 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-15T20:33:52.892 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:52.924 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-15T20:33:53.028 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:54.357 INFO:teuthology.orchestra.run.smithi052.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-15T20:33:54.357 INFO:teuthology.orchestra.run.smithi052.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-15T20:33:54.357 INFO:teuthology.orchestra.run.smithi052.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-15T20:33:54.357 INFO:teuthology.orchestra.run.smithi052.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-15T20:33:54.540 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:55.966 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-15T20:33:56.913 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-15T20:33:57.306 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-15T20:33:57.376 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-15T20:33:57.410 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:57.485 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-15T20:33:57.536 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-15T20:33:57.611 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:57.639 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:33:57.677 INFO:teuthology.orchestra.run.smithi052.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-15T20:33:57.677 INFO:teuthology.orchestra.run.smithi052.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-15T20:33:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-15T20:33:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-15T20:33:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-15T20:33:59.034 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-15T20:33:59.217 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:34:01.444 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:34:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-15T20:34:02.996 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-15T20:34:03.122 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-15T20:34:03.189 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-15T20:34:03.189 INFO:teuthology.orchestra.run.smithi081.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-15T20:34:12.675 INFO:teuthology.orchestra.run.smithi052.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-15T20:34:12.675 INFO:teuthology.orchestra.run.smithi052.stdout:Sourcing file `/etc/default/grub' 2024-09-15T20:34:12.701 INFO:teuthology.orchestra.run.smithi052.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T20:34:12.723 INFO:teuthology.orchestra.run.smithi052.stdout:Generating grub configuration file ... 2024-09-15T20:34:13.044 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T20:34:13.068 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T20:34:13.429 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T20:34:13.435 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T20:34:13.505 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T20:34:13.511 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T20:34:13.658 INFO:teuthology.orchestra.run.smithi052.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T20:34:13.659 INFO:teuthology.orchestra.run.smithi052.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T20:34:13.659 INFO:teuthology.orchestra.run.smithi052.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T20:34:13.697 INFO:teuthology.orchestra.run.smithi052.stdout:done 2024-09-15T20:34:14.159 DEBUG:teuthology.orchestra.run.smithi052:> dpkg -s linux-image-generic 2024-09-15T20:34:14.179 INFO:teuthology.orchestra.run.smithi052.stdout:Package: linux-image-generic 2024-09-15T20:34:14.179 INFO:teuthology.orchestra.run.smithi052.stdout:Status: install ok installed 2024-09-15T20:34:14.179 INFO:teuthology.orchestra.run.smithi052.stdout:Priority: optional 2024-09-15T20:34:14.179 INFO:teuthology.orchestra.run.smithi052.stdout:Section: kernel 2024-09-15T20:34:14.179 INFO:teuthology.orchestra.run.smithi052.stdout:Installed-Size: 21 2024-09-15T20:34:14.179 INFO:teuthology.orchestra.run.smithi052.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T20:34:14.180 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: amd64 2024-09-15T20:34:14.180 INFO:teuthology.orchestra.run.smithi052.stdout:Source: linux-meta 2024-09-15T20:34:14.180 INFO:teuthology.orchestra.run.smithi052.stdout:Version: 5.15.0.121.121 2024-09-15T20:34:14.180 INFO:teuthology.orchestra.run.smithi052.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T20:34:14.180 INFO:teuthology.orchestra.run.smithi052.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T20:34:14.180 INFO:teuthology.orchestra.run.smithi052.stdout:Recommends: thermald 2024-09-15T20:34:14.180 INFO:teuthology.orchestra.run.smithi052.stdout:Description: Generic Linux kernel image 2024-09-15T20:34:14.180 INFO:teuthology.orchestra.run.smithi052.stdout: This package will always depend on the latest generic kernel image 2024-09-15T20:34:14.180 INFO:teuthology.orchestra.run.smithi052.stdout: available. 2024-09-15T20:34:14.180 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-15T20:34:14.181 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T20:34:14.181 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T20:34:14.181 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-15T20:34:14.181 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T20:34:14.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get clean 2024-09-15T20:34:14.363 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2024-09-15T20:34:14.473 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-15T20:34:14.601 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T20:34:14.682 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T20:34:14.764 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T20:34:14.988 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 129 kB in 0s (273 kB/s) 2024-09-15T20:34:16.013 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-15T20:34:16.033 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T20:34:16.097 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-15T20:34:16.310 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-09-15T20:34:16.311 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-09-15T20:34:16.505 INFO:teuthology.orchestra.run.smithi052.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-15T20:34:16.505 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T20:34:16.506 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T20:34:16.506 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T20:34:16.506 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T20:34:16.506 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T20:34:16.506 INFO:teuthology.orchestra.run.smithi052.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T20:34:16.506 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T20:34:16.548 INFO:teuthology.orchestra.run.smithi052.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T20:34:16.549 DEBUG:teuthology.orchestra.run.smithi052:> dpkg -s linux-image-generic 2024-09-15T20:34:16.566 INFO:teuthology.orchestra.run.smithi052.stdout:Package: linux-image-generic 2024-09-15T20:34:16.566 INFO:teuthology.orchestra.run.smithi052.stdout:Status: install ok installed 2024-09-15T20:34:16.566 INFO:teuthology.orchestra.run.smithi052.stdout:Priority: optional 2024-09-15T20:34:16.566 INFO:teuthology.orchestra.run.smithi052.stdout:Section: kernel 2024-09-15T20:34:16.566 INFO:teuthology.orchestra.run.smithi052.stdout:Installed-Size: 21 2024-09-15T20:34:16.566 INFO:teuthology.orchestra.run.smithi052.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T20:34:16.566 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: amd64 2024-09-15T20:34:16.566 INFO:teuthology.orchestra.run.smithi052.stdout:Source: linux-meta 2024-09-15T20:34:16.566 INFO:teuthology.orchestra.run.smithi052.stdout:Version: 5.15.0.121.121 2024-09-15T20:34:16.567 INFO:teuthology.orchestra.run.smithi052.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T20:34:16.567 INFO:teuthology.orchestra.run.smithi052.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T20:34:16.567 INFO:teuthology.orchestra.run.smithi052.stdout:Recommends: thermald 2024-09-15T20:34:16.567 INFO:teuthology.orchestra.run.smithi052.stdout:Description: Generic Linux kernel image 2024-09-15T20:34:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: This package will always depend on the latest generic kernel image 2024-09-15T20:34:16.567 INFO:teuthology.orchestra.run.smithi052.stdout: available. 2024-09-15T20:34:16.567 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-15T20:34:16.614 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.JsZg51wLkS 2024-09-15T20:34:16.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub/grub.cfg /tmp/tmp.JsZg51wLkS 2024-09-15T20:34:16.671 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.JsZg51wLkS 2024-09-15T20:34:16.786 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.JsZg51wLkS is 10KB 2024-09-15T20:34:16.798 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.JsZg51wLkS 2024-09-15T20:34:16.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-15T20:34:16.857 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:34:16.858 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-15T20:34:16.858 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-15T20:34:16.956 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-15T20:34:16.956 DEBUG:teuthology.orchestra.run.smithi052:> sudo update-grub 2024-09-15T20:34:17.710 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-15T20:34:17.710 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub' 2024-09-15T20:34:17.734 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T20:34:17.754 INFO:teuthology.orchestra.run.smithi081.stdout:Generating grub configuration file ... 2024-09-15T20:34:18.138 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T20:34:18.161 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T20:34:18.230 INFO:teuthology.orchestra.run.smithi052.stderr:Sourcing file `/etc/default/grub' 2024-09-15T20:34:18.231 INFO:teuthology.orchestra.run.smithi052.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T20:34:18.233 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2024-09-15T20:34:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T20:34:18.488 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T20:34:18.557 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T20:34:18.563 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T20:34:18.626 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T20:34:18.631 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T20:34:18.774 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T20:34:18.780 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T20:34:18.824 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T20:34:18.829 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T20:34:18.837 INFO:teuthology.orchestra.run.smithi081.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T20:34:18.837 INFO:teuthology.orchestra.run.smithi081.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T20:34:18.837 INFO:teuthology.orchestra.run.smithi081.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T20:34:18.876 INFO:teuthology.orchestra.run.smithi081.stdout:done 2024-09-15T20:34:18.962 INFO:teuthology.orchestra.run.smithi052.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T20:34:18.962 INFO:teuthology.orchestra.run.smithi052.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T20:34:18.962 INFO:teuthology.orchestra.run.smithi052.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T20:34:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:done 2024-09-15T20:34:18.981 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2024-09-15T20:34:19.347 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2024-09-15T20:34:19.372 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2024-09-15T20:34:19.372 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2024-09-15T20:34:19.372 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2024-09-15T20:34:19.373 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2024-09-15T20:34:19.373 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 21 2024-09-15T20:34:19.373 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T20:34:19.373 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2024-09-15T20:34:19.373 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2024-09-15T20:34:19.373 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.121.121 2024-09-15T20:34:19.373 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T20:34:19.373 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T20:34:19.373 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2024-09-15T20:34:19.373 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2024-09-15T20:34:19.373 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2024-09-15T20:34:19.374 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2024-09-15T20:34:19.374 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-15T20:34:19.375 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T20:34:19.375 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T20:34:19.375 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-15T20:34:19.375 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T20:34:19.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2024-09-15T20:34:19.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-15T20:34:19.804 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T20:34:19.804 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-15T20:34:19.876 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T20:34:19.957 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T20:34:20.240 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 129 kB in 1s (241 kB/s) 2024-09-15T20:34:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-15T20:34:21.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-15T20:34:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-15T20:34:21.470 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-15T20:34:21.471 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-15T20:34:21.636 INFO:teuthology.orchestra.run.smithi081.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-15T20:34:21.636 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T20:34:21.636 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T20:34:21.636 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T20:34:21.636 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T20:34:21.636 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T20:34:21.637 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T20:34:21.637 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T20:34:21.677 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-15T20:34:21.678 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2024-09-15T20:34:21.734 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2024-09-15T20:34:21.734 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2024-09-15T20:34:21.734 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2024-09-15T20:34:21.734 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2024-09-15T20:34:21.734 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 21 2024-09-15T20:34:21.734 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T20:34:21.735 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2024-09-15T20:34:21.735 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2024-09-15T20:34:21.735 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.121.121 2024-09-15T20:34:21.735 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T20:34:21.735 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T20:34:21.735 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2024-09-15T20:34:21.735 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2024-09-15T20:34:21.735 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2024-09-15T20:34:21.735 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2024-09-15T20:34:21.735 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-15T20:34:21.779 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.fyLj7BX7UZ 2024-09-15T20:34:21.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub/grub.cfg /tmp/tmp.fyLj7BX7UZ 2024-09-15T20:34:21.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.fyLj7BX7UZ 2024-09-15T20:34:21.952 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.fyLj7BX7UZ is 10KB 2024-09-15T20:34:21.964 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.fyLj7BX7UZ 2024-09-15T20:34:21.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-15T20:34:22.023 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:34:22.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-15T20:34:22.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-15T20:34:22.091 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-15T20:34:22.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo update-grub 2024-09-15T20:34:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub' 2024-09-15T20:34:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T20:34:23.610 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-15T20:34:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T20:34:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T20:34:24.275 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T20:34:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T20:34:24.321 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T20:34:24.329 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T20:34:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T20:34:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T20:34:24.450 INFO:teuthology.orchestra.run.smithi081.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T20:34:24.460 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-15T20:34:24.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-15T20:34:49.001 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-15T20:34:49.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-15T20:34:49.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T20:34:54.481 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-15T20:34:54.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-15T20:34:54.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T20:35:07.453 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-09-15T20:35:12.836 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-15T20:35:16.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-15T20:35:16.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T20:35:21.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-15T20:35:21.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T20:35:24.897 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-15T20:35:36.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-15T20:35:36.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T20:36:08.670 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-15T20:36:09.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-15T20:36:09.272 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-15T20:36:09.273 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-15T20:36:09.318 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-121-generic 2024-09-15T20:36:09.318 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-15T20:36:09.318 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T20:36:09.318 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-15T20:36:10.319 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-15T20:36:10.319 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T20:36:10.389 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-09-15T20:36:10.419 DEBUG:teuthology.parallel:result is None 2024-09-15T20:36:16.460 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T20:36:28.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-15T20:36:28.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T20:36:28.754 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-15T20:36:29.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-15T20:36:29.352 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-15T20:36:29.352 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-09-15T20:36:29.404 INFO:teuthology.orchestra.run.smithi052.stdout:5.15.0-121-generic 2024-09-15T20:36:29.404 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-15T20:36:29.404 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T20:36:29.404 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-15T20:36:30.405 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-15T20:36:30.405 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T20:36:30.484 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2024-09-15T20:36:30.509 DEBUG:teuthology.parallel:result is None 2024-09-15T20:36:30.510 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T20:36:30.525 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T20:36:30.525 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T20:36:30.528 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T20:36:30.534 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T20:36:30.540 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T20:36:30.547 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T20:36:30.547 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T20:36:30.577 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T20:36:30.597 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T20:36:30.604 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T20:36:30.604 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T20:36:30.633 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T20:36:30.650 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T20:36:30.658 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T20:36:30.697 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T20:36:30.706 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T20:36:30.708 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T20:36:30.715 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T20:36:30.715 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T20:36:30.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T20:36:30.731 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T20:36:30.741 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T20:36:30.741 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T20:36:30.773 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T20:36:30.778 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T20:36:30.824 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T20:36:30.872 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:36:30.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T20:36:30.937 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T20:36:30.942 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T20:36:30.990 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:36:30.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T20:36:31.055 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-09-15T20:36:31.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-15T20:36:31.130 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T20:36:31.137 INFO:teuthology.task.internal:Starting timer... 2024-09-15T20:36:31.138 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T20:36:31.149 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T20:36:31.158 DEBUG:teuthology.task.selinux:Excluding smithi052: OS 'ubuntu' does not support SELinux 2024-09-15T20:36:31.158 DEBUG:teuthology.task.selinux:Excluding smithi081: OS 'ubuntu' does not support SELinux 2024-09-15T20:36:31.158 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T20:36:31.158 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-15T20:36:31.158 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T20:36:31.158 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T20:36:31.167 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T20:36:31.179 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T20:36:31.180 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi081.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T20:44:06.823 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com')] 2024-09-15T20:44:06.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-15T20:44:06.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T20:44:06.911 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-15T20:44:06.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-15T20:44:06.989 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-15T20:44:06.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T20:44:07.068 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-15T20:44:07.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-15T20:44:07.145 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T20:44:07.157 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T20:44:07.157 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T20:44:07.157 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T20:44:07.160 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T20:44:07.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T20:44:07.188 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-15T20:44:07.188 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: Command line: ntpd -gq 2024-09-15T20:44:07.188 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: ---------------------------------------------------- 2024-09-15T20:44:07.188 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: ntp-4 is maintained by Network Time Foundation, 2024-09-15T20:44:07.188 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-15T20:44:07.188 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: corporation. Support and training for ntp-4 are 2024-09-15T20:44:07.189 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: available at https://www.nwtime.org/support 2024-09-15T20:44:07.189 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: ---------------------------------------------------- 2024-09-15T20:44:07.189 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: proto: precision = 0.046 usec (-24) 2024-09-15T20:44:07.190 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: basedate set to 2022-02-04 2024-09-15T20:44:07.190 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: gps base set to 2022-02-06 (week 2196) 2024-09-15T20:44:07.190 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T20:44:07.190 INFO:teuthology.orchestra.run.smithi052.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T20:44:07.190 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: restrict ::: KOD does nothing without LIMITED. 2024-09-15T20:44:07.191 INFO:teuthology.orchestra.run.smithi052.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-15T20:44:07.191 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: Listen and drop on 0 v6wildcard [::]:123 2024-09-15T20:44:07.192 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-15T20:44:07.192 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: Listen normally on 2 lo 127.0.0.1:123 2024-09-15T20:44:07.192 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: Listen normally on 3 ens1f0 172.21.15.52:123 2024-09-15T20:44:07.192 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: Listen normally on 4 lo [::1]:123 2024-09-15T20:44:07.192 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15de%4]:123 2024-09-15T20:44:07.192 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:07 ntpd[18391]: Listening on routing socket on fd #22 for interface updates 2024-09-15T20:44:07.215 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-15T20:44:07.215 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: Command line: ntpd -gq 2024-09-15T20:44:07.215 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: ---------------------------------------------------- 2024-09-15T20:44:07.215 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: ntp-4 is maintained by Network Time Foundation, 2024-09-15T20:44:07.215 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-15T20:44:07.215 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: corporation. Support and training for ntp-4 are 2024-09-15T20:44:07.215 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: available at https://www.nwtime.org/support 2024-09-15T20:44:07.215 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: ---------------------------------------------------- 2024-09-15T20:44:07.216 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: proto: precision = 0.044 usec (-24) 2024-09-15T20:44:07.216 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: basedate set to 2022-02-04 2024-09-15T20:44:07.216 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: gps base set to 2022-02-06 (week 2196) 2024-09-15T20:44:07.216 INFO:teuthology.orchestra.run.smithi081.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T20:44:07.217 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T20:44:07.217 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: restrict ::: KOD does nothing without LIMITED. 2024-09-15T20:44:07.217 INFO:teuthology.orchestra.run.smithi081.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-15T20:44:07.218 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: Listen and drop on 0 v6wildcard [::]:123 2024-09-15T20:44:07.218 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-15T20:44:07.218 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: Listen normally on 2 lo 127.0.0.1:123 2024-09-15T20:44:07.218 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: Listen normally on 3 enp3s0f1 172.21.15.81:123 2024-09-15T20:44:07.219 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: Listen normally on 4 lo [::1]:123 2024-09-15T20:44:07.219 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d753%5]:123 2024-09-15T20:44:07.219 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:07 ntpd[18483]: Listening on routing socket on fd #22 for interface updates 2024-09-15T20:44:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:08.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:08.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:08 ntpd[18391]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:09.215 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:09 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:09.215 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:09 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:10.194 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:10.195 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:10.196 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:10.196 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:10.196 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:10.196 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:10.196 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:10.196 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:10.196 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:10 ntpd[18391]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:10.215 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:10 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:10.215 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:10 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:10.216 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:10 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:10.216 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:10 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:10.216 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:10 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:10.216 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:10 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:12.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:12.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:12.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:12.192 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:12 ntpd[18391]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:12 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:14.189 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:14 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:14.189 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:14 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:14.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:14 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:14.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:14 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:14.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:14 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:14.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:14 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:14.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:14 ntpd[18391]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:14.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:14 ntpd[18391]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:14.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:14 ntpd[18391]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:14.190 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:14 ntpd[18391]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:14.190 INFO:teuthology.orchestra.run.smithi052.stdout:15 Sep 20:44:14 ntpd[18391]: ntpd: time slew +0.000915 s 2024-09-15T20:44:14.191 INFO:teuthology.orchestra.run.smithi052.stdout:ntpd: time slew +0.000915s 2024-09-15T20:44:14.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:14 ntpd[18391]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-15T20:44:14.191 INFO:teuthology.orchestra.run.smithi052.stderr:15 Sep 20:44:14 ntpd[18391]: can't open /var/log/ntpstats/loopstats.20240915: Permission denied 2024-09-15T20:44:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:14.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:14.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:14 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:14.244 INFO:teuthology.orchestra.run.smithi052.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T20:44:14.244 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================== 2024-09-15T20:44:14.244 INFO:teuthology.orchestra.run.smithi052.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T20:44:14.244 INFO:teuthology.orchestra.run.smithi052.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T20:44:14.244 INFO:teuthology.orchestra.run.smithi052.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T20:44:14.244 INFO:teuthology.orchestra.run.smithi052.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T20:44:16.216 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:16.216 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:16.216 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:16.216 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T20:44:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T20:44:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T20:44:16.217 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T20:44:16.217 INFO:teuthology.orchestra.run.smithi081.stdout:15 Sep 20:44:16 ntpd[18483]: ntpd: time slew +0.000502 s 2024-09-15T20:44:16.218 INFO:teuthology.orchestra.run.smithi081.stdout:ntpd: time slew +0.000502s 2024-09-15T20:44:16.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-15T20:44:16.218 INFO:teuthology.orchestra.run.smithi081.stderr:15 Sep 20:44:16 ntpd[18483]: can't open /var/log/ntpstats/loopstats.20240915: Permission denied 2024-09-15T20:44:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T20:44:16.261 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-09-15T20:44:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T20:44:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T20:44:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T20:44:16.261 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T20:44:16.262 INFO:teuthology.run_tasks:Running task install... 2024-09-15T20:44:16.274 DEBUG:teuthology.task.install:project ceph 2024-09-15T20:44:16.275 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'fc3e0bff7468fd55478adbae7f75508b749124b6'}} 2024-09-15T20:44:16.275 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'flavor': 'default', 'sha1': 'fc3e0bff7468fd55478adbae7f75508b749124b6'} 2024-09-15T20:44:16.275 INFO:teuthology.task.install:Using flavor: default 2024-09-15T20:44:16.281 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T20:44:16.281 INFO:teuthology.task.install:extra packages: [] 2024-09-15T20:44:16.281 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-key list | grep Ceph 2024-09-15T20:44:16.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-key list | grep Ceph 2024-09-15T20:44:16.350 INFO:teuthology.orchestra.run.smithi052.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-15T20:44:16.361 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-15T20:44:16.383 INFO:teuthology.orchestra.run.smithi052.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-15T20:44:16.383 INFO:teuthology.orchestra.run.smithi052.stdout:uid [ unknown] Ceph.com (release key) 2024-09-15T20:44:16.383 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-15T20:44:16.384 INFO:teuthology.task.install.deb:Installing system (non-project) packages: sqlite3 on remote deb x86_64 2024-09-15T20:44:16.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fc3e0bff7468fd55478adbae7f75508b749124b6 2024-09-15T20:44:16.389 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-15T20:44:16.389 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph.com (release key) 2024-09-15T20:44:16.390 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-15T20:44:16.390 INFO:teuthology.task.install.deb:Installing system (non-project) packages: sqlite3 on remote deb x86_64 2024-09-15T20:44:16.390 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fc3e0bff7468fd55478adbae7f75508b749124b6 2024-09-15T20:44:16.531 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default/ 2024-09-15T20:44:16.531 INFO:teuthology.task.install.deb:Package version is 19.3.0-4930-gfc3e0bff-1jammy 2024-09-15T20:44:16.534 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default/ 2024-09-15T20:44:16.534 INFO:teuthology.task.install.deb:Package version is 19.3.0-4930-gfc3e0bff-1jammy 2024-09-15T20:44:16.645 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:44:16.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-15T20:44:16.651 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:44:16.651 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-15T20:44:16.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-15T20:44:16.666 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2024-09-15T20:44:16.824 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T20:44:16.833 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T20:44:16.833 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T20:44:16.834 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T20:44:16.843 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T20:44:16.851 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T20:44:16.860 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T20:44:16.878 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy InRelease 2024-09-15T20:44:16.888 INFO:teuthology.orchestra.run.smithi052.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy InRelease 2024-09-15T20:44:16.900 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-15T20:44:16.909 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-15T20:44:16.921 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-15T20:44:16.931 INFO:teuthology.orchestra.run.smithi052.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-15T20:44:16.942 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-15T20:44:16.946 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T20:44:16.952 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-15T20:44:16.981 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-15T20:44:16.989 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-15T20:44:17.165 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 29.2 kB in 0s (87.5 kB/s) 2024-09-15T20:44:17.209 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 29.2 kB in 0s (81.4 kB/s) 2024-09-15T20:44:18.130 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-15T20:44:18.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4930-gfc3e0bff-1jammy cephadm=19.3.0-4930-gfc3e0bff-1jammy ceph-mds=19.3.0-4930-gfc3e0bff-1jammy ceph-mgr=19.3.0-4930-gfc3e0bff-1jammy ceph-common=19.3.0-4930-gfc3e0bff-1jammy ceph-fuse=19.3.0-4930-gfc3e0bff-1jammy ceph-test=19.3.0-4930-gfc3e0bff-1jammy ceph-volume=19.3.0-4930-gfc3e0bff-1jammy radosgw=19.3.0-4930-gfc3e0bff-1jammy python3-rados=19.3.0-4930-gfc3e0bff-1jammy python3-rgw=19.3.0-4930-gfc3e0bff-1jammy python3-cephfs=19.3.0-4930-gfc3e0bff-1jammy python3-rbd=19.3.0-4930-gfc3e0bff-1jammy libcephfs2=19.3.0-4930-gfc3e0bff-1jammy libcephfs-dev=19.3.0-4930-gfc3e0bff-1jammy librados2=19.3.0-4930-gfc3e0bff-1jammy librbd1=19.3.0-4930-gfc3e0bff-1jammy rbd-fuse=19.3.0-4930-gfc3e0bff-1jammy 2024-09-15T20:44:18.209 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-15T20:44:18.253 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-15T20:44:18.269 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4930-gfc3e0bff-1jammy cephadm=19.3.0-4930-gfc3e0bff-1jammy ceph-mds=19.3.0-4930-gfc3e0bff-1jammy ceph-mgr=19.3.0-4930-gfc3e0bff-1jammy ceph-common=19.3.0-4930-gfc3e0bff-1jammy ceph-fuse=19.3.0-4930-gfc3e0bff-1jammy ceph-test=19.3.0-4930-gfc3e0bff-1jammy ceph-volume=19.3.0-4930-gfc3e0bff-1jammy radosgw=19.3.0-4930-gfc3e0bff-1jammy python3-rados=19.3.0-4930-gfc3e0bff-1jammy python3-rgw=19.3.0-4930-gfc3e0bff-1jammy python3-cephfs=19.3.0-4930-gfc3e0bff-1jammy python3-rbd=19.3.0-4930-gfc3e0bff-1jammy libcephfs2=19.3.0-4930-gfc3e0bff-1jammy libcephfs-dev=19.3.0-4930-gfc3e0bff-1jammy librados2=19.3.0-4930-gfc3e0bff-1jammy librbd1=19.3.0-4930-gfc3e0bff-1jammy rbd-fuse=19.3.0-4930-gfc3e0bff-1jammy 2024-09-15T20:44:18.323 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-15T20:44:18.417 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-15T20:44:18.418 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-15T20:44:18.513 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-09-15T20:44:18.514 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-09-15T20:44:18.610 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T20:44:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T20:44:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T20:44:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T20:44:18.612 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T20:44:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T20:44:18.613 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T20:44:18.613 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-09-15T20:44:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-15T20:44:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-15T20:44:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-15T20:44:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-15T20:44:18.613 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-15T20:44:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-15T20:44:18.614 INFO:teuthology.orchestra.run.smithi081.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-15T20:44:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-15T20:44:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-15T20:44:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-15T20:44:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-15T20:44:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-15T20:44:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-15T20:44:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-15T20:44:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-15T20:44:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-15T20:44:18.615 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-15T20:44:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-15T20:44:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-15T20:44:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-15T20:44:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-15T20:44:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-15T20:44:18.616 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-15T20:44:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet zip 2024-09-15T20:44:18.617 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-09-15T20:44:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-15T20:44:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-15T20:44:18.617 INFO:teuthology.orchestra.run.smithi081.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-15T20:44:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-15T20:44:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-15T20:44:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-15T20:44:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-15T20:44:18.618 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-09-15T20:44:18.618 INFO:teuthology.orchestra.run.smithi081.stdout: btrfs-tools 2024-09-15T20:44:18.706 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T20:44:18.706 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T20:44:18.706 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T20:44:18.706 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T20:44:18.707 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T20:44:18.707 INFO:teuthology.orchestra.run.smithi052.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T20:44:18.707 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T20:44:18.708 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2024-09-15T20:44:18.708 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-15T20:44:18.708 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-15T20:44:18.709 INFO:teuthology.orchestra.run.smithi052.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-15T20:44:18.709 INFO:teuthology.orchestra.run.smithi052.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-15T20:44:18.709 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-15T20:44:18.709 INFO:teuthology.orchestra.run.smithi052.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-15T20:44:18.709 INFO:teuthology.orchestra.run.smithi052.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-15T20:44:18.709 INFO:teuthology.orchestra.run.smithi052.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-15T20:44:18.710 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-15T20:44:18.711 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-15T20:44:18.711 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet zip 2024-09-15T20:44:18.711 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2024-09-15T20:44:18.711 INFO:teuthology.orchestra.run.smithi052.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-15T20:44:18.711 INFO:teuthology.orchestra.run.smithi052.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-15T20:44:18.711 INFO:teuthology.orchestra.run.smithi052.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-15T20:44:18.711 INFO:teuthology.orchestra.run.smithi052.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-15T20:44:18.711 INFO:teuthology.orchestra.run.smithi052.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-15T20:44:18.711 INFO:teuthology.orchestra.run.smithi052.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-15T20:44:18.711 INFO:teuthology.orchestra.run.smithi052.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-15T20:44:18.711 INFO:teuthology.orchestra.run.smithi052.stdout:Recommended packages: 2024-09-15T20:44:18.712 INFO:teuthology.orchestra.run.smithi052.stdout: btrfs-tools 2024-09-15T20:44:18.719 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-09-15T20:44:18.719 INFO:teuthology.orchestra.run.smithi081.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-15T20:44:18.719 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-15T20:44:18.719 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-15T20:44:18.719 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-15T20:44:18.719 INFO:teuthology.orchestra.run.smithi081.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-15T20:44:18.720 INFO:teuthology.orchestra.run.smithi081.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-15T20:44:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-15T20:44:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-15T20:44:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-15T20:44:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-15T20:44:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-15T20:44:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-15T20:44:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-15T20:44:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-15T20:44:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-15T20:44:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-15T20:44:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-15T20:44:18.721 INFO:teuthology.orchestra.run.smithi081.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-15T20:44:18.722 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-15T20:44:18.722 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-15T20:44:18.722 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-15T20:44:18.722 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-15T20:44:18.722 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-15T20:44:18.722 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-15T20:44:18.722 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-15T20:44:18.722 INFO:teuthology.orchestra.run.smithi081.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-15T20:44:18.781 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-15T20:44:18.781 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 244 MB of archives. 2024-09-15T20:44:18.782 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 909 MB of additional disk space will be used. 2024-09-15T20:44:18.782 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-15T20:44:18.818 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2024-09-15T20:44:18.819 INFO:teuthology.orchestra.run.smithi052.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-15T20:44:18.819 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-15T20:44:18.819 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-15T20:44:18.819 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-15T20:44:18.819 INFO:teuthology.orchestra.run.smithi052.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-15T20:44:18.819 INFO:teuthology.orchestra.run.smithi052.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-15T20:44:18.820 INFO:teuthology.orchestra.run.smithi052.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-15T20:44:18.820 INFO:teuthology.orchestra.run.smithi052.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-15T20:44:18.820 INFO:teuthology.orchestra.run.smithi052.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-15T20:44:18.820 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-15T20:44:18.820 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-15T20:44:18.820 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-15T20:44:18.821 INFO:teuthology.orchestra.run.smithi052.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-15T20:44:18.865 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4930-gfc3e0bff-1jammy [3,633 kB] 2024-09-15T20:44:18.869 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-15T20:44:18.872 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-15T20:44:18.880 INFO:teuthology.orchestra.run.smithi052.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-15T20:44:18.880 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 244 MB of archives. 2024-09-15T20:44:18.881 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 909 MB of additional disk space will be used. 2024-09-15T20:44:18.881 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-15T20:44:18.889 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-15T20:44:18.948 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-15T20:44:18.953 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-15T20:44:18.965 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-15T20:44:18.965 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4930-gfc3e0bff-1jammy [3,633 kB] 2024-09-15T20:44:18.969 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-15T20:44:18.969 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-15T20:44:18.970 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-15T20:44:18.971 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-15T20:44:18.972 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-15T20:44:18.972 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-15T20:44:18.980 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-15T20:44:18.982 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-15T20:44:18.985 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-15T20:44:18.986 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-15T20:44:18.987 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-15T20:44:18.988 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-15T20:44:19.003 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-15T20:44:19.006 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-15T20:44:19.009 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-15T20:44:19.009 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-15T20:44:19.009 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-15T20:44:19.010 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-15T20:44:19.010 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-15T20:44:19.010 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-15T20:44:19.021 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-15T20:44:19.021 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-15T20:44:19.037 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-15T20:44:19.038 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-15T20:44:19.040 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-15T20:44:19.041 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-15T20:44:19.041 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-15T20:44:19.042 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-15T20:44:19.043 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-15T20:44:19.043 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-15T20:44:19.048 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-15T20:44:19.053 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-15T20:44:19.054 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-15T20:44:19.056 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-15T20:44:19.066 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-15T20:44:19.070 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-15T20:44:19.071 INFO:teuthology.orchestra.run.smithi052.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-15T20:44:19.072 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-15T20:44:19.072 INFO:teuthology.orchestra.run.smithi052.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-15T20:44:19.073 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-15T20:44:19.073 INFO:teuthology.orchestra.run.smithi052.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-15T20:44:19.077 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-15T20:44:19.078 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-15T20:44:19.078 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-15T20:44:19.079 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-15T20:44:19.081 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-15T20:44:19.081 INFO:teuthology.orchestra.run.smithi081.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4930-gfc3e0bff-1jammy [3,334 kB] 2024-09-15T20:44:19.082 INFO:teuthology.orchestra.run.smithi052.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-15T20:44:19.082 INFO:teuthology.orchestra.run.smithi081.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-15T20:44:19.084 INFO:teuthology.orchestra.run.smithi052.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-15T20:44:19.086 INFO:teuthology.orchestra.run.smithi052.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-15T20:44:19.088 INFO:teuthology.orchestra.run.smithi052.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-15T20:44:19.088 INFO:teuthology.orchestra.run.smithi052.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-15T20:44:19.089 INFO:teuthology.orchestra.run.smithi081.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-15T20:44:19.090 INFO:teuthology.orchestra.run.smithi081.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-15T20:44:19.100 INFO:teuthology.orchestra.run.smithi081.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-15T20:44:19.103 INFO:teuthology.orchestra.run.smithi081.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-15T20:44:19.103 INFO:teuthology.orchestra.run.smithi081.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-15T20:44:19.104 INFO:teuthology.orchestra.run.smithi052.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-15T20:44:19.104 INFO:teuthology.orchestra.run.smithi081.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-15T20:44:19.106 INFO:teuthology.orchestra.run.smithi052.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-15T20:44:19.107 INFO:teuthology.orchestra.run.smithi081.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-15T20:44:19.108 INFO:teuthology.orchestra.run.smithi052.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-15T20:44:19.108 INFO:teuthology.orchestra.run.smithi052.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-15T20:44:19.109 INFO:teuthology.orchestra.run.smithi052.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-15T20:44:19.121 INFO:teuthology.orchestra.run.smithi052.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-15T20:44:19.121 INFO:teuthology.orchestra.run.smithi052.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-15T20:44:19.121 INFO:teuthology.orchestra.run.smithi052.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-15T20:44:19.122 INFO:teuthology.orchestra.run.smithi052.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-15T20:44:19.122 INFO:teuthology.orchestra.run.smithi052.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-15T20:44:19.138 INFO:teuthology.orchestra.run.smithi052.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-15T20:44:19.138 INFO:teuthology.orchestra.run.smithi052.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-15T20:44:19.141 INFO:teuthology.orchestra.run.smithi052.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-15T20:44:19.141 INFO:teuthology.orchestra.run.smithi052.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-15T20:44:19.142 INFO:teuthology.orchestra.run.smithi052.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-15T20:44:19.155 INFO:teuthology.orchestra.run.smithi052.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-15T20:44:19.155 INFO:teuthology.orchestra.run.smithi052.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-15T20:44:19.156 INFO:teuthology.orchestra.run.smithi052.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-15T20:44:19.156 INFO:teuthology.orchestra.run.smithi052.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-15T20:44:19.157 INFO:teuthology.orchestra.run.smithi052.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-15T20:44:19.159 INFO:teuthology.orchestra.run.smithi081.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-15T20:44:19.160 INFO:teuthology.orchestra.run.smithi081.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-15T20:44:19.161 INFO:teuthology.orchestra.run.smithi081.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-15T20:44:19.161 INFO:teuthology.orchestra.run.smithi081.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-15T20:44:19.162 INFO:teuthology.orchestra.run.smithi081.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-15T20:44:19.169 INFO:teuthology.orchestra.run.smithi081.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4930-gfc3e0bff-1jammy [721 kB] 2024-09-15T20:44:19.172 INFO:teuthology.orchestra.run.smithi052.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-15T20:44:19.172 INFO:teuthology.orchestra.run.smithi052.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-15T20:44:19.177 INFO:teuthology.orchestra.run.smithi052.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-15T20:44:19.178 INFO:teuthology.orchestra.run.smithi052.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-15T20:44:19.178 INFO:teuthology.orchestra.run.smithi052.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-15T20:44:19.179 INFO:teuthology.orchestra.run.smithi081.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-15T20:44:19.181 INFO:teuthology.orchestra.run.smithi081.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-15T20:44:19.182 INFO:teuthology.orchestra.run.smithi081.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-15T20:44:19.183 INFO:teuthology.orchestra.run.smithi081.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4930-gfc3e0bff-1jammy [356 kB] 2024-09-15T20:44:19.187 INFO:teuthology.orchestra.run.smithi052.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4930-gfc3e0bff-1jammy [3,334 kB] 2024-09-15T20:44:19.189 INFO:teuthology.orchestra.run.smithi052.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-15T20:44:19.190 INFO:teuthology.orchestra.run.smithi052.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-15T20:44:19.192 INFO:teuthology.orchestra.run.smithi052.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-15T20:44:19.192 INFO:teuthology.orchestra.run.smithi052.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-15T20:44:19.194 INFO:teuthology.orchestra.run.smithi052.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-15T20:44:19.195 INFO:teuthology.orchestra.run.smithi081.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4930-gfc3e0bff-1jammy [32.8 kB] 2024-09-15T20:44:19.195 INFO:teuthology.orchestra.run.smithi081.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-15T20:44:19.196 INFO:teuthology.orchestra.run.smithi081.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-15T20:44:19.196 INFO:teuthology.orchestra.run.smithi081.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4930-gfc3e0bff-1jammy [180 kB] 2024-09-15T20:44:19.196 INFO:teuthology.orchestra.run.smithi081.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-15T20:44:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-15T20:44:19.197 INFO:teuthology.orchestra.run.smithi081.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-15T20:44:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-15T20:44:19.199 INFO:teuthology.orchestra.run.smithi081.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4930-gfc3e0bff-1jammy [71.3 kB] 2024-09-15T20:44:19.200 INFO:teuthology.orchestra.run.smithi081.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4930-gfc3e0bff-1jammy [338 kB] 2024-09-15T20:44:19.206 INFO:teuthology.orchestra.run.smithi052.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-15T20:44:19.206 INFO:teuthology.orchestra.run.smithi081.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4930-gfc3e0bff-1jammy [7,966 kB] 2024-09-15T20:44:19.208 INFO:teuthology.orchestra.run.smithi052.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-15T20:44:19.208 INFO:teuthology.orchestra.run.smithi052.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-15T20:44:19.209 INFO:teuthology.orchestra.run.smithi052.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-15T20:44:19.212 INFO:teuthology.orchestra.run.smithi081.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-15T20:44:19.212 INFO:teuthology.orchestra.run.smithi052.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-15T20:44:19.213 INFO:teuthology.orchestra.run.smithi081.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-15T20:44:19.215 INFO:teuthology.orchestra.run.smithi081.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-15T20:44:19.229 INFO:teuthology.orchestra.run.smithi081.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-15T20:44:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-15T20:44:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-15T20:44:19.234 INFO:teuthology.orchestra.run.smithi081.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-15T20:44:19.236 INFO:teuthology.orchestra.run.smithi081.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-15T20:44:19.237 INFO:teuthology.orchestra.run.smithi081.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-15T20:44:19.237 INFO:teuthology.orchestra.run.smithi081.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-15T20:44:19.247 INFO:teuthology.orchestra.run.smithi081.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-15T20:44:19.247 INFO:teuthology.orchestra.run.smithi081.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-15T20:44:19.250 INFO:teuthology.orchestra.run.smithi081.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-15T20:44:19.264 INFO:teuthology.orchestra.run.smithi081.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-15T20:44:19.265 INFO:teuthology.orchestra.run.smithi081.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-15T20:44:19.265 INFO:teuthology.orchestra.run.smithi081.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-15T20:44:19.265 INFO:teuthology.orchestra.run.smithi052.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-15T20:44:19.266 INFO:teuthology.orchestra.run.smithi052.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-15T20:44:19.266 INFO:teuthology.orchestra.run.smithi081.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-15T20:44:19.267 INFO:teuthology.orchestra.run.smithi081.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-15T20:44:19.267 INFO:teuthology.orchestra.run.smithi052.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-15T20:44:19.267 INFO:teuthology.orchestra.run.smithi052.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-15T20:44:19.268 INFO:teuthology.orchestra.run.smithi052.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-15T20:44:19.273 INFO:teuthology.orchestra.run.smithi081.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-15T20:44:19.273 INFO:teuthology.orchestra.run.smithi081.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-15T20:44:19.281 INFO:teuthology.orchestra.run.smithi081.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-15T20:44:19.282 INFO:teuthology.orchestra.run.smithi081.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-15T20:44:19.283 INFO:teuthology.orchestra.run.smithi081.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-15T20:44:19.286 INFO:teuthology.orchestra.run.smithi052.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-15T20:44:19.288 INFO:teuthology.orchestra.run.smithi052.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-15T20:44:19.288 INFO:teuthology.orchestra.run.smithi052.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-15T20:44:19.301 INFO:teuthology.orchestra.run.smithi052.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4930-gfc3e0bff-1jammy [721 kB] 2024-09-15T20:44:19.302 INFO:teuthology.orchestra.run.smithi052.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-15T20:44:19.302 INFO:teuthology.orchestra.run.smithi052.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-15T20:44:19.303 INFO:teuthology.orchestra.run.smithi052.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-15T20:44:19.303 INFO:teuthology.orchestra.run.smithi052.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-15T20:44:19.304 INFO:teuthology.orchestra.run.smithi052.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-15T20:44:19.304 INFO:teuthology.orchestra.run.smithi052.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-15T20:44:19.334 INFO:teuthology.orchestra.run.smithi052.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4930-gfc3e0bff-1jammy [356 kB] 2024-09-15T20:44:19.334 INFO:teuthology.orchestra.run.smithi052.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-15T20:44:19.334 INFO:teuthology.orchestra.run.smithi052.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-15T20:44:19.336 INFO:teuthology.orchestra.run.smithi052.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-15T20:44:19.337 INFO:teuthology.orchestra.run.smithi052.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-15T20:44:19.338 INFO:teuthology.orchestra.run.smithi052.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-15T20:44:19.339 INFO:teuthology.orchestra.run.smithi052.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-15T20:44:19.341 INFO:teuthology.orchestra.run.smithi052.stdout:Get:76 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4930-gfc3e0bff-1jammy [32.8 kB] 2024-09-15T20:44:19.342 INFO:teuthology.orchestra.run.smithi052.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-15T20:44:19.343 INFO:teuthology.orchestra.run.smithi052.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4930-gfc3e0bff-1jammy [180 kB] 2024-09-15T20:44:19.344 INFO:teuthology.orchestra.run.smithi052.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-15T20:44:19.348 INFO:teuthology.orchestra.run.smithi052.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4930-gfc3e0bff-1jammy [71.3 kB] 2024-09-15T20:44:19.350 INFO:teuthology.orchestra.run.smithi052.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4930-gfc3e0bff-1jammy [338 kB] 2024-09-15T20:44:19.354 INFO:teuthology.orchestra.run.smithi052.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-15T20:44:19.355 INFO:teuthology.orchestra.run.smithi052.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-15T20:44:19.359 INFO:teuthology.orchestra.run.smithi052.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-15T20:44:19.365 INFO:teuthology.orchestra.run.smithi052.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4930-gfc3e0bff-1jammy [7,966 kB] 2024-09-15T20:44:19.371 INFO:teuthology.orchestra.run.smithi052.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-15T20:44:19.374 INFO:teuthology.orchestra.run.smithi052.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-15T20:44:19.374 INFO:teuthology.orchestra.run.smithi052.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-15T20:44:19.374 INFO:teuthology.orchestra.run.smithi052.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-15T20:44:19.374 INFO:teuthology.orchestra.run.smithi052.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-15T20:44:19.376 INFO:teuthology.orchestra.run.smithi052.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-15T20:44:19.376 INFO:teuthology.orchestra.run.smithi052.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-15T20:44:19.387 INFO:teuthology.orchestra.run.smithi052.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-15T20:44:19.388 INFO:teuthology.orchestra.run.smithi052.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-15T20:44:19.388 INFO:teuthology.orchestra.run.smithi052.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-15T20:44:19.405 INFO:teuthology.orchestra.run.smithi052.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-15T20:44:19.406 INFO:teuthology.orchestra.run.smithi052.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-15T20:44:19.443 INFO:teuthology.orchestra.run.smithi081.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4930-gfc3e0bff-1jammy [112 kB] 2024-09-15T20:44:19.445 INFO:teuthology.orchestra.run.smithi081.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4930-gfc3e0bff-1jammy [473 kB] 2024-09-15T20:44:19.466 INFO:teuthology.orchestra.run.smithi081.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4930-gfc3e0bff-1jammy [28.2 MB] 2024-09-15T20:44:19.650 INFO:teuthology.orchestra.run.smithi052.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4930-gfc3e0bff-1jammy [112 kB] 2024-09-15T20:44:19.666 INFO:teuthology.orchestra.run.smithi052.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4930-gfc3e0bff-1jammy [473 kB] 2024-09-15T20:44:19.683 INFO:teuthology.orchestra.run.smithi052.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4930-gfc3e0bff-1jammy [28.2 MB] 2024-09-15T20:44:20.401 INFO:teuthology.orchestra.run.smithi081.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4930-gfc3e0bff-1jammy [5,206 kB] 2024-09-15T20:44:20.479 INFO:teuthology.orchestra.run.smithi081.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4930-gfc3e0bff-1jammy [251 kB] 2024-09-15T20:44:20.482 INFO:teuthology.orchestra.run.smithi081.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4930-gfc3e0bff-1jammy [124 kB] 2024-09-15T20:44:20.485 INFO:teuthology.orchestra.run.smithi081.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4930-gfc3e0bff-1jammy [1,561 kB] 2024-09-15T20:44:20.525 INFO:teuthology.orchestra.run.smithi081.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4930-gfc3e0bff-1jammy [6,309 kB] 2024-09-15T20:44:20.685 INFO:teuthology.orchestra.run.smithi081.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4930-gfc3e0bff-1jammy [23.1 MB] 2024-09-15T20:44:20.925 INFO:teuthology.orchestra.run.smithi052.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4930-gfc3e0bff-1jammy [5,206 kB] 2024-09-15T20:44:21.055 INFO:teuthology.orchestra.run.smithi052.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4930-gfc3e0bff-1jammy [251 kB] 2024-09-15T20:44:21.060 INFO:teuthology.orchestra.run.smithi052.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4930-gfc3e0bff-1jammy [124 kB] 2024-09-15T20:44:21.085 INFO:teuthology.orchestra.run.smithi052.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4930-gfc3e0bff-1jammy [1,561 kB] 2024-09-15T20:44:21.140 INFO:teuthology.orchestra.run.smithi052.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4930-gfc3e0bff-1jammy [6,309 kB] 2024-09-15T20:44:21.376 INFO:teuthology.orchestra.run.smithi052.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4930-gfc3e0bff-1jammy [23.1 MB] 2024-09-15T20:44:21.385 INFO:teuthology.orchestra.run.smithi081.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4930-gfc3e0bff-1jammy [14.1 kB] 2024-09-15T20:44:21.385 INFO:teuthology.orchestra.run.smithi081.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4930-gfc3e0bff-1jammy [880 kB] 2024-09-15T20:44:21.400 INFO:teuthology.orchestra.run.smithi081.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4930-gfc3e0bff-1jammy [2,452 kB] 2024-09-15T20:44:21.440 INFO:teuthology.orchestra.run.smithi081.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4930-gfc3e0bff-1jammy [813 kB] 2024-09-15T20:44:21.450 INFO:teuthology.orchestra.run.smithi081.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4930-gfc3e0bff-1jammy [160 kB] 2024-09-15T20:44:21.452 INFO:teuthology.orchestra.run.smithi081.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4930-gfc3e0bff-1jammy [61.4 MB] 2024-09-15T20:44:22.403 INFO:teuthology.orchestra.run.smithi052.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4930-gfc3e0bff-1jammy [14.1 kB] 2024-09-15T20:44:22.404 INFO:teuthology.orchestra.run.smithi052.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4930-gfc3e0bff-1jammy [880 kB] 2024-09-15T20:44:22.421 INFO:teuthology.orchestra.run.smithi052.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4930-gfc3e0bff-1jammy [2,452 kB] 2024-09-15T20:44:22.466 INFO:teuthology.orchestra.run.smithi052.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4930-gfc3e0bff-1jammy [813 kB] 2024-09-15T20:44:22.501 INFO:teuthology.orchestra.run.smithi052.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4930-gfc3e0bff-1jammy [160 kB] 2024-09-15T20:44:22.503 INFO:teuthology.orchestra.run.smithi052.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4930-gfc3e0bff-1jammy [61.4 MB] 2024-09-15T20:44:23.335 INFO:teuthology.orchestra.run.smithi081.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4930-gfc3e0bff-1jammy [8,625 kB] 2024-09-15T20:44:23.507 INFO:teuthology.orchestra.run.smithi081.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4930-gfc3e0bff-1jammy [14.2 kB] 2024-09-15T20:44:23.507 INFO:teuthology.orchestra.run.smithi081.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4930-gfc3e0bff-1jammy [48.5 MB] 2024-09-15T20:44:24.973 INFO:teuthology.orchestra.run.smithi052.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4930-gfc3e0bff-1jammy [8,625 kB] 2024-09-15T20:44:25.089 INFO:teuthology.orchestra.run.smithi052.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4930-gfc3e0bff-1jammy [14.2 kB] 2024-09-15T20:44:25.089 INFO:teuthology.orchestra.run.smithi052.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4930-gfc3e0bff-1jammy [48.5 MB] 2024-09-15T20:44:25.090 INFO:teuthology.orchestra.run.smithi081.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4930-gfc3e0bff-1jammy [130 kB] 2024-09-15T20:44:25.092 INFO:teuthology.orchestra.run.smithi081.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4930-gfc3e0bff-1jammy [39.0 kB] 2024-09-15T20:44:25.093 INFO:teuthology.orchestra.run.smithi081.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4930-gfc3e0bff-1jammy [15.8 MB] 2024-09-15T20:44:25.573 INFO:teuthology.orchestra.run.smithi081.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4930-gfc3e0bff-1jammy [91.2 kB] 2024-09-15T20:44:26.139 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 244 MB in 7s (35.6 MB/s) 2024-09-15T20:44:26.303 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-15T20:44:26.336 INFO:teuthology.orchestra.run.smithi052.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4930-gfc3e0bff-1jammy [130 kB] 2024-09-15T20:44:26.339 INFO:teuthology.orchestra.run.smithi052.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4930-gfc3e0bff-1jammy [39.0 kB] 2024-09-15T20:44:26.340 INFO:teuthology.orchestra.run.smithi052.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4930-gfc3e0bff-1jammy [15.8 MB] 2024-09-15T20:44:26.404 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-15T20:44:26.409 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-15T20:44:26.494 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T20:44:26.637 INFO:teuthology.orchestra.run.smithi052.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/main/fc3e0bff7468fd55478adbae7f75508b749124b6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4930-gfc3e0bff-1jammy [91.2 kB] 2024-09-15T20:44:26.831 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-15T20:44:26.857 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-15T20:44:26.897 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T20:44:27.218 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 244 MB in 8s (31.2 MB/s) 2024-09-15T20:44:27.234 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-15T20:44:27.260 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-15T20:44:27.300 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T20:44:27.338 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-15T20:44:27.438 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-15T20:44:27.443 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-15T20:44:27.528 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T20:44:27.737 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-15T20:44:27.763 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T20:44:27.812 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T20:44:27.882 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-15T20:44:27.909 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-15T20:44:27.948 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T20:44:28.207 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-15T20:44:28.234 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T20:44:28.274 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T20:44:28.293 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-15T20:44:28.319 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-15T20:44:28.359 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T20:44:28.635 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-15T20:44:28.662 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T20:44:28.702 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T20:44:28.738 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-15T20:44:28.765 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T20:44:28.805 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T20:44:29.022 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-15T20:44:29.048 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-15T20:44:29.080 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T20:44:29.201 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-15T20:44:29.228 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T20:44:29.268 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T20:44:29.425 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librados2. 2024-09-15T20:44:29.451 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../007-librados2_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:29.491 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librados2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:29.579 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-15T20:44:29.606 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T20:44:29.637 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T20:44:29.991 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-15T20:44:30.018 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-15T20:44:30.057 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T20:44:30.244 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libnbd0. 2024-09-15T20:44:30.270 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-15T20:44:30.311 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-15T20:44:30.619 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librados2. 2024-09-15T20:44:30.622 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librbd1. 2024-09-15T20:44:30.646 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../007-librados2_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:30.648 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../009-librbd1_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:30.681 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librbd1 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:30.693 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librados2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:31.109 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs2. 2024-09-15T20:44:31.134 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:31.175 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:31.271 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libnbd0. 2024-09-15T20:44:31.298 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-15T20:44:31.338 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-15T20:44:31.453 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rados. 2024-09-15T20:44:31.475 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:31.519 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rados (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:31.724 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librbd1. 2024-09-15T20:44:31.751 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../009-librbd1_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:31.799 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librbd1 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:31.872 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-15T20:44:31.898 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:44:31.939 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-argparse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:32.166 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cephfs. 2024-09-15T20:44:32.182 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:32.216 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cephfs (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:32.277 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libcephfs2. 2024-09-15T20:44:32.304 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:32.352 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libcephfs2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:32.537 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-15T20:44:32.562 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:44:32.602 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-common (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:32.663 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rados. 2024-09-15T20:44:32.689 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:32.737 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rados (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:32.914 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-15T20:44:32.940 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-15T20:44:32.981 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T20:44:33.074 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-15T20:44:33.101 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:44:33.149 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-ceph-argparse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:33.309 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-prettytable. 2024-09-15T20:44:33.335 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-15T20:44:33.375 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-15T20:44:33.401 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cephfs. 2024-09-15T20:44:33.428 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:33.468 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cephfs (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:33.611 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rbd. 2024-09-15T20:44:33.626 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:33.661 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rbd (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:33.821 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-15T20:44:33.848 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:44:33.895 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-ceph-common (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:34.014 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-15T20:44:34.041 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-15T20:44:34.081 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T20:44:34.290 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-15T20:44:34.317 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-15T20:44:34.350 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-15T20:44:34.365 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T20:44:34.376 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-15T20:44:34.417 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T20:44:34.720 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-15T20:44:34.743 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-prettytable. 2024-09-15T20:44:34.746 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-15T20:44:34.770 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-15T20:44:34.786 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T20:44:34.810 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-15T20:44:35.054 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rbd. 2024-09-15T20:44:35.070 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:35.112 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rbd (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:35.157 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua5.1. 2024-09-15T20:44:35.183 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-15T20:44:35.224 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-15T20:44:35.473 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-15T20:44:35.500 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-15T20:44:35.548 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T20:44:35.627 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua-any. 2024-09-15T20:44:35.642 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-15T20:44:35.693 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-15T20:44:35.946 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package zip. 2024-09-15T20:44:35.961 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-15T20:44:35.985 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-15T20:44:36.004 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking zip (3.0-12build2) ... 2024-09-15T20:44:36.012 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-15T20:44:36.060 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T20:44:36.316 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package unzip. 2024-09-15T20:44:36.342 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-15T20:44:36.354 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-15T20:44:36.370 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-15T20:44:36.383 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-15T20:44:36.412 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T20:44:36.749 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package lua5.1. 2024-09-15T20:44:36.776 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-15T20:44:36.824 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-15T20:44:36.862 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package luarocks. 2024-09-15T20:44:36.888 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-15T20:44:36.936 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-15T20:44:37.186 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package lua-any. 2024-09-15T20:44:37.213 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-15T20:44:37.260 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-15T20:44:37.353 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librgw2. 2024-09-15T20:44:37.379 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../026-librgw2_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:37.419 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librgw2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:37.538 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package zip. 2024-09-15T20:44:37.565 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-15T20:44:37.605 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking zip (3.0-12build2) ... 2024-09-15T20:44:37.925 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package unzip. 2024-09-15T20:44:37.940 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-15T20:44:37.983 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-15T20:44:38.064 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rgw. 2024-09-15T20:44:38.090 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rgw (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:38.387 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package luarocks. 2024-09-15T20:44:38.413 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-15T20:44:38.462 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-15T20:44:38.525 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-15T20:44:38.551 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-15T20:44:38.600 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T20:44:38.903 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librgw2. 2024-09-15T20:44:38.930 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../026-librgw2_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:38.977 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librgw2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:39.003 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libradosstriper1. 2024-09-15T20:44:39.029 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:39.081 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libradosstriper1 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:39.507 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-common. 2024-09-15T20:44:39.533 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:39.573 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-common (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:39.622 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rgw. 2024-09-15T20:44:39.648 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:39.688 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rgw (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:40.050 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-15T20:44:40.077 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-15T20:44:40.116 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T20:44:40.469 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libradosstriper1. 2024-09-15T20:44:40.496 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:40.544 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libradosstriper1 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:41.048 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-common. 2024-09-15T20:44:41.074 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:41.087 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-base. 2024-09-15T20:44:41.114 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:41.147 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-common (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:41.162 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-base (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:41.758 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-15T20:44:41.785 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-15T20:44:41.825 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-15T20:44:42.119 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cheroot. 2024-09-15T20:44:42.148 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-15T20:44:42.186 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T20:44:42.539 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-15T20:44:42.565 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-15T20:44:42.597 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-15T20:44:42.677 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-base. 2024-09-15T20:44:42.704 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:42.754 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-base (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:42.908 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-15T20:44:42.921 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-15T20:44:42.966 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-15T20:44:43.303 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-15T20:44:43.329 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-15T20:44:43.365 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-15T20:44:43.369 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-15T20:44:43.392 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-15T20:44:43.431 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-15T20:44:43.631 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempora. 2024-09-15T20:44:43.646 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-15T20:44:43.689 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-15T20:44:43.743 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cheroot. 2024-09-15T20:44:43.770 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-15T20:44:43.810 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T20:44:43.992 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-portend. 2024-09-15T20:44:44.019 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-15T20:44:44.059 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-15T20:44:44.113 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-15T20:44:44.140 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-15T20:44:44.179 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-15T20:44:44.362 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-15T20:44:44.388 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-15T20:44:44.428 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-15T20:44:44.463 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-15T20:44:44.490 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-15T20:44:44.524 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-15T20:44:44.690 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-15T20:44:44.716 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-15T20:44:44.748 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-15T20:44:44.818 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-15T20:44:44.846 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-15T20:44:44.885 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-15T20:44:45.060 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-natsort. 2024-09-15T20:44:45.086 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-15T20:44:45.118 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-15T20:44:45.188 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-tempora. 2024-09-15T20:44:45.215 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-15T20:44:45.254 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-15T20:44:45.421 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-logutils. 2024-09-15T20:44:45.448 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-15T20:44:45.488 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-15T20:44:45.532 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-portend. 2024-09-15T20:44:45.559 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-15T20:44:45.598 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-15T20:44:45.783 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-15T20:44:45.809 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-15T20:44:45.853 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-15T20:44:45.868 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-15T20:44:45.896 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-15T20:44:45.935 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-15T20:44:46.152 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-mako. 2024-09-15T20:44:46.178 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-15T20:44:46.219 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T20:44:46.396 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-15T20:44:46.423 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-15T20:44:46.462 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-15T20:44:46.522 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-15T20:44:46.548 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-15T20:44:46.580 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-15T20:44:46.758 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-natsort. 2024-09-15T20:44:46.785 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-15T20:44:46.824 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-15T20:44:46.858 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-15T20:44:46.885 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-15T20:44:46.925 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-15T20:44:47.136 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-logutils. 2024-09-15T20:44:47.163 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-15T20:44:47.202 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-15T20:44:47.278 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webob. 2024-09-15T20:44:47.304 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-15T20:44:47.353 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T20:44:47.489 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-15T20:44:47.516 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-15T20:44:47.555 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-15T20:44:47.714 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-waitress. 2024-09-15T20:44:47.741 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-15T20:44:47.784 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T20:44:47.858 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-mako. 2024-09-15T20:44:47.885 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-15T20:44:47.916 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T20:44:48.109 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempita. 2024-09-15T20:44:48.135 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-15T20:44:48.175 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T20:44:48.203 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-15T20:44:48.230 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-15T20:44:48.269 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-15T20:44:48.487 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-paste. 2024-09-15T20:44:48.514 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-15T20:44:48.554 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T20:44:48.572 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-15T20:44:48.599 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-15T20:44:48.639 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-15T20:44:48.882 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-15T20:44:48.908 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-15T20:44:48.925 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-webob. 2024-09-15T20:44:48.948 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T20:44:48.952 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-15T20:44:48.991 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T20:44:49.226 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-15T20:44:49.253 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-15T20:44:49.293 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-15T20:44:49.353 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-waitress. 2024-09-15T20:44:49.380 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-15T20:44:49.423 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T20:44:49.521 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webtest. 2024-09-15T20:44:49.536 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-15T20:44:49.579 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-15T20:44:49.789 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-tempita. 2024-09-15T20:44:49.816 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-15T20:44:49.864 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T20:44:49.899 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pecan. 2024-09-15T20:44:49.925 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-15T20:44:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T20:44:50.329 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-certifi. 2024-09-15T20:44:50.355 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-15T20:44:50.395 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-15T20:44:50.732 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-idna. 2024-09-15T20:44:50.758 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-15T20:44:50.807 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T20:44:51.051 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-paste. 2024-09-15T20:44:51.079 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-15T20:44:51.143 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T20:44:51.285 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-urllib3. 2024-09-15T20:44:51.311 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-15T20:44:51.343 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T20:44:51.504 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-15T20:44:51.520 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-15T20:44:51.571 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T20:44:51.621 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests. 2024-09-15T20:44:51.647 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-15T20:44:51.679 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T20:44:51.907 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-15T20:44:51.934 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-15T20:44:51.973 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-15T20:44:51.974 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-15T20:44:52.001 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-15T20:44:52.041 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T20:44:52.277 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-webtest. 2024-09-15T20:44:52.304 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-15T20:44:52.343 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-15T20:44:52.654 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pecan. 2024-09-15T20:44:52.681 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-15T20:44:52.721 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T20:44:53.076 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-certifi. 2024-09-15T20:44:53.103 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-15T20:44:53.134 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-15T20:44:53.170 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-15T20:44:53.196 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:44:53.253 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:53.437 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-idna. 2024-09-15T20:44:53.464 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-15T20:44:53.545 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T20:44:53.649 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-15T20:44:53.676 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:53.716 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:53.856 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-urllib3. 2024-09-15T20:44:53.883 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-15T20:44:53.923 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T20:44:54.036 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-15T20:44:54.062 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-15T20:44:54.102 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-15T20:44:54.260 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-requests. 2024-09-15T20:44:54.287 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-15T20:44:54.326 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T20:44:54.371 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-openssl. 2024-09-15T20:44:54.387 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-15T20:44:54.421 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-15T20:44:54.654 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-15T20:44:54.681 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-15T20:44:54.720 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T20:44:54.767 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr. 2024-09-15T20:44:54.793 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:54.833 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:55.015 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-15T20:44:55.032 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:44:55.073 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:55.236 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mon. 2024-09-15T20:44:55.263 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:55.303 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mon (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:55.462 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-15T20:44:55.489 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:55.528 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:55.848 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-15T20:44:55.856 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-osd. 2024-09-15T20:44:55.875 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-15T20:44:55.883 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:55.914 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-15T20:44:55.915 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-osd (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:56.217 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-openssl. 2024-09-15T20:44:56.245 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-15T20:44:56.284 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-15T20:44:56.746 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr. 2024-09-15T20:44:56.773 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:56.812 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:57.010 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph. 2024-09-15T20:44:57.025 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../067-ceph_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:57.068 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:57.215 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mon. 2024-09-15T20:44:57.243 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:57.281 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mon (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-fuse. 2024-09-15T20:44:57.414 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:57.454 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-fuse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:57.782 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mds. 2024-09-15T20:44:57.797 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:57.832 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mds (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:57.885 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-osd. 2024-09-15T20:44:57.913 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:57.952 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-osd (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:58.202 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephadm. 2024-09-15T20:44:58.229 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../070-cephadm_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:58.268 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephadm (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:58.571 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-15T20:44:58.598 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-15T20:44:58.629 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-15T20:44:58.949 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-15T20:44:58.975 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T20:44:59.013 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph. 2024-09-15T20:44:59.015 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T20:44:59.029 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../067-ceph_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:59.071 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:59.391 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-fuse. 2024-09-15T20:44:59.418 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:59.457 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-fuse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:44:59.835 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mds. 2024-09-15T20:44:59.863 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:44:59.902 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mds (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:00.054 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-babel. 2024-09-15T20:45:00.081 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T20:45:00.120 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T20:45:00.255 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package cephadm. 2024-09-15T20:45:00.282 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../070-cephadm_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:45:00.313 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking cephadm (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:00.473 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jinja2. 2024-09-15T20:45:00.500 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-15T20:45:00.540 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T20:45:00.625 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-15T20:45:00.652 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-15T20:45:00.691 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-15T20:45:00.877 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-15T20:45:00.903 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:45:00.943 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:01.018 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-15T20:45:01.035 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T20:45:01.110 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T20:45:01.280 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-15T20:45:01.306 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-15T20:45:01.346 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-15T20:45:01.841 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-routes. 2024-09-15T20:45:01.868 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-15T20:45:01.899 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T20:45:02.219 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-15T20:45:02.240 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-babel. 2024-09-15T20:45:02.247 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:45:02.268 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T20:45:02.277 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:02.306 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T20:45:02.643 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jinja2. 2024-09-15T20:45:02.670 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-15T20:45:02.709 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T20:45:03.079 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-15T20:45:03.107 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:45:03.146 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:03.483 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-15T20:45:03.510 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-15T20:45:03.549 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-15T20:45:03.835 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-routes. 2024-09-15T20:45:03.863 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-15T20:45:03.902 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T20:45:04.247 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-15T20:45:04.274 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:45:04.313 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:05.210 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-15T20:45:05.240 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-15T20:45:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T20:45:05.788 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-joblib. 2024-09-15T20:45:05.816 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-15T20:45:05.855 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T20:45:06.225 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-15T20:45:06.253 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-15T20:45:06.291 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-15T20:45:06.611 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn. 2024-09-15T20:45:06.639 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-15T20:45:06.771 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T20:45:07.360 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-15T20:45:07.378 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-15T20:45:07.410 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T20:45:07.656 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-15T20:45:07.685 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:45:07.723 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:07.888 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-joblib. 2024-09-15T20:45:07.917 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-15T20:45:07.955 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T20:45:08.325 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-15T20:45:08.353 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-15T20:45:08.391 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-15T20:45:08.711 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-sklearn. 2024-09-15T20:45:08.739 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-15T20:45:08.776 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cachetools. 2024-09-15T20:45:08.804 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-15T20:45:08.843 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-15T20:45:08.871 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T20:45:09.146 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-15T20:45:09.173 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-15T20:45:09.212 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-15T20:45:09.550 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-15T20:45:09.577 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-15T20:45:09.591 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-15T20:45:09.615 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T20:45:09.619 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:45:09.649 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:09.927 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rsa. 2024-09-15T20:45:09.955 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-15T20:45:09.994 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-15T20:45:10.272 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-google-auth. 2024-09-15T20:45:10.289 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-15T20:45:10.339 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-15T20:45:10.569 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cachetools. 2024-09-15T20:45:10.597 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-15T20:45:10.635 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-15T20:45:10.726 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-15T20:45:10.754 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-15T20:45:10.800 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T20:45:10.897 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-15T20:45:10.925 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-15T20:45:10.963 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-15T20:45:11.121 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-websocket. 2024-09-15T20:45:11.149 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-15T20:45:11.195 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-15T20:45:11.317 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-15T20:45:11.345 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-15T20:45:11.383 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T20:45:11.507 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-15T20:45:11.535 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-15T20:45:11.573 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T20:45:11.686 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rsa. 2024-09-15T20:45:11.714 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-15T20:45:11.752 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-15T20:45:12.098 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-google-auth. 2024-09-15T20:45:12.126 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-15T20:45:12.164 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-15T20:45:12.454 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-15T20:45:12.471 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:45:12.510 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-15T20:45:12.512 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:12.538 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-15T20:45:12.576 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T20:45:12.815 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-15T20:45:12.844 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-15T20:45:12.862 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-websocket. 2024-09-15T20:45:12.882 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T20:45:12.891 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-15T20:45:12.921 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-15T20:45:13.186 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-15T20:45:13.214 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T20:45:13.241 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-15T20:45:13.247 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T20:45:13.269 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-15T20:45:13.307 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T20:45:13.504 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package jq. 2024-09-15T20:45:13.521 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T20:45:13.563 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-15T20:45:13.818 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package socat. 2024-09-15T20:45:13.836 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-15T20:45:13.878 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-15T20:45:13.963 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-15T20:45:13.980 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:45:14.021 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:14.186 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package xmlstarlet. 2024-09-15T20:45:14.202 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-15T20:45:14.252 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-15T20:45:14.340 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-15T20:45:14.369 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-15T20:45:14.432 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T20:45:14.598 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-test. 2024-09-15T20:45:14.614 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:45:14.656 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-test (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:14.743 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-15T20:45:14.771 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T20:45:14.810 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T20:45:15.062 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package jq. 2024-09-15T20:45:15.079 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T20:45:15.121 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-15T20:45:15.373 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package socat. 2024-09-15T20:45:15.390 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-15T20:45:15.432 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-15T20:45:15.710 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package xmlstarlet. 2024-09-15T20:45:15.727 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-15T20:45:15.768 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-15T20:45:16.139 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-test. 2024-09-15T20:45:16.158 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:45:16.197 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-test (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:16.903 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-volume. 2024-09-15T20:45:16.931 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:45:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-volume (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:17.290 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-15T20:45:17.306 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:45:17.348 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs-dev (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:17.651 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-15T20:45:17.679 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-15T20:45:17.717 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T20:45:18.064 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-15T20:45:18.092 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-15T20:45:18.130 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-15T20:45:18.435 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-volume. 2024-09-15T20:45:18.463 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4930-gfc3e0bff-1jammy_all.deb ... 2024-09-15T20:45:18.501 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-volume (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:18.509 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package nvme-cli. 2024-09-15T20:45:18.537 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-15T20:45:18.575 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T20:45:18.798 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-15T20:45:18.814 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:45:18.860 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libcephfs-dev (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:18.998 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package pkg-config. 2024-09-15T20:45:19.331 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-15T20:45:19.331 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-15T20:45:19.331 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T20:45:19.331 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-15T20:45:19.332 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T20:45:19.332 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-15T20:45:19.342 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-15T20:45:19.375 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-15T20:45:19.562 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-15T20:45:19.591 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-15T20:45:19.629 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-15T20:45:19.796 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-15T20:45:19.823 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-15T20:45:19.862 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-15T20:45:19.941 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package nvme-cli. 2024-09-15T20:45:19.970 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-15T20:45:19.999 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T20:45:20.089 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastescript. 2024-09-15T20:45:20.106 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-15T20:45:20.139 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-15T20:45:20.430 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package pkg-config. 2024-09-15T20:45:20.435 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pluggy. 2024-09-15T20:45:20.458 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-15T20:45:20.462 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-15T20:45:20.496 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T20:45:20.501 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-15T20:45:20.749 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-15T20:45:20.766 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-15T20:45:20.807 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-15T20:45:20.821 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-psutil. 2024-09-15T20:45:20.849 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-15T20:45:20.887 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-15T20:45:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-py. 2024-09-15T20:45:21.227 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-15T20:45:21.244 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-15T20:45:21.261 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-15T20:45:21.265 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-15T20:45:21.302 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-15T20:45:21.585 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pygments. 2024-09-15T20:45:21.597 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pastescript. 2024-09-15T20:45:21.613 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-15T20:45:21.625 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-15T20:45:21.652 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T20:45:21.654 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-15T20:45:22.017 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pluggy. 2024-09-15T20:45:22.045 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-15T20:45:22.091 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-15T20:45:22.148 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-15T20:45:22.176 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-15T20:45:22.214 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-15T20:45:22.428 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-psutil. 2024-09-15T20:45:22.456 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-15T20:45:22.494 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-15T20:45:22.509 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-toml. 2024-09-15T20:45:22.537 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-15T20:45:22.567 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-15T20:45:22.837 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pytest. 2024-09-15T20:45:22.865 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-15T20:45:22.903 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T20:45:23.206 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-py. 2024-09-15T20:45:23.234 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-15T20:45:23.240 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplejson. 2024-09-15T20:45:23.269 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-15T20:45:23.280 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-15T20:45:23.307 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-15T20:45:23.584 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-15T20:45:23.600 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-15T20:45:23.634 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pygments. 2024-09-15T20:45:23.642 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-15T20:45:23.662 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-15T20:45:23.700 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T20:45:24.163 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-15T20:45:24.191 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-15T20:45:24.238 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-15T20:45:24.389 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package radosgw. 2024-09-15T20:45:24.417 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../117-radosgw_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:45:24.455 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking radosgw (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:24.565 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-toml. 2024-09-15T20:45:24.594 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-15T20:45:24.632 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-15T20:45:24.935 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pytest. 2024-09-15T20:45:24.964 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-15T20:45:25.001 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T20:45:25.342 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package rbd-fuse. 2024-09-15T20:45:25.371 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:45:25.380 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-simplejson. 2024-09-15T20:45:25.408 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking rbd-fuse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:25.409 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-15T20:45:25.446 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-15T20:45:25.716 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-15T20:45:25.744 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-15T20:45:25.755 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-15T20:45:25.782 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-15T20:45:26.016 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T20:45:26.140 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T20:45:26.405 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-15T20:45:26.486 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package radosgw. 2024-09-15T20:45:26.515 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../117-radosgw_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:45:26.552 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking radosgw (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:26.747 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-15T20:45:27.145 INFO:teuthology.orchestra.run.smithi081.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-15T20:45:27.216 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephadm (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:27.456 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package rbd-fuse. 2024-09-15T20:45:27.473 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4930-gfc3e0bff-1jammy_amd64.deb ... 2024-09-15T20:45:27.506 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking rbd-fuse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:27.811 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-15T20:45:28.049 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user cephadm....done 2024-09-15T20:45:28.069 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T20:45:28.195 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T20:45:28.198 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T20:45:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-15T20:45:28.470 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-15T20:45:28.701 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-15T20:45:28.818 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-15T20:45:28.854 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-15T20:45:29.111 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-15T20:45:29.266 INFO:teuthology.orchestra.run.smithi052.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-15T20:45:29.322 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up cephadm (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:29.371 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T20:45:29.497 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-15T20:45:29.764 INFO:teuthology.orchestra.run.smithi052.stdout:Adding system user cephadm....done 2024-09-15T20:45:29.799 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T20:45:29.911 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T20:45:30.134 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-15T20:45:30.196 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-15T20:45:30.368 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-15T20:45:30.556 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-15T20:45:30.637 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-15T20:45:30.657 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-15T20:45:30.888 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-15T20:45:30.916 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-15T20:45:31.140 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-15T20:45:31.176 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T20:45:31.310 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-15T20:45:31.424 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-15T20:45:31.620 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T20:45:31.658 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-argparse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:31.892 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T20:45:31.989 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-15T20:45:32.019 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-15T20:45:32.170 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T20:45:32.249 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-15T20:45:32.296 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T20:45:32.422 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-15T20:45:32.525 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-15T20:45:32.698 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-15T20:45:32.784 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-15T20:45:33.052 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-15T20:45:33.085 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-15T20:45:33.121 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-15T20:45:33.176 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T20:45:33.311 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-15T20:45:33.320 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-15T20:45:33.579 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-ceph-argparse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:33.671 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T20:45:33.797 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-15T20:45:33.830 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T20:45:33.932 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-15T20:45:34.041 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T20:45:34.064 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T20:45:34.167 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T20:45:34.293 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-15T20:45:34.324 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-15T20:45:34.602 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-15T20:45:34.616 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up zip (3.0-12build2) ... 2024-09-15T20:45:34.718 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T20:45:34.979 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-15T20:45:35.009 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-15T20:45:35.056 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T20:45:35.157 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-15T20:45:35.345 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T20:45:35.516 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T20:45:35.604 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T20:45:35.642 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-15T20:45:35.730 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-15T20:45:35.856 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T20:45:35.918 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T20:45:36.174 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-15T20:45:36.211 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-15T20:45:36.512 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up zip (3.0-12build2) ... 2024-09-15T20:45:36.550 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-15T20:45:36.647 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T20:45:36.776 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T20:45:37.145 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T20:45:37.390 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T20:45:37.430 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T20:45:37.658 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T20:45:37.764 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-15T20:45:37.817 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-15T20:45:37.943 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T20:45:38.015 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-15T20:45:38.125 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-common (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:38.252 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-15T20:45:38.401 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T20:45:38.679 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-15T20:45:38.694 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T20:45:38.938 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T20:45:39.332 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T20:45:39.616 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T20:45:39.875 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T20:45:39.968 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-15T20:45:40.093 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T20:45:40.227 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-15T20:45:40.228 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-15T20:45:40.353 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-ceph-common (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:40.487 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T20:45:40.613 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-15T20:45:40.662 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T20:45:40.739 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T20:45:40.980 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T20:45:41.032 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-15T20:45:41.267 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-15T20:45:41.493 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T20:45:41.611 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-15T20:45:41.929 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-15T20:45:42.178 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T20:45:42.180 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-15T20:45:42.438 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T20:45:42.448 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-15T20:45:42.564 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-15T20:45:42.699 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-15T20:45:42.807 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T20:45:42.933 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-15T20:45:42.941 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-15T20:45:43.059 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T20:45:43.360 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-15T20:45:43.460 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T20:45:43.577 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-15T20:45:43.653 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-15T20:45:43.862 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T20:45:43.912 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T20:45:43.988 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T20:45:44.047 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-15T20:45:44.289 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T20:45:44.359 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-15T20:45:44.591 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-15T20:45:44.598 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-15T20:45:44.850 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-15T20:45:44.863 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T20:45:44.959 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-15T20:45:45.068 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T20:45:45.109 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-15T20:45:45.158 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-15T20:45:45.377 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-15T20:45:45.395 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T20:45:45.521 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T20:45:45.654 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T20:45:45.779 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-15T20:45:45.906 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-15T20:45:46.056 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T20:45:46.157 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T20:45:46.174 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-15T20:45:46.275 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-15T20:45:46.433 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T20:45:46.509 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T20:45:46.619 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T20:45:46.734 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-15T20:45:46.929 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T20:45:46.993 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T20:45:47.120 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-15T20:45:47.245 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T20:45:47.263 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T20:45:47.335 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-15T20:45:47.547 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-15T20:45:47.580 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T20:45:47.673 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-15T20:45:47.715 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T20:45:47.941 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-15T20:45:48.091 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-15T20:45:48.286 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T20:45:48.351 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-15T20:45:48.477 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-15T20:45:48.554 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-15T20:45:48.736 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T20:45:48.863 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T20:45:48.939 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-15T20:45:49.196 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T20:45:49.224 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T20:45:49.473 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T20:45:49.568 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T20:45:49.694 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librados2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:49.724 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-15T20:45:49.823 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:49.850 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-15T20:45:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-15T20:45:50.126 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-15T20:45:50.251 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:50.369 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libradosstriper1 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:50.487 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T20:45:50.495 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-15T20:45:50.747 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-15T20:45:50.780 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librbd1 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:50.932 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-modules-core (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:51.057 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-fuse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:51.124 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-15T20:45:51.278 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T20:45:51.278 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T20:45:51.442 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T20:45:51.767 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs-dev (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:51.796 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T20:45:51.918 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rados (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:51.920 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librados2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:52.046 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:52.069 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librgw2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:52.156 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-15T20:45:52.237 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T20:45:52.459 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libcephfs2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:52.585 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libradosstriper1 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:52.711 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-15T20:45:52.996 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librbd1 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:53.114 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-modules-core (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:53.215 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-fuse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:53.429 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T20:45:53.429 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T20:45:53.524 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rbd (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:53.667 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up rbd-fuse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:53.818 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rgw (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:53.969 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cephfs (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:54.005 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libcephfs-dev (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:54.120 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-common (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:54.134 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rados (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:54.260 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librgw2 (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:54.411 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T20:45:54.713 INFO:teuthology.orchestra.run.smithi081.stdout:Adding group ceph....done 2024-09-15T20:45:55.140 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user ceph....done 2024-09-15T20:45:55.309 INFO:teuthology.orchestra.run.smithi081.stdout:Setting system user ceph properties....done 2024-09-15T20:45:55.327 INFO:teuthology.orchestra.run.smithi081.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-15T20:45:55.459 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-15T20:45:55.649 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rbd (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:55.754 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-15T20:45:55.776 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up rbd-fuse (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:55.902 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rgw (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:56.029 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cephfs (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:56.154 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-common (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:56.239 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-test (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:56.365 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up radosgw (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:56.671 INFO:teuthology.orchestra.run.smithi052.stdout:Adding group ceph....done 2024-09-15T20:45:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T20:45:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T20:45:57.056 INFO:teuthology.orchestra.run.smithi052.stdout:Adding system user ceph....done 2024-09-15T20:45:57.216 INFO:teuthology.orchestra.run.smithi052.stdout:Setting system user ceph properties....done 2024-09-15T20:45:57.230 INFO:teuthology.orchestra.run.smithi052.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-15T20:45:57.308 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-base (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:57.374 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-15T20:45:57.619 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-15T20:45:57.736 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-15T20:45:58.196 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-test (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:58.220 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mds (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:58.314 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up radosgw (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:58.455 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T20:45:58.455 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T20:45:58.758 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T20:45:58.758 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T20:45:59.191 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-base (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:59.283 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:45:59.530 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T20:45:59.530 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T20:45:59.557 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-15T20:45:59.993 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-osd (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:00.018 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mds (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:00.235 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T20:46:00.235 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T20:46:00.261 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T20:46:00.261 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T20:46:00.720 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:00.736 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:00.870 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:00.940 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T20:46:00.940 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T20:46:01.021 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mon (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:01.230 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T20:46:01.231 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T20:46:01.421 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-osd (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:01.707 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T20:46:01.708 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T20:46:01.731 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-cephadm (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:01.882 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:01.991 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-dashboard (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:02.126 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-volume (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:02.189 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:02.290 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:02.441 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mon (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:02.479 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T20:46:02.605 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T20:46:02.666 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T20:46:02.666 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T20:46:02.766 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T20:46:03.126 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-cephadm (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:03.277 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:03.405 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-dashboard (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:03.538 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-volume (19.3.0-4930-gfc3e0bff-1jammy) ... 2024-09-15T20:46:03.883 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T20:46:04.495 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T20:46:04.495 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T20:46:04.495 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T20:46:04.519 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T20:46:04.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install sqlite3 2024-09-15T20:46:04.575 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-15T20:46:04.761 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-15T20:46:04.761 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-15T20:46:04.943 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T20:46:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T20:46:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T20:46:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T20:46:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T20:46:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T20:46:04.944 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T20:46:04.945 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-09-15T20:46:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: libsqlite3-0 2024-09-15T20:46:04.947 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-09-15T20:46:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: sqlite3-doc 2024-09-15T20:46:04.975 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-09-15T20:46:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: sqlite3 2024-09-15T20:46:04.976 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2024-09-15T20:46:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: libsqlite3-0 2024-09-15T20:46:05.029 INFO:teuthology.orchestra.run.smithi081.stdout:1 upgraded, 1 newly installed, 0 to remove and 330 not upgraded. 2024-09-15T20:46:05.029 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 1,410 kB of archives. 2024-09-15T20:46:05.029 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 1,873 kB of additional disk space will be used. 2024-09-15T20:46:05.029 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-09-15T20:46:05.156 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-09-15T20:46:05.487 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T20:46:05.491 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 1,410 kB in 0s (7,331 kB/s) 2024-09-15T20:46:05.796 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176255 files and directories currently installed.) 2024-09-15T20:46:05.801 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-09-15T20:46:06.006 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-09-15T20:46:06.143 INFO:teuthology.orchestra.run.smithi052.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T20:46:06.146 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install sqlite3 2024-09-15T20:46:06.249 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-09-15T20:46:06.393 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package sqlite3. 2024-09-15T20:46:06.409 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-09-15T20:46:06.451 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-09-15T20:46:06.466 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-09-15T20:46:06.466 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-09-15T20:46:06.680 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T20:46:06.680 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T20:46:06.680 INFO:teuthology.orchestra.run.smithi052.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T20:46:06.680 INFO:teuthology.orchestra.run.smithi052.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T20:46:06.681 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T20:46:06.681 INFO:teuthology.orchestra.run.smithi052.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T20:46:06.681 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T20:46:06.682 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2024-09-15T20:46:06.683 INFO:teuthology.orchestra.run.smithi052.stdout: libsqlite3-0 2024-09-15T20:46:06.684 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2024-09-15T20:46:06.684 INFO:teuthology.orchestra.run.smithi052.stdout: sqlite3-doc 2024-09-15T20:46:06.716 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2024-09-15T20:46:06.716 INFO:teuthology.orchestra.run.smithi052.stdout: sqlite3 2024-09-15T20:46:06.717 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages will be upgraded: 2024-09-15T20:46:06.717 INFO:teuthology.orchestra.run.smithi052.stdout: libsqlite3-0 2024-09-15T20:46:06.769 INFO:teuthology.orchestra.run.smithi052.stdout:1 upgraded, 1 newly installed, 0 to remove and 330 not upgraded. 2024-09-15T20:46:06.769 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 1,410 kB of archives. 2024-09-15T20:46:06.769 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 1,873 kB of additional disk space will be used. 2024-09-15T20:46:06.769 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-09-15T20:46:06.854 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-09-15T20:46:06.890 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-09-15T20:46:06.989 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-09-15T20:46:07.116 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T20:46:07.282 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 1,410 kB in 0s (7,612 kB/s) 2024-09-15T20:46:07.546 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176255 files and directories currently installed.) 2024-09-15T20:46:07.552 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-09-15T20:46:07.758 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-09-15T20:46:08.086 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package sqlite3. 2024-09-15T20:46:08.104 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-09-15T20:46:08.145 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-09-15T20:46:08.392 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T20:46:08.506 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-09-15T20:46:08.632 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-09-15T20:46:08.759 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T20:46:08.861 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T20:46:08.867 DEBUG:teuthology.parallel:result is None 2024-09-15T20:46:09.821 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T20:46:10.249 INFO:teuthology.orchestra.run.smithi052.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T20:46:10.254 DEBUG:teuthology.parallel:result is None 2024-09-15T20:46:10.255 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fc3e0bff7468fd55478adbae7f75508b749124b6 2024-09-15T20:46:10.403 DEBUG:teuthology.orchestra.run.smithi052:> dpkg-query -W -f '${Version}' ceph 2024-09-15T20:46:10.422 INFO:teuthology.orchestra.run.smithi052.stdout:19.3.0-4930-gfc3e0bff-1jammy 2024-09-15T20:46:10.423 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4930-gfc3e0bff-1jammy 2024-09-15T20:46:10.423 INFO:teuthology.task.install:The correct ceph version 19.3.0-4930-gfc3e0bff-1jammy is installed. 2024-09-15T20:46:10.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=fc3e0bff7468fd55478adbae7f75508b749124b6 2024-09-15T20:46:10.565 DEBUG:teuthology.orchestra.run.smithi081:> dpkg-query -W -f '${Version}' ceph 2024-09-15T20:46:10.584 INFO:teuthology.orchestra.run.smithi081.stdout:19.3.0-4930-gfc3e0bff-1jammy 2024-09-15T20:46:10.584 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4930-gfc3e0bff-1jammy 2024-09-15T20:46:10.584 INFO:teuthology.task.install:The correct ceph version 19.3.0-4930-gfc3e0bff-1jammy is installed. 2024-09-15T20:46:10.586 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T20:46:10.587 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:10.587 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T20:46:10.601 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:10.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T20:46:10.641 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T20:46:10.642 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:10.642 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T20:46:10.658 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T20:46:10.715 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:10.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T20:46:10.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T20:46:10.784 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T20:46:10.784 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:10.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T20:46:10.797 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T20:46:10.853 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:10.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T20:46:10.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T20:46:10.920 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T20:46:10.920 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:10.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T20:46:10.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T20:46:10.991 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:10.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T20:46:11.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T20:46:11.056 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T20:46:11.155 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T20:46:11.155 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2024-09-15T20:46:11.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-09-15T20:46:11.170 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T20:46:11.171 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T20:46:11.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T20:46:11.228 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T20:46:11.228 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T20:46:11.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T20:46:11.296 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T20:46:11.296 INFO:tasks.ceph:config {'conf': {'client': {'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T20:46:11.297 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610', 'branch': 'main', 'description': 'rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-low-osd-mem-target} rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7905610', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled'], 'sha1': 'fc3e0bff7468fd55478adbae7f75508b749124b6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'fc3e0bff7468fd55478adbae7f75508b749124b6'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '7498493279982dfe87f00616198a5967475f6169'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 101, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2855, 'sha1': 'fc3e0bff7468fd55478adbae7f75508b749124b6', 'sleep_before_teardown': 0, 'subset': '17936/100000', 'suite': 'rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7498493279982dfe87f00616198a5967475f6169/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7498493279982dfe87f00616198a5967475f6169', 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5DJem3xaL5BQyjkNVysNd8GGqR2RpCKi04S54npsF5amdMF6g2d/A9M/CmsLpn82tihb2W8uPvrJ1QKtr0HCA=', 'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJvNlgP4OqkAPyq8F1T7NJax+DML0Pm4N21Iw9HPbcOhVzoMTR7z9KEIXBIlknkRK+sUeqwJmh57LKP5/83BZe0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'flavor': 'default', 'sha1': 'fc3e0bff7468fd55478adbae7f75508b749124b6'}}, {'ceph': None}, {'exec': {'client.0': ['ceph osd pool create cephsqlite', "ceph auth get-or-create client.libcephsqlite mon 'profile simple-rados-client-with-blocklist' osd 'allow rwx pool=cephsqlite' >> /etc/ceph/ceph.keyring"]}}, {'exec': {'client.0': ['ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr']}}, {'workunit': {'clients': {'client.0': ['rados/test_libcephsqlite.sh cephsqlite']}, 'env': {'CEPH_ARGS': '--id libcephsqlite --no-log-to-stderr'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_20:00:16', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T20:46:11.297 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T20:46:11.328 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T20:46:11.333 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T20:46:11.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T20:46:11.389 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:11.389 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T20:46:11.435 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T20:46:11.435 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-09-15T20:46:11.483 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T20:46:11.483 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T20:46:11.483 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-09-15T20:46:11.484 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T20:46:11.484 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-15 20:40:32.053938940 +0000 2024-09-15T20:46:11.484 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-15 20:40:32.049939163 +0000 2024-09-15T20:46:11.484 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-15 20:40:32.049939163 +0000 2024-09-15T20:46:11.484 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2024-09-15T20:46:11.484 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T20:46:11.537 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-15T20:46:11.538 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-15T20:46:11.538 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000322125 s, 1.6 MB/s 2024-09-15T20:46:11.539 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T20:46:11.589 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-09-15T20:46:11.635 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T20:46:11.635 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T20:46:11.635 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 895 Links: 1 2024-09-15T20:46:11.635 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T20:46:11.635 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-15 20:40:32.821895984 +0000 2024-09-15T20:46:11.635 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-15 20:40:32.553910974 +0000 2024-09-15T20:46:11.635 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-15 20:40:32.553910974 +0000 2024-09-15T20:46:11.635 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2024-09-15T20:46:11.636 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T20:46:11.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-15T20:46:11.689 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-15T20:46:11.689 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000304784 s, 1.7 MB/s 2024-09-15T20:46:11.691 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T20:46:11.740 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-09-15T20:46:11.787 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T20:46:11.787 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T20:46:11.787 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-09-15T20:46:11.788 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T20:46:11.788 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-15 20:40:33.309868997 +0000 2024-09-15T20:46:11.788 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-15 20:40:33.041883718 +0000 2024-09-15T20:46:11.788 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-15 20:40:33.041883718 +0000 2024-09-15T20:46:11.788 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2024-09-15T20:46:11.788 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T20:46:11.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-15T20:46:11.841 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-15T20:46:11.841 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000203633 s, 2.5 MB/s 2024-09-15T20:46:11.842 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T20:46:11.892 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-09-15T20:46:11.939 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T20:46:11.939 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T20:46:11.939 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-15T20:46:11.939 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T20:46:11.939 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-15 20:40:33.777843289 +0000 2024-09-15T20:46:11.939 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-15 20:40:33.517857571 +0000 2024-09-15T20:46:11.939 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-15 20:40:33.517857571 +0000 2024-09-15T20:46:11.939 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2024-09-15T20:46:11.940 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T20:46:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-15T20:46:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-15T20:46:11.997 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000204093 s, 2.5 MB/s 2024-09-15T20:46:11.998 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T20:46:12.049 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T20:46:12.049 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:12.050 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T20:46:12.055 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T20:46:12.055 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-15T20:46:12.101 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T20:46:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T20:46:12.102 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-15T20:46:12.102 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T20:46:12.102 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-15 20:40:31.238507577 +0000 2024-09-15T20:46:12.102 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-15 20:40:31.002509672 +0000 2024-09-15T20:46:12.102 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-15 20:40:31.002509672 +0000 2024-09-15T20:46:12.102 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-15T20:46:12.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T20:46:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-15T20:46:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-15T20:46:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000450134 s, 1.1 MB/s 2024-09-15T20:46:12.157 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T20:46:12.207 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-15T20:46:12.253 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T20:46:12.253 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T20:46:12.253 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-15T20:46:12.253 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T20:46:12.254 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-15 20:40:31.762502926 +0000 2024-09-15T20:46:12.254 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-15 20:40:31.490505340 +0000 2024-09-15T20:46:12.254 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-15 20:40:31.490505340 +0000 2024-09-15T20:46:12.254 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-15T20:46:12.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T20:46:12.307 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-15T20:46:12.308 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-15T20:46:12.308 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000346045 s, 1.5 MB/s 2024-09-15T20:46:12.309 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T20:46:12.358 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-15T20:46:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T20:46:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T20:46:12.405 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-09-15T20:46:12.405 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T20:46:12.405 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-15 20:40:32.262498488 +0000 2024-09-15T20:46:12.405 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-15 20:40:32.014500689 +0000 2024-09-15T20:46:12.405 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-15 20:40:32.014500689 +0000 2024-09-15T20:46:12.405 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-15T20:46:12.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T20:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-15T20:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-15T20:46:12.459 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000333587 s, 1.5 MB/s 2024-09-15T20:46:12.460 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T20:46:12.510 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-15T20:46:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T20:46:12.557 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T20:46:12.557 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-09-15T20:46:12.557 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T20:46:12.557 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-15 20:40:32.754494121 +0000 2024-09-15T20:46:12.558 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-15 20:40:32.498496393 +0000 2024-09-15T20:46:12.558 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-15 20:40:32.498496393 +0000 2024-09-15T20:46:12.558 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-15T20:46:12.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T20:46:12.616 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-15T20:46:12.616 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-15T20:46:12.616 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000392981 s, 1.3 MB/s 2024-09-15T20:46:12.617 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T20:46:12.666 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T20:46:12.666 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T20:46:12.666 INFO:tasks.ceph:Generating config... 2024-09-15T20:46:12.668 INFO:tasks.ceph:[client] debug cephsqlite = 20 2024-09-15T20:46:12.668 INFO:tasks.ceph:[client] debug client = 20 2024-09-15T20:46:12.668 INFO:tasks.ceph:[client] debug ms = 1 2024-09-15T20:46:12.668 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-15T20:46:12.668 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-09-15T20:46:12.668 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-15T20:46:12.668 INFO:tasks.ceph:[global] ms type = async 2024-09-15T20:46:12.668 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T20:46:12.669 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T20:46:12.669 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T20:46:12.669 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T20:46:12.669 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T20:46:12.669 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-15T20:46:12.669 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-15T20:46:12.669 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-15T20:46:12.669 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-15T20:46:12.669 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-15T20:46:12.669 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-15T20:46:12.669 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-15T20:46:12.669 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-15T20:46:12.669 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-15T20:46:12.669 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] bluestore write v2 = False 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-15T20:46:12.670 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-15T20:46:12.671 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-15T20:46:12.671 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2024-09-15T20:46:12.671 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-15T20:46:12.671 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-15T20:46:12.671 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-15T20:46:12.671 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-15T20:46:12.671 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T20:46:12.671 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T20:46:12.706 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T20:46:12.827 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T20:46:12.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T20:46:12.962 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52'), ('mon.c', '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]'), ('mon.b', '172.21.15.81')] 2024-09-15T20:46:12.962 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],172.21.15.81', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-15T20:46:12.963 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:12.963 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T20:46:13.011 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --addv c '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]' --add b 172.21.15.81 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:13.099 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:13.100 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid 5b0b6dfd-6a20-4023-acf9-e3c53f9607bc 2024-09-15T20:46:13.100 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = quincy 2024-09-15T20:46:13.100 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2024-09-15T20:46:13.100 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 5b0b6dfd-6a20-4023-acf9-e3c53f9607bc 2024-09-15T20:46:13.100 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2024-09-15T20:46:13.099961+0000 2024-09-15T20:46:13.100 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-09-15T20:46:13.099961+0000 2024-09-15T20:46:13.100 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 17 (quincy) 2024-09-15T20:46:13.100 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 3 2024-09-15T20:46:13.100 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-09-15T20:46:13.100 INFO:teuthology.orchestra.run.smithi052.stdout:1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.b 2024-09-15T20:46:13.100 INFO:teuthology.orchestra.run.smithi052.stdout:2: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.c 2024-09-15T20:46:13.100 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-15T20:46:13.105 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T20:46:13.110 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5b0b6dfd-6a20-4023-acf9-e3c53f9607bc... 2024-09-15T20:46:13.111 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T20:46:13.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T20:46:13.186 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-09-15T20:46:13.186 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-09-15T20:46:13.186 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T20:46:13.186 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-09-15T20:46:13.186 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.186 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.187 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T20:46:13.188 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T20:46:13.188 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.188 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-09-15T20:46:13.188 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.188 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-09-15T20:46:13.188 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-09-15T20:46:13.188 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-09-15T20:46:13.188 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-09-15T20:46:13.188 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-09-15T20:46:13.188 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-09-15T20:46:13.188 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-09-15T20:46:13.188 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T20:46:13.189 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T20:46:13.189 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-09-15T20:46:13.189 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.189 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T20:46:13.189 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.189 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-09-15T20:46:13.189 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.189 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-09-15T20:46:13.189 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.189 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-09-15T20:46:13.189 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-09-15T20:46:13.189 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],172.21.15.81" 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout: mon client directed command retry = 5 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout: mon election default strategy = 3 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout: ms inject socket failures = 5000 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout: ms type = async 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 5b0b6dfd-6a20-4023-acf9-e3c53f9607bc 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-09-15T20:46:13.190 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug trim objects = true 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.191 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: bdev async discard = True 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: bdev enable discard = True 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-09-15T20:46:13.192 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore write v2 = False 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore zero block detection = True 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 20 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 20 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 10 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify cached snaps = True 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify missing on start = True 2024-09-15T20:46:13.193 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock override recovery settings = True 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout: osd memory target = 1610612736 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout: osd op queue = debug_random 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout: osd op queue cut off = debug_random 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout: osd shutdown pgref assert = True 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-15T20:46:13.194 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-09-15T20:46:13.195 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: mon min osdmap epochs = 50 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: mon osdmap full prune interval = 2 2024-09-15T20:46:13.196 INFO:teuthology.orchestra.run.smithi052.stdout: mon osdmap full prune min = 15 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout: mon osdmap full prune txsize = 2 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout: mon scrub interval = 300 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout: paxos service trim min = 10 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout: debug cephsqlite = 20 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-09-15T20:46:13.197 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-09-15T20:46:13.198 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2024-09-15T20:46:13.198 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2024-09-15T20:46:13.199 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-15T20:46:13.199 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-15T20:46:13.199 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T20:46:13.199 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-15T20:46:13.199 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.199 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-15T20:46:13.199 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.199 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-15T20:46:13.199 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-15T20:46:13.201 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.201 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-15T20:46:13.201 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-15T20:46:13.201 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-15T20:46:13.201 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-15T20:46:13.201 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-15T20:46:13.201 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-15T20:46:13.201 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-15T20:46:13.201 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T20:46:13.201 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T20:46:13.201 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-15T20:46:13.201 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],172.21.15.81" 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: mon client directed command retry = 5 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: mon election default strategy = 3 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: ms inject socket failures = 5000 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: ms type = async 2024-09-15T20:46:13.202 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 5b0b6dfd-6a20-4023-acf9-e3c53f9607bc 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-15T20:46:13.203 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-15T20:46:13.204 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: bdev async discard = True 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: bdev enable discard = True 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore write v2 = False 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore zero block detection = True 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2024-09-15T20:46:13.205 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify cached snaps = True 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify missing on start = True 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock override recovery settings = True 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: osd memory target = 1610612736 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: osd op queue = debug_random 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: osd op queue cut off = debug_random 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: osd shutdown pgref assert = True 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-15T20:46:13.206 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-15T20:46:13.207 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-15T20:46:13.208 INFO:teuthology.orchestra.run.smithi081.stdout: mon min osdmap epochs = 50 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: mon osdmap full prune interval = 2 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: mon osdmap full prune min = 15 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: mon osdmap full prune txsize = 2 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: mon scrub interval = 300 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: paxos service trim min = 10 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: debug cephsqlite = 20 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2024-09-15T20:46:13.209 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-15T20:46:13.210 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-15T20:46:13.210 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-09-15T20:46:13.210 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-09-15T20:46:13.210 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T20:46:13.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T20:46:13.292 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T20:46:13.292 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:13.292 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T20:46:13.298 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:13.298 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T20:46:13.346 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:46:13.346 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:13.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T20:46:13.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T20:46:13.412 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:13.412 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:13.459 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-09-15T20:46:13.459 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:13.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T20:46:13.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T20:46:13.482 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:13.482 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:13.529 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T20:46:13.530 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T20:46:13.530 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T20:46:13.577 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T20:46:13.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T20:46:13.623 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T20:46:13.638 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T20:46:13.638 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T20:46:13.638 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T20:46:13.674 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T20:46:13.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-15T20:46:13.719 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-15T20:46:13.730 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T20:46:13.730 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T20:46:13.731 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T20:46:13.742 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T20:46:13.742 INFO:tasks.ceph:role: osd.0 2024-09-15T20:46:13.742 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:46:13.742 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T20:46:13.799 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T20:46:13.799 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T20:46:13.799 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T20:46:13.799 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T20:46:13.799 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T20:46:13.800 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-09-15T20:46:13.800 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T20:46:13.800 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T20:46:13.800 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T20:46:13.800 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T20:46:13.823 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-09-15T20:46:13.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-09-15T20:46:13.825 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T20:46:13.885 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T20:46:13.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:46:13.935 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T20:46:13.936 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T20:46:13.990 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T20:46:13.990 INFO:tasks.ceph:role: osd.1 2024-09-15T20:46:13.990 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:46:13.990 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T20:46:14.046 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T20:46:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T20:46:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T20:46:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T20:46:14.046 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T20:46:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-09-15T20:46:14.046 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T20:46:14.046 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T20:46:14.046 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T20:46:14.046 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T20:46:14.070 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-09-15T20:46:14.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-09-15T20:46:14.072 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T20:46:14.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T20:46:14.184 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T20:46:14.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:46:14.185 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T20:46:14.238 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T20:46:14.240 INFO:tasks.ceph:role: osd.2 2024-09-15T20:46:14.240 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:46:14.240 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T20:46:14.297 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T20:46:14.297 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T20:46:14.297 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T20:46:14.297 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T20:46:14.297 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T20:46:14.297 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-09-15T20:46:14.298 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T20:46:14.298 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T20:46:14.298 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T20:46:14.298 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T20:46:14.321 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-09-15T20:46:14.323 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-09-15T20:46:14.323 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-15T20:46:14.383 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T20:46:14.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:46:14.435 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T20:46:14.435 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-15T20:46:14.488 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T20:46:14.489 INFO:tasks.ceph:role: osd.3 2024-09-15T20:46:14.489 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:46:14.489 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T20:46:14.543 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T20:46:14.543 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T20:46:14.543 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T20:46:14.543 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T20:46:14.543 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T20:46:14.543 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2024-09-15T20:46:14.543 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T20:46:14.544 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T20:46:14.544 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T20:46:14.544 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T20:46:14.566 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2024-09-15T20:46:14.568 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2024-09-15T20:46:14.568 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-15T20:46:14.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-15T20:46:14.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:46:14.682 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T20:46:14.682 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:14.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:14.802+0000 7f1546cd47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-15T20:46:14.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:14.802+0000 7f1546cd47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-15T20:46:14.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:14.802+0000 7f1546cd47c0 -1 bdev(0x55743f9ff800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-15T20:46:14.805 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:14.802+0000 7f1546cd47c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-15T20:46:17.924 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T20:46:17.939 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:18.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:18.018+0000 7f658d90e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-15T20:46:18.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:18.018+0000 7f658d90e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-15T20:46:18.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:18.018+0000 7f658d90e7c0 -1 bdev(0x564509e41800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-15T20:46:18.022 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:18.022+0000 7f658d90e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-15T20:46:21.378 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T20:46:21.435 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:21.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:21.518+0000 7f82d3ece7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-15T20:46:21.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:21.518+0000 7f82d3ece7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-15T20:46:21.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:21.518+0000 7f82d3ece7c0 -1 bdev(0x5564ed793800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-15T20:46:21.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:21.518+0000 7f82d3ece7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-15T20:46:24.618 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T20:46:24.679 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:24.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:24.762+0000 7f6b6a9b77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-15T20:46:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:24.762+0000 7f6b6a9b77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-15T20:46:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:24.762+0000 7f6b6a9b77c0 -1 bdev(0x55b493e7d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-15T20:46:24.764 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:24.762+0000 7f6b6a9b77c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-15T20:46:27.921 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-15T20:46:27.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-15T20:46:27.993 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T20:46:27.994 INFO:tasks.ceph:role: osd.4 2024-09-15T20:46:27.994 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-15T20:46:27.994 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T20:46:28.056 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T20:46:28.056 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T20:46:28.056 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T20:46:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T20:46:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T20:46:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-15T20:46:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T20:46:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T20:46:28.057 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T20:46:28.057 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T20:46:28.522 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-15T20:46:28.524 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-15T20:46:28.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-15T20:46:28.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-15T20:46:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T20:46:28.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:46:28.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-15T20:46:28.720 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T20:46:28.720 INFO:tasks.ceph:role: osd.5 2024-09-15T20:46:28.720 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-15T20:46:28.720 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T20:46:28.781 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T20:46:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T20:46:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T20:46:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T20:46:28.782 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T20:46:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-15T20:46:28.782 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T20:46:28.782 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T20:46:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T20:46:28.782 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T20:46:29.247 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-15T20:46:29.249 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-15T20:46:29.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-15T20:46:29.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-15T20:46:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T20:46:29.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:46:29.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-15T20:46:29.469 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T20:46:29.470 INFO:tasks.ceph:role: osd.6 2024-09-15T20:46:29.470 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-15T20:46:29.470 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T20:46:29.538 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T20:46:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T20:46:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T20:46:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T20:46:29.538 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T20:46:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-15T20:46:29.538 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T20:46:29.539 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T20:46:29.539 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T20:46:29.539 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T20:46:30.014 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-15T20:46:30.016 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-15T20:46:30.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-15T20:46:30.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-15T20:46:30.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:46:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T20:46:30.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-15T20:46:30.221 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T20:46:30.222 INFO:tasks.ceph:role: osd.7 2024-09-15T20:46:30.222 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-15T20:46:30.222 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T20:46:30.285 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T20:46:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T20:46:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T20:46:30.285 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T20:46:30.285 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T20:46:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-15T20:46:30.286 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T20:46:30.286 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T20:46:30.286 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T20:46:30.286 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T20:46:30.706 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-15T20:46:30.708 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-15T20:46:30.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-15T20:46:30.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-15T20:46:30.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:46:30.815 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T20:46:30.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:30.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:30.919+0000 7fc87657d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-15T20:46:30.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:30.923+0000 7fc87657d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-15T20:46:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:30.923+0000 7fc87657d7c0 -1 bdev(0x556864db9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-15T20:46:30.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:30.923+0000 7fc87657d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-15T20:46:34.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-15T20:46:34.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:34.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:34.175+0000 7f88d52687c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-15T20:46:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:34.175+0000 7f88d52687c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-15T20:46:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:34.175+0000 7f88d52687c0 -1 bdev(0x557652fbf800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-15T20:46:34.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:34.175+0000 7f88d52687c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-15T20:46:37.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-15T20:46:37.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:37.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:37.443+0000 7fa06fe717c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-15T20:46:37.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:37.443+0000 7fa06fe717c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-15T20:46:37.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:37.443+0000 7fa06fe717c0 -1 bdev(0x560d266df800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-15T20:46:37.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:37.447+0000 7fa06fe717c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-15T20:46:40.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-15T20:46:40.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:40.719+0000 7f9b8088e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-15T20:46:40.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:40.719+0000 7f9b8088e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-15T20:46:40.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:40.719+0000 7f9b8088e7c0 -1 bdev(0x558466041800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-15T20:46:40.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:40.723+0000 7f9b8088e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-15T20:46:43.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-15T20:46:43.926 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T20:46:43.927 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:43.927 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-15T20:46:43.942 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:43.942 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T20:46:43.998 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:43.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T20:46:44.054 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:44.054 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T20:46:44.110 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:44.110 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-15T20:46:44.166 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:44.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T20:46:44.180 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:44.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-15T20:46:44.236 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:44.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-15T20:46:44.288 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:44.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-15T20:46:44.344 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:44.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-15T20:46:44.401 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:44.401 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T20:46:44.406 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:44.406 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-15T20:46:44.453 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T20:46:44.453 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T20:46:44.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T20:46:44.503 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2024-09-15T20:46:44.503 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCVR+dm2clnIhAAveqUh4YDyJW88AOtyFQeTw== 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCWR+dmnLL+LxAAC3abB6amhHKjNnY/B43uBw== 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCaR+dmgZ1PARAAjoFcE4YPKbt+8lhb6Hie9w== 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCdR+dm2AH+HhAAOe9NoaJMp3Zuj7BGYdCJhA== 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCgR+dmpASBLRAADAKsmZh2z1i4kaTuluxQCw== 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCVR+dmj/wFJRAAS3gvQe+btbFEdN9yEcj3vA== 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.4] 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCmR+dmlzoTNxAAgc4F4MNma3ikjqx6merdAA== 2024-09-15T20:46:44.504 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.5] 2024-09-15T20:46:44.505 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCqR+dmL7W/ChAAcGMgKRjdvuC6Raj9NkkMLA== 2024-09-15T20:46:44.505 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.6] 2024-09-15T20:46:44.505 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCtR+dmTUTMGhAAvF2gvzi/CB6fGm9StwRwig== 2024-09-15T20:46:44.505 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.7] 2024-09-15T20:46:44.505 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCwR+dmw5BDKxAAyf7RptFecJ0jr5Q8JedPXA== 2024-09-15T20:46:44.505 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-09-15T20:46:44.505 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCVR+dmafs7KBAA5I5aZuddyke+roevbVyhww== 2024-09-15T20:46:44.505 INFO:teuthology.orchestra.run.smithi052.stdout:[client.1] 2024-09-15T20:46:44.505 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQCVR+dm9znDKhAAT8RVyCGHbJ9O9rgWzhPkOA== 2024-09-15T20:46:44.511 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2024-09-15T20:46:44.511 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCVR+dm2clnIhAAveqUh4YDyJW88AOtyFQeTw== 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCWR+dmnLL+LxAAC3abB6amhHKjNnY/B43uBw== 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCaR+dmgZ1PARAAjoFcE4YPKbt+8lhb6Hie9w== 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCdR+dm2AH+HhAAOe9NoaJMp3Zuj7BGYdCJhA== 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCgR+dmpASBLRAADAKsmZh2z1i4kaTuluxQCw== 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCVR+dmj/wFJRAAS3gvQe+btbFEdN9yEcj3vA== 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCmR+dmlzoTNxAAgc4F4MNma3ikjqx6merdAA== 2024-09-15T20:46:44.512 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2024-09-15T20:46:44.513 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCqR+dmL7W/ChAAcGMgKRjdvuC6Raj9NkkMLA== 2024-09-15T20:46:44.513 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2024-09-15T20:46:44.513 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCtR+dmTUTMGhAAvF2gvzi/CB6fGm9StwRwig== 2024-09-15T20:46:44.513 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2024-09-15T20:46:44.513 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCwR+dmw5BDKxAAyf7RptFecJ0jr5Q8JedPXA== 2024-09-15T20:46:44.513 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-15T20:46:44.513 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCVR+dmafs7KBAA5I5aZuddyke+roevbVyhww== 2024-09-15T20:46:44.513 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2024-09-15T20:46:44.513 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCVR+dm9znDKhAAT8RVyCGHbJ9O9rgWzhPkOA== 2024-09-15T20:46:44.514 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T20:46:44.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T20:46:44.601 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:44.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:44.647 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:44.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:44.728 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:44.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:44.813 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:44.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:44.902 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T20:46:44.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T20:46:44.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:44.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:45.060 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:45.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:45.121 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:45.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:45.203 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:45.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T20:46:45.280 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T20:46:45.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T20:46:45.363 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T20:46:45.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T20:46:45.447 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T20:46:45.448 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T20:46:45.460 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T20:46:45.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T20:46:45.569 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-15T20:46:45.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T20:46:45.721 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-15T20:46:45.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-15T20:46:45.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T20:46:45.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-15T20:46:45.854 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:45.856 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T20:46:45.901 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T20:46:45.902 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T20:46:45.902 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T20:46:45.904 INFO:tasks.ceph.mon.a:Started 2024-09-15T20:46:45.904 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-15T20:46:45.905 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-15T20:46:45.907 INFO:tasks.ceph.mon.c:Started 2024-09-15T20:46:45.907 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-15T20:46:45.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-15T20:46:45.946 INFO:tasks.ceph.mon.b:Started 2024-09-15T20:46:45.947 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T20:46:45.947 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-15T20:46:45.947 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-15T20:46:45.949 INFO:tasks.ceph.mgr.y:Started 2024-09-15T20:46:45.950 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T20:46:45.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T20:46:45.952 INFO:tasks.ceph.mgr.x:Started 2024-09-15T20:46:45.953 DEBUG:tasks.ceph:set 0 configs 2024-09-15T20:46:45.953 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T20:46:45.953 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T20:46:46.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.069+0000 7f417067c640 1 Processor -- start 2024-09-15T20:46:46.073 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.069+0000 7f417067c640 1 -- start start 2024-09-15T20:46:46.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.073+0000 7f417067c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:46.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.073+0000 7f417067c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f416813ede0 con 0x7f4168144ce0 2024-09-15T20:46:46.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.073+0000 7f417067c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41681451c0 con 0x7f416806ce60 2024-09-15T20:46:46.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.073+0000 7f417067c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f41681456e0 con 0x7f41681419b0 2024-09-15T20:46:46.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.073+0000 7f416ec19640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:46.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.073+0000 7f416dc17640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4168144ce0 0x7f41681412a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:42694/0 (socket says 172.21.15.52:42694) 2024-09-15T20:46:46.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.073+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 learned_addr learned my addr 172.21.15.52:0/3471654951 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:46:46.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.073+0000 7f416ec19640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 msgr2=0x7f416814cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T20:46:46.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.073+0000 7f416ec19640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 msgr2=0x7f416814cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:46.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.073+0000 7f416ec19640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:46.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.073+0000 7f416ec19640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T20:46:46.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.277+0000 7f416ec19640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:46.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.277+0000 7f416ec19640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 msgr2=0x7f416814cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T20:46:46.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.277+0000 7f416ec19640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 msgr2=0x7f416814cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:46.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.277+0000 7f416ec19640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:46.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.277+0000 7f416ec19640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T20:46:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.681+0000 7f416ec19640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.681+0000 7f416ec19640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 msgr2=0x7f416814cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T20:46:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.681+0000 7f416ec19640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 msgr2=0x7f416814cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.681+0000 7f416ec19640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:46.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:46.681+0000 7f416ec19640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T20:46:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:47.485+0000 7f416ec19640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:47.485+0000 7f416ec19640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 msgr2=0x7f416814cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T20:46:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:47.485+0000 7f416ec19640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 msgr2=0x7f416814cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:47.485+0000 7f416ec19640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:47.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:47.485+0000 7f416ec19640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T20:46:49.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f415ffff640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 msgr2=0x7f416814cbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T20:46:49.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f415ffff640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41681419b0 0x7f416814cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:49.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f415ffff640 1 -- 172.21.15.52:0/3471654951 >> v1:172.21.15.81:6789/0 conn(0x7f416806ce60 legacy=0x7f41680afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:49.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f415ffff640 1 -- 172.21.15.52:0/3471654951 >> v1:172.21.15.52:6789/0 conn(0x7f4168144ce0 legacy=0x7f41681412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:49.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f415ffff640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:49.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f415ffff640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:49.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f415ffff640 1 -- 172.21.15.52:0/3471654951 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f41681456e0 con 0x7f414c0061d0 2024-09-15T20:46:49.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f415ffff640 1 -- 172.21.15.52:0/3471654951 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f414c008d20 con 0x7f414c003700 2024-09-15T20:46:49.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:49.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:49.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T20:46:49.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:49.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:49.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 msgr2=0x7f414c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T20:46:49.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 msgr2=0x7f414c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:49.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:49.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T20:46:49.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.073+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T20:46:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.277+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.277+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.277+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 msgr2=0x7f414c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T20:46:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.277+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 msgr2=0x7f414c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.277+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.277+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T20:46:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.277+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T20:46:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.277+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.277+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:49.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.277+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T20:46:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.681+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.681+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 msgr2=0x7f414c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T20:46:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.681+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 msgr2=0x7f414c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.681+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.681+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T20:46:49.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.681+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:49.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.681+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T20:46:49.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.681+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:49.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.681+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:49.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:49.681+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T20:46:50.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:50.485+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:50.485+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 msgr2=0x7f414c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T20:46:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:50.485+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 msgr2=0x7f414c008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:50.485+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:50.485+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T20:46:50.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:50.485+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:50.485+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T20:46:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:50.485+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:50.485+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:50.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:50.485+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T20:46:52.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f415ffff640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T20:46:52.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f415ffff640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.075 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f415ffff640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 msgr2=0x7f414c008690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f415ffff640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c0061d0 0x7f414c008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f415ffff640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 0x7f414c00b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f416ec19640 1 -- 172.21.15.52:0/3471654951 reap_dead start 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f415ffff640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f415ffff640 1 -- 172.21.15.52:0/3471654951 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41680b2810 con 0x7f416806ce60 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f415ffff640 1 -- 172.21.15.52:0/3471654951 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f41681456e0 con 0x7f414c009110 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f415ffff640 1 -- 172.21.15.52:0/3471654951 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f414c008d20 con 0x7f414c003700 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 0x7f414c00b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 msgr2=0x7f414c00b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 msgr2=0x7f414c00b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 0x7f414c00b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:52.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T20:46:52.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:52.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:52.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 0x7f414c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T20:46:52.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.073+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T20:46:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.277+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 0x7f414c00b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.277+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.277+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 msgr2=0x7f414c00b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T20:46:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.277+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 msgr2=0x7f414c00b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.277+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 0x7f414c00b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.277+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 0x7f414c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T20:46:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.277+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T20:46:52.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.277+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:52.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.277+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:52.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.277+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T20:46:52.546 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.545+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4108222485 0 0) 0x7f41680b2810 con 0x7f416806ce60 2024-09-15T20:46:52.547 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.545+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4154003530 con 0x7f416806ce60 2024-09-15T20:46:52.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 <== mon.1 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1379591316 0 0) 0x7f4154003530 con 0x7f416806ce60 2024-09-15T20:46:52.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 msgr2=0x7f414c005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T20:46:52.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.81:3300/0 conn(0x7f414c003700 0x7f414c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 msgr2=0x7f414c00b500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T20:46:52.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 --2- 172.21.15.52:0/3471654951 >> v2:172.21.15.52:3300/0 conn(0x7f414c009110 0x7f414c00b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c008890 con 0x7f416806ce60 2024-09-15T20:46:52.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 <== mon.1 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 282972984 0 0) 0x7f4160009a00 con 0x7f416806ce60 2024-09-15T20:46:52.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 >> v1:172.21.15.81:6789/0 conn(0x7f416806ce60 legacy=0x7f414c00bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:52.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154003a10 0x7f4154003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:52.553 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4154004810 0x7f4154004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:52.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41540052f0 0x7f415400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:52.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f41681456e0 con 0x7f4154004810 2024-09-15T20:46:52.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f414c008d20 con 0x7f4154003a10 2024-09-15T20:46:52.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f415400c240 con 0x7f41540052f0 2024-09-15T20:46:52.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154003a10 0x7f4154003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:52.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4154004810 0x7f4154004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:52.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416ec19640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41540052f0 0x7f415400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:52.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154003a10 msgr2=0x7f4154003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T20:46:52.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416e418640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154003a10 msgr2=0x7f4154003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T20:46:52.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154003a10 0x7f4154003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T20:46:52.554 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416e418640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154003a10 0x7f4154003e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T20:46:52.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41540052f0 msgr2=0x7f415400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:52.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f41540052f0 0x7f415400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154003a10 msgr2=0x7f4154003e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T20:46:52.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154003a10 0x7f4154003e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416dc17640 1 -- 172.21.15.52:0/3471654951 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4154003530 con 0x7f4154004810 2024-09-15T20:46:52.555 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.549+0000 7f416ec19640 1 -- 172.21.15.52:0/3471654951 reap_dead start 2024-09-15T20:46:52.559 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.557+0000 7f416dc17640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4154004810 0x7f4154004c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f414c008bd0 tx=0x7f415801d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97b3b416cf51501 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:52.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.561+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41580af020 con 0x7f4154004810 2024-09-15T20:46:52.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.561+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41580a7490 con 0x7f4154004810 2024-09-15T20:46:52.563 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.561+0000 7f416d416640 1 -- 172.21.15.52:0/3471654951 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158005cd0 con 0x7f4154004810 2024-09-15T20:46:52.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.561+0000 7f417067c640 1 -- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4154004810 msgr2=0x7f4154004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:52.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.561+0000 7f417067c640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4154004810 0x7f4154004c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f414c008bd0 tx=0x7f415801d9a0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.561+0000 7f417067c640 1 -- 172.21.15.52:0/3471654951 shutdown_connections 2024-09-15T20:46:52.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.561+0000 7f417067c640 1 --2- 172.21.15.52:0/3471654951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4154004810 0x7f4154004c90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.561+0000 7f417067c640 1 -- 172.21.15.52:0/3471654951 >> 172.21.15.52:0/3471654951 conn(0x7f41680b64c0 msgr2=0x7f41680b68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:52.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.561+0000 7f417067c640 1 -- 172.21.15.52:0/3471654951 shutdown_connections 2024-09-15T20:46:52.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.561+0000 7f417067c640 1 -- 172.21.15.52:0/3471654951 wait complete. 2024-09-15T20:46:52.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f417067c640 1 Processor -- start 2024-09-15T20:46:52.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f417067c640 1 -- start start 2024-09-15T20:46:52.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f417067c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154004810 0x7f416813a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:52.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f417067c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f416813aee0 0x7f4168136830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:52.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f417067c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4168136d70 0x7f41681382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:52.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f417067c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4168141630 con 0x7f4168136d70 2024-09-15T20:46:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f417067c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f41681414b0 con 0x7f4154004810 2024-09-15T20:46:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f417067c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f41681417b0 con 0x7f416813aee0 2024-09-15T20:46:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416dc17640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f416813aee0 0x7f4168136830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416ec19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4168136d70 0x7f41681382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416dc17640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f416813aee0 0x7f4168136830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:45872/0 (socket says 172.21.15.52:45872) 2024-09-15T20:46:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416dc17640 1 -- 172.21.15.52:0/4226836029 learned_addr learned my addr 172.21.15.52:0/4226836029 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:46:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416ec19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4168136d70 0x7f41681382c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45188/0 (socket says 172.21.15.52:45188) 2024-09-15T20:46:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416e418640 1 --2- 172.21.15.52:0/4226836029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154004810 0x7f416813a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416ec19640 1 -- 172.21.15.52:0/4226836029 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f416813aee0 msgr2=0x7f4168136830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416ec19640 1 --2- 172.21.15.52:0/4226836029 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f416813aee0 0x7f4168136830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416ec19640 1 -- 172.21.15.52:0/4226836029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154004810 msgr2=0x7f416813a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416ec19640 1 --2- 172.21.15.52:0/4226836029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154004810 0x7f416813a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416ec19640 1 -- 172.21.15.52:0/4226836029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4168139fd0 con 0x7f4168136d70 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416dc17640 1 --2- 172.21.15.52:0/4226836029 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f416813aee0 0x7f4168136830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416e418640 1 --2- 172.21.15.52:0/4226836029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154004810 0x7f416813a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f416ec19640 1 --2- 172.21.15.52:0/4226836029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4168136d70 0x7f41681382c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4168141d90 tx=0x7f41600156a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f415effd640 1 -- 172.21.15.52:0/4226836029 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416001c030 con 0x7f4168136d70 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f415effd640 1 -- 172.21.15.52:0/4226836029 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4160015ca0 con 0x7f4168136d70 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f417067c640 1 -- 172.21.15.52:0/4226836029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416813a240 con 0x7f4168136d70 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f415effd640 1 -- 172.21.15.52:0/4226836029 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160015e90 con 0x7f4168136d70 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f417067c640 1 -- 172.21.15.52:0/4226836029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4168137a90 con 0x7f4168136d70 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f415effd640 1 -- 172.21.15.52:0/4226836029 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f416001f030 con 0x7f4168136d70 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f415effd640 1 -- 172.21.15.52:0/4226836029 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4160020ce0 con 0x7f4168136d70 2024-09-15T20:46:52.571 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.565+0000 7f417067c640 1 -- 172.21.15.52:0/4226836029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41680afee0 con 0x7f4168136d70 2024-09-15T20:46:52.572 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.569+0000 7f415effd640 1 -- 172.21.15.52:0/4226836029 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f416813a240 con 0x7f4168136d70 2024-09-15T20:46:52.640 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.637+0000 7f417067c640 1 -- 172.21.15.52:0/4226836029 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f41680b4210 con 0x7f4168136d70 2024-09-15T20:46:52.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.641+0000 7f415effd640 1 -- 172.21.15.52:0/4226836029 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f41600203c0 con 0x7f4168136d70 2024-09-15T20:46:52.642 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-09-15T20:46:52.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.641+0000 7f417067c640 1 -- 172.21.15.52:0/4226836029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4168136d70 msgr2=0x7f41681382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:52.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.641+0000 7f417067c640 1 --2- 172.21.15.52:0/4226836029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4168136d70 0x7f41681382c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4168141d90 tx=0x7f41600156a0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.641+0000 7f417067c640 1 -- 172.21.15.52:0/4226836029 shutdown_connections 2024-09-15T20:46:52.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.641+0000 7f417067c640 1 --2- 172.21.15.52:0/4226836029 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4168136d70 0x7f41681382c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.641+0000 7f417067c640 1 --2- 172.21.15.52:0/4226836029 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f416813aee0 0x7f4168136830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.641+0000 7f417067c640 1 --2- 172.21.15.52:0/4226836029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4154004810 0x7f416813a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:52.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.641+0000 7f417067c640 1 -- 172.21.15.52:0/4226836029 >> 172.21.15.52:0/4226836029 conn(0x7f41680b64c0 msgr2=0x7f41680b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:52.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.641+0000 7f417067c640 1 -- 172.21.15.52:0/4226836029 shutdown_connections 2024-09-15T20:46:52.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:52.641+0000 7f417067c640 1 -- 172.21.15.52:0/4226836029 wait complete. 2024-09-15T20:46:52.662 INFO:tasks.ceph:check_enable_crimson: False 2024-09-15T20:46:52.663 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T20:46:52.663 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:52.663 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T20:46:52.675 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:52.675 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T20:46:52.730 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:52.730 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T20:46:52.786 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:46:52.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-15T20:46:52.842 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:52.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-15T20:46:52.855 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:52.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-15T20:46:52.909 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:52.909 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-15T20:46:52.964 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-15T20:46:52.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-15T20:46:53.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new b99fda03-8405-4cd4-aea3-a8cc67bc0fe6 0 2024-09-15T20:46:53.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.175+0000 7fad2d8f9640 1 Processor -- start 2024-09-15T20:46:53.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.175+0000 7fad2d8f9640 1 -- start start 2024-09-15T20:46:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.175+0000 7fad2d8f9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad28074970 0x7fad2813d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.175+0000 7fad2d8f9640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad28140e50 con 0x7fad28074d50 2024-09-15T20:46:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.175+0000 7fad2d8f9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad28072cf0 con 0x7fad281409a0 2024-09-15T20:46:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.175+0000 7fad2d8f9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fad28073f10 con 0x7fad28074970 2024-09-15T20:46:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.175+0000 7fad277fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fad281409a0 0x7fad2814aba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45490/0 (socket says 172.21.15.81:45490) 2024-09-15T20:46:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.175+0000 7fad277fe640 1 -- 172.21.15.81:0/2700817095 learned_addr learned my addr 172.21.15.81:0/2700817095 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-15T20:46:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.175+0000 7fad26ffd640 1 --2- 172.21.15.81:0/2700817095 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad28074970 0x7fad2813d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.175+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1804957132 0 0) 0x7fad28072cf0 con 0x7fad281409a0 2024-09-15T20:46:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.175+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad14003530 con 0x7fad281409a0 2024-09-15T20:46:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 <== mon.1 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 771388314 0 0) 0x7fad14003530 con 0x7fad281409a0 2024-09-15T20:46:53.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad28074970 msgr2=0x7fad2813d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 --2- 172.21.15.81:0/2700817095 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad28074970 0x7fad2813d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 >> v1:172.21.15.52:6789/0 conn(0x7fad28074d50 legacy=0x7fad28140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad28072fb0 con 0x7fad281409a0 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 <== mon.1 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 282972984 0 0) 0x7fad18001700 con 0x7fad281409a0 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 >> v1:172.21.15.81:6789/0 conn(0x7fad281409a0 legacy=0x7fad2814aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 --2- 172.21.15.81:0/2700817095 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad28074970 0x7fad14003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 --2- 172.21.15.81:0/2700817095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14003fe0 0x7fad14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 --2- 172.21.15.81:0/2700817095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad14004d50 0x7fad140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad28073f10 con 0x7fad14004d50 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad1400bc60 con 0x7fad14003fe0 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fad1400e070 con 0x7fad28074970 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad267fc640 1 --2- 172.21.15.81:0/2700817095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14003fe0 0x7fad14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad26ffd640 1 --2- 172.21.15.81:0/2700817095 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad28074970 0x7fad14003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad277fe640 1 --2- 172.21.15.81:0/2700817095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad14004d50 0x7fad140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad267fc640 1 -- 172.21.15.81:0/2700817095 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad28074970 msgr2=0x7fad14003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:53.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad267fc640 1 --2- 172.21.15.81:0/2700817095 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad28074970 0x7fad14003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad267fc640 1 -- 172.21.15.81:0/2700817095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad14004d50 msgr2=0x7fad140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:53.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad267fc640 1 --2- 172.21.15.81:0/2700817095 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad14004d50 0x7fad140051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.179+0000 7fad267fc640 1 -- 172.21.15.81:0/2700817095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad14003530 con 0x7fad14003fe0 2024-09-15T20:46:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad267fc640 1 --2- 172.21.15.81:0/2700817095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14003fe0 0x7fad14004810 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad28071970 tx=0x7fad2001c550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c07e515fc82aba0b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20001ae0 con 0x7fad14003fe0 2024-09-15T20:46:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad20003b80 con 0x7fad14003fe0 2024-09-15T20:46:53.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad25ffb640 1 -- 172.21.15.81:0/2700817095 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad200050d0 con 0x7fad14003fe0 2024-09-15T20:46:53.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2700817095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14003fe0 msgr2=0x7fad14004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 --2- 172.21.15.81:0/2700817095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14003fe0 0x7fad14004810 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad28071970 tx=0x7fad2001c550 comp rx=0 tx=0).stop 2024-09-15T20:46:53.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad277fe640 1 -- 172.21.15.81:0/2700817095 reap_dead start 2024-09-15T20:46:53.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2700817095 shutdown_connections 2024-09-15T20:46:53.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2700817095 >> 172.21.15.81:0/2700817095 conn(0x7fad280b6290 msgr2=0x7fad280b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:53.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2700817095 shutdown_connections 2024-09-15T20:46:53.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2700817095 wait complete. 2024-09-15T20:46:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 Processor -- start 2024-09-15T20:46:53.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 -- start start 2024-09-15T20:46:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14003fe0 0x7fad2813c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad281d0820 0x7fad281d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad2813fd90 0x7fad281d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fad2806d7a0 con 0x7fad2813fd90 2024-09-15T20:46:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad2806d620 con 0x7fad14003fe0 2024-09-15T20:46:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fad2806d920 con 0x7fad281d0820 2024-09-15T20:46:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad26ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14003fe0 0x7fad2813c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad26ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14003fe0 0x7fad2813c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42964/0 (socket says 172.21.15.81:42964) 2024-09-15T20:46:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad26ffd640 1 -- 172.21.15.81:0/2078960471 learned_addr learned my addr 172.21.15.81:0/2078960471 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-15T20:46:53.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad267fc640 1 --2- 172.21.15.81:0/2078960471 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad281d0820 0x7fad281d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad277fe640 1 --2- 172.21.15.81:0/2078960471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad2813fd90 0x7fad281d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad26ffd640 1 -- 172.21.15.81:0/2078960471 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad281d0820 msgr2=0x7fad281d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad26ffd640 1 --2- 172.21.15.81:0/2078960471 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad281d0820 0x7fad281d1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad26ffd640 1 -- 172.21.15.81:0/2078960471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad2813fd90 msgr2=0x7fad281d24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad26ffd640 1 --2- 172.21.15.81:0/2078960471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad2813fd90 0x7fad281d24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad26ffd640 1 -- 172.21.15.81:0/2078960471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad281cfe30 con 0x7fad14003fe0 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad277fe640 1 --2- 172.21.15.81:0/2078960471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad2813fd90 0x7fad281d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad26ffd640 1 --2- 172.21.15.81:0/2078960471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14003fe0 0x7fad2813c260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fad100115e0 tx=0x7fad10011aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad1ffff640 1 -- 172.21.15.81:0/2078960471 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1000f8f0 con 0x7fad14003fe0 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad1ffff640 1 -- 172.21.15.81:0/2078960471 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1000fa90 con 0x7fad14003fe0 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2078960471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad281d9c80 con 0x7fad14003fe0 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad1ffff640 1 -- 172.21.15.81:0/2078960471 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1000fe40 con 0x7fad14003fe0 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2078960471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad281d0500 con 0x7fad14003fe0 2024-09-15T20:46:53.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad1ffff640 1 -- 172.21.15.81:0/2078960471 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fad10015460 con 0x7fad14003fe0 2024-09-15T20:46:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.183+0000 7fad1ffff640 1 -- 172.21.15.81:0/2078960471 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fad1001dc90 con 0x7fad14003fe0 2024-09-15T20:46:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.187+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2078960471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad281d1c30 con 0x7fad14003fe0 2024-09-15T20:46:53.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.187+0000 7fad1ffff640 1 -- 172.21.15.81:0/2078960471 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fad10019030 con 0x7fad14003fe0 2024-09-15T20:46:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.259+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2078960471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b99fda03-8405-4cd4-aea3-a8cc67bc0fe6", "id": 0} v 0) -- 0x7fad281401a0 con 0x7fad14003fe0 2024-09-15T20:46:53.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.267+0000 7fad1ffff640 1 -- 172.21.15.81:0/2078960471 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b99fda03-8405-4cd4-aea3-a8cc67bc0fe6", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fad100059a0 con 0x7fad14003fe0 2024-09-15T20:46:53.273 INFO:teuthology.orchestra.run.smithi081.stdout:0 2024-09-15T20:46:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.267+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2078960471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14003fe0 msgr2=0x7fad2813c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.267+0000 7fad2d8f9640 1 --2- 172.21.15.81:0/2078960471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14003fe0 0x7fad2813c260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fad100115e0 tx=0x7fad10011aa0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.267+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2078960471 shutdown_connections 2024-09-15T20:46:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.267+0000 7fad2d8f9640 1 --2- 172.21.15.81:0/2078960471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fad2813fd90 0x7fad281d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.267+0000 7fad2d8f9640 1 --2- 172.21.15.81:0/2078960471 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fad281d0820 0x7fad281d1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.267+0000 7fad2d8f9640 1 --2- 172.21.15.81:0/2078960471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad14003fe0 0x7fad2813c260 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.267+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2078960471 >> 172.21.15.81:0/2078960471 conn(0x7fad280b6290 msgr2=0x7fad281cb890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.267+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2078960471 shutdown_connections 2024-09-15T20:46:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.267+0000 7fad2d8f9640 1 -- 172.21.15.81:0/2078960471 wait complete. 2024-09-15T20:46:53.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 1d555c27-c8c2-4d30-9a50-be7cf9a60db5 1 2024-09-15T20:46:53.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.399+0000 7f6db420c640 1 Processor -- start 2024-09-15T20:46:53.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.399+0000 7f6db420c640 1 -- start start 2024-09-15T20:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.399+0000 7f6db420c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6dac0b1da0 0x7f6dac140190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.399+0000 7f6db420c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f6dac0b21d0 0x7f6dac1406d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.399+0000 7f6db420c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dac073fd0 con 0x7f6dac071aa0 2024-09-15T20:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.399+0000 7f6db420c640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f6dac0742b0 con 0x7f6dac0b21d0 2024-09-15T20:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.399+0000 7f6db420c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6dac074b20 con 0x7f6dac0b1da0 2024-09-15T20:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.399+0000 7f6db17a7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6dac0b1da0 0x7f6dac140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.399+0000 7f6db1fa8640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6dac071aa0 0x7f6dac071e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45496/0 (socket says 172.21.15.81:45496) 2024-09-15T20:46:53.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.399+0000 7f6db1fa8640 1 -- 172.21.15.81:0/2902797964 learned_addr learned my addr 172.21.15.81:0/2902797964 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-15T20:46:53.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.399+0000 7f6db17a7640 1 --2- 172.21.15.81:0/2902797964 >> v2:172.21.15.81:3300/0 conn(0x7f6dac0b1da0 0x7f6dac140190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42978/0 (socket says 172.21.15.81:42978) 2024-09-15T20:46:53.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db27a9640 1 --2- 172.21.15.81:0/2902797964 >> v2:172.21.15.52:3300/0 conn(0x7f6dac0b21d0 0x7f6dac1406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db17a7640 1 -- 172.21.15.81:0/2902797964 >> v2:172.21.15.52:3300/0 conn(0x7f6dac0b21d0 msgr2=0x7f6dac1406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:53.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db17a7640 1 --2- 172.21.15.81:0/2902797964 >> v2:172.21.15.52:3300/0 conn(0x7f6dac0b21d0 0x7f6dac1406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db17a7640 1 -- 172.21.15.81:0/2902797964 >> v1:172.21.15.81:6789/0 conn(0x7f6dac071aa0 legacy=0x7f6dac071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db0fa6640 1 -- 172.21.15.81:0/2902797964 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 70941312 0 0) 0x7f6dac073fd0 con 0x7f6dac071aa0 2024-09-15T20:46:53.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db17a7640 1 -- 172.21.15.81:0/2902797964 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac075040 con 0x7f6dac0b1da0 2024-09-15T20:46:53.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db27a9640 1 --2- 172.21.15.81:0/2902797964 >> v2:172.21.15.52:3300/0 conn(0x7f6dac0b21d0 0x7f6dac1406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db17a7640 1 --2- 172.21.15.81:0/2902797964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac0b1da0 0x7f6dac140190 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0738c0 tx=0x7f6d9c01ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e210d0047351e72d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db0fa6640 1 -- 172.21.15.81:0/2902797964 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0b5070 con 0x7f6dac0b1da0 2024-09-15T20:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db0fa6640 1 -- 172.21.15.81:0/2902797964 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9c0a88d0 con 0x7f6dac0b1da0 2024-09-15T20:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db0fa6640 1 -- 172.21.15.81:0/2902797964 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c0a8ca0 con 0x7f6dac0b1da0 2024-09-15T20:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db420c640 1 -- 172.21.15.81:0/2902797964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac0b1da0 msgr2=0x7f6dac140190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db420c640 1 --2- 172.21.15.81:0/2902797964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac0b1da0 0x7f6dac140190 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0738c0 tx=0x7f6d9c01ebc0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db420c640 1 -- 172.21.15.81:0/2902797964 shutdown_connections 2024-09-15T20:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db420c640 1 --2- 172.21.15.81:0/2902797964 >> v2:172.21.15.52:3300/0 conn(0x7f6dac0b21d0 0x7f6dac1406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db420c640 1 --2- 172.21.15.81:0/2902797964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac0b1da0 0x7f6dac140190 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db420c640 1 -- 172.21.15.81:0/2902797964 >> 172.21.15.81:0/2902797964 conn(0x7f6dac0b6430 msgr2=0x7f6dac0b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db420c640 1 -- 172.21.15.81:0/2902797964 shutdown_connections 2024-09-15T20:46:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.403+0000 7f6db420c640 1 -- 172.21.15.81:0/2902797964 wait complete. 2024-09-15T20:46:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db420c640 1 Processor -- start 2024-09-15T20:46:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db420c640 1 -- start start 2024-09-15T20:46:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db420c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac071aa0 0x7f6dac149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db420c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6dac0b1da0 0x7f6dac1de890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db420c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dac0b21d0 0x7f6dac1dedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db420c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac06cf90 con 0x7f6dac0b21d0 2024-09-15T20:46:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db420c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac06ce10 con 0x7f6dac071aa0 2024-09-15T20:46:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db420c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f6dac06d110 con 0x7f6dac0b1da0 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db1fa8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac071aa0 0x7f6dac149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db1fa8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac071aa0 0x7f6dac149110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42982/0 (socket says 172.21.15.81:42982) 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db1fa8640 1 -- 172.21.15.81:0/679847760 learned_addr learned my addr 172.21.15.81:0/679847760 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db27a9640 1 --2- 172.21.15.81:0/679847760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dac0b21d0 0x7f6dac1dedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db17a7640 1 --2- 172.21.15.81:0/679847760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6dac0b1da0 0x7f6dac1de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db1fa8640 1 -- 172.21.15.81:0/679847760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6dac0b1da0 msgr2=0x7f6dac1de890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db1fa8640 1 --2- 172.21.15.81:0/679847760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6dac0b1da0 0x7f6dac1de890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db1fa8640 1 -- 172.21.15.81:0/679847760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dac0b21d0 msgr2=0x7f6dac1dedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db1fa8640 1 --2- 172.21.15.81:0/679847760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dac0b21d0 0x7f6dac1dedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db1fa8640 1 -- 172.21.15.81:0/679847760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac1442d0 con 0x7f6dac071aa0 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db1fa8640 1 --2- 172.21.15.81:0/679847760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac071aa0 0x7f6dac149110 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6da800c430 tx=0x7f6da800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6da27fc640 1 -- 172.21.15.81:0/679847760 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da80074e0 con 0x7f6dac071aa0 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6da27fc640 1 -- 172.21.15.81:0/679847760 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da80047f0 con 0x7f6dac071aa0 2024-09-15T20:46:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db420c640 1 -- 172.21.15.81:0/679847760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dac1372e0 con 0x7f6dac071aa0 2024-09-15T20:46:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6da27fc640 1 -- 172.21.15.81:0/679847760 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8004be0 con 0x7f6dac071aa0 2024-09-15T20:46:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db420c640 1 -- 172.21.15.81:0/679847760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dac136b40 con 0x7f6dac071aa0 2024-09-15T20:46:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6da27fc640 1 -- 172.21.15.81:0/679847760 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6da8011070 con 0x7f6dac071aa0 2024-09-15T20:46:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6da27fc640 1 -- 172.21.15.81:0/679847760 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f6da8013770 con 0x7f6dac071aa0 2024-09-15T20:46:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.407+0000 7f6db420c640 1 -- 172.21.15.81:0/679847760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dac142d80 con 0x7f6dac071aa0 2024-09-15T20:46:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.411+0000 7f6da27fc640 1 -- 172.21.15.81:0/679847760 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6da80139c0 con 0x7f6dac071aa0 2024-09-15T20:46:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.479+0000 7f6db420c640 1 -- 172.21.15.81:0/679847760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1d555c27-c8c2-4d30-9a50-be7cf9a60db5", "id": 1} v 0) -- 0x7f6dac06d570 con 0x7f6dac071aa0 2024-09-15T20:46:53.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.487+0000 7f6da27fc640 1 -- 172.21.15.81:0/679847760 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d555c27-c8c2-4d30-9a50-be7cf9a60db5", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f6da8013ba0 con 0x7f6dac071aa0 2024-09-15T20:46:53.494 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-15T20:46:53.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.487+0000 7f6db420c640 1 -- 172.21.15.81:0/679847760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac071aa0 msgr2=0x7f6dac149110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.487+0000 7f6db420c640 1 --2- 172.21.15.81:0/679847760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac071aa0 0x7f6dac149110 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6da800c430 tx=0x7f6da800c8f0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.487+0000 7f6db420c640 1 -- 172.21.15.81:0/679847760 shutdown_connections 2024-09-15T20:46:53.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.487+0000 7f6db420c640 1 --2- 172.21.15.81:0/679847760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6dac0b21d0 0x7f6dac1dedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.487+0000 7f6db420c640 1 --2- 172.21.15.81:0/679847760 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6dac0b1da0 0x7f6dac1de890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.487+0000 7f6db420c640 1 --2- 172.21.15.81:0/679847760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac071aa0 0x7f6dac149110 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.487+0000 7f6db420c640 1 -- 172.21.15.81:0/679847760 >> 172.21.15.81:0/679847760 conn(0x7f6dac0b6430 msgr2=0x7f6dac0b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:53.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.487+0000 7f6db420c640 1 -- 172.21.15.81:0/679847760 shutdown_connections 2024-09-15T20:46:53.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.487+0000 7f6db420c640 1 -- 172.21.15.81:0/679847760 wait complete. 2024-09-15T20:46:53.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 8d5f33c4-cf45-4c87-b9ea-f0b474dfcada 2 2024-09-15T20:46:53.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4ea18e4640 1 Processor -- start 2024-09-15T20:46:53.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4ea18e4640 1 -- start start 2024-09-15T20:46:53.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4ea18e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e9c0b2d60 0x7f4e9c13b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4ea18e4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4e9c0b3140 0x7f4e9c144990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4ea18e4640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e9c074580 con 0x7f4e9c0b3a30 2024-09-15T20:46:53.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4ea18e4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4e9c13ef50 con 0x7f4e9c0b3140 2024-09-15T20:46:53.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4ea18e4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4e9c074060 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4e9affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e9c0b2d60 0x7f4e9c13b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4e9affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e9c0b2d60 0x7f4e9c13b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42984/0 (socket says 172.21.15.81:42984) 2024-09-15T20:46:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4e9affd640 1 -- 172.21.15.81:0/157158249 learned_addr learned my addr 172.21.15.81:0/157158249 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-15T20:46:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4e9a7fc640 1 --2- 172.21.15.81:0/157158249 >> v2:172.21.15.52:3300/0 conn(0x7f4e9c0b3140 0x7f4e9c144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4e9affd640 1 -- 172.21.15.81:0/157158249 >> v2:172.21.15.52:3300/0 conn(0x7f4e9c0b3140 msgr2=0x7f4e9c144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4e9affd640 1 --2- 172.21.15.81:0/157158249 >> v2:172.21.15.52:3300/0 conn(0x7f4e9c0b3140 0x7f4e9c144990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4e9affd640 1 -- 172.21.15.81:0/157158249 >> v1:172.21.15.52:6789/0 conn(0x7f4e9c0b3a30 legacy=0x7f4e9c144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.619+0000 7f4e9affd640 1 -- 172.21.15.81:0/157158249 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c0736d0 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4e9affd640 1 --2- 172.21.15.81:0/157158249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c0b2d60 0x7f4e9c13b0f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0b4c10 tx=0x7f4e9401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c89f1da36a4d2b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4e99ffb640 1 -- 172.21.15.81:0/157158249 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940a55c0 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4e99ffb640 1 -- 172.21.15.81:0/157158249 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e940a5760 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4e99ffb640 1 -- 172.21.15.81:0/157158249 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940a5b30 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4ea18e4640 1 -- 172.21.15.81:0/157158249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c0b2d60 msgr2=0x7f4e9c13b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4ea18e4640 1 --2- 172.21.15.81:0/157158249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c0b2d60 0x7f4e9c13b0f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0b4c10 tx=0x7f4e9401c940 comp rx=0 tx=0).stop 2024-09-15T20:46:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4ea18e4640 1 -- 172.21.15.81:0/157158249 shutdown_connections 2024-09-15T20:46:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4ea18e4640 1 --2- 172.21.15.81:0/157158249 >> v2:172.21.15.52:3300/0 conn(0x7f4e9c0b3140 0x7f4e9c144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4ea18e4640 1 --2- 172.21.15.81:0/157158249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c0b2d60 0x7f4e9c13b0f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4ea18e4640 1 -- 172.21.15.81:0/157158249 >> 172.21.15.81:0/157158249 conn(0x7f4e9c0b3e50 msgr2=0x7f4e9c0b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4ea18e4640 1 -- 172.21.15.81:0/157158249 shutdown_connections 2024-09-15T20:46:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4ea18e4640 1 -- 172.21.15.81:0/157158249 wait complete. 2024-09-15T20:46:53.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4ea18e4640 1 Processor -- start 2024-09-15T20:46:53.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.623+0000 7f4ea18e4640 1 -- start start 2024-09-15T20:46:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4ea18e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c0b2d60 0x7f4e9c0affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4ea18e4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e9c14b3b0 0x7f4e9c13a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4ea18e4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e9c13a9e0 0x7f4e9c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4ea18e4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c14e750 con 0x7f4e9c14b3b0 2024-09-15T20:46:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4ea18e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c14e8d0 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4ea18e4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f4e9c14ea50 con 0x7f4e9c13a9e0 2024-09-15T20:46:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c0b2d60 0x7f4e9c0affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e9affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c0b2d60 0x7f4e9c0affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42996/0 (socket says 172.21.15.81:42996) 2024-09-15T20:46:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e9affd640 1 -- 172.21.15.81:0/3421426026 learned_addr learned my addr 172.21.15.81:0/3421426026 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-15T20:46:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e9a7fc640 1 --2- 172.21.15.81:0/3421426026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e9c14b3b0 0x7f4e9c13a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e9b7fe640 1 --2- 172.21.15.81:0/3421426026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e9c13a9e0 0x7f4e9c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e9affd640 1 -- 172.21.15.81:0/3421426026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e9c13a9e0 msgr2=0x7f4e9c06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e9affd640 1 --2- 172.21.15.81:0/3421426026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e9c13a9e0 0x7f4e9c06ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e9affd640 1 -- 172.21.15.81:0/3421426026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e9c14b3b0 msgr2=0x7f4e9c13a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e9affd640 1 --2- 172.21.15.81:0/3421426026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e9c14b3b0 0x7f4e9c13a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e9affd640 1 -- 172.21.15.81:0/3421426026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c0ab840 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e9affd640 1 --2- 172.21.15.81:0/3421426026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c0b2d60 0x7f4e9c0affb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e9401d1e0 tx=0x7f4e940196e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e83fff640 1 -- 172.21.15.81:0/3421426026 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940bc020 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e83fff640 1 -- 172.21.15.81:0/3421426026 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e940b88a0 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4ea18e4640 1 -- 172.21.15.81:0/3421426026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9c0abb20 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e83fff640 1 -- 172.21.15.81:0/3421426026 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94009510 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4ea18e4640 1 -- 172.21.15.81:0/3421426026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e9c13ae60 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e83fff640 1 -- 172.21.15.81:0/3421426026 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4e940bf020 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4e83fff640 1 -- 172.21.15.81:0/3421426026 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f4e940b6860 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.627+0000 7f4ea18e4640 1 -- 172.21.15.81:0/3421426026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e9c13e3e0 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.631+0000 7f4e83fff640 1 -- 172.21.15.81:0/3421426026 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4e940c6030 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.699+0000 7f4ea18e4640 1 -- 172.21.15.81:0/3421426026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8d5f33c4-cf45-4c87-b9ea-f0b474dfcada", "id": 2} v 0) -- 0x7f4e9c13b0f0 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.707+0000 7f4e83fff640 1 -- 172.21.15.81:0/3421426026 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d5f33c4-cf45-4c87-b9ea-f0b474dfcada", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f4e940165c0 con 0x7f4e9c0b2d60 2024-09-15T20:46:53.714 INFO:teuthology.orchestra.run.smithi081.stdout:2 2024-09-15T20:46:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.707+0000 7f4ea18e4640 1 -- 172.21.15.81:0/3421426026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c0b2d60 msgr2=0x7f4e9c0affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.707+0000 7f4ea18e4640 1 --2- 172.21.15.81:0/3421426026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c0b2d60 0x7f4e9c0affb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4e9401d1e0 tx=0x7f4e940196e0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.707+0000 7f4ea18e4640 1 -- 172.21.15.81:0/3421426026 shutdown_connections 2024-09-15T20:46:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.707+0000 7f4ea18e4640 1 --2- 172.21.15.81:0/3421426026 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4e9c13a9e0 0x7f4e9c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.707+0000 7f4ea18e4640 1 --2- 172.21.15.81:0/3421426026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e9c14b3b0 0x7f4e9c13a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.707+0000 7f4ea18e4640 1 --2- 172.21.15.81:0/3421426026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c0b2d60 0x7f4e9c0affb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.707+0000 7f4ea18e4640 1 -- 172.21.15.81:0/3421426026 >> 172.21.15.81:0/3421426026 conn(0x7f4e9c0b3e50 msgr2=0x7f4e9c0b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.707+0000 7f4ea18e4640 1 -- 172.21.15.81:0/3421426026 shutdown_connections 2024-09-15T20:46:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.707+0000 7f4ea18e4640 1 -- 172.21.15.81:0/3421426026 wait complete. 2024-09-15T20:46:53.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new d9b51207-4514-4bfd-967c-32040c0b196f 3 2024-09-15T20:46:53.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.839+0000 7fa3ae06a640 1 Processor -- start 2024-09-15T20:46:53.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.839+0000 7fa3ae06a640 1 -- start start 2024-09-15T20:46:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa3ae06a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3a8068c30 0x7fa3a8140430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa3ae06a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3a80b1f10 0x7fa3a8140970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa3ae06a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a80738b0 con 0x7fa3a8071dc0 2024-09-15T20:46:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa3ae06a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a8069010 con 0x7fa3a80b1f10 2024-09-15T20:46:53.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa3ae06a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a8073fb0 con 0x7fa3a8068c30 2024-09-15T20:46:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa39ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3a80b1f10 0x7fa3a8140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa39ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3a80b1f10 0x7fa3a8140970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43004/0 (socket says 172.21.15.81:43004) 2024-09-15T20:46:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa39ffff640 1 -- 172.21.15.81:0/2595948960 learned_addr learned my addr 172.21.15.81:0/2595948960 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-15T20:46:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa39ffff640 1 -- 172.21.15.81:0/2595948960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3a8068c30 msgr2=0x7fa3a8140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa3a77fe640 1 --2- 172.21.15.81:0/2595948960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3a8068c30 0x7fa3a8140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa39ffff640 1 --2- 172.21.15.81:0/2595948960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3a8068c30 0x7fa3a8140430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa39ffff640 1 -- 172.21.15.81:0/2595948960 >> v1:172.21.15.52:6789/0 conn(0x7fa3a8071dc0 legacy=0x7fa3a8072210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:53.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa39ffff640 1 -- 172.21.15.81:0/2595948960 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a8073bc0 con 0x7fa3a80b1f10 2024-09-15T20:46:53.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa39ffff640 1 --2- 172.21.15.81:0/2595948960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a80b1f10 0x7fa3a8140970 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa390009870 tx=0x7fa39001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d1ae213cb770c4b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:53.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa3a6ffd640 1 -- 172.21.15.81:0/2595948960 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3900b0070 con 0x7fa3a80b1f10 2024-09-15T20:46:53.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa3a6ffd640 1 -- 172.21.15.81:0/2595948960 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3900ab600 con 0x7fa3a80b1f10 2024-09-15T20:46:53.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.843+0000 7fa3a6ffd640 1 -- 172.21.15.81:0/2595948960 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3900ab9d0 con 0x7fa3a80b1f10 2024-09-15T20:46:53.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 -- 172.21.15.81:0/2595948960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a80b1f10 msgr2=0x7fa3a8140970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 --2- 172.21.15.81:0/2595948960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a80b1f10 0x7fa3a8140970 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa390009870 tx=0x7fa39001c4b0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 -- 172.21.15.81:0/2595948960 shutdown_connections 2024-09-15T20:46:53.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 --2- 172.21.15.81:0/2595948960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a80b1f10 0x7fa3a8140970 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 --2- 172.21.15.81:0/2595948960 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3a8068c30 0x7fa3a8140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 -- 172.21.15.81:0/2595948960 >> 172.21.15.81:0/2595948960 conn(0x7fa3a806d580 msgr2=0x7fa3a80b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:53.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 -- 172.21.15.81:0/2595948960 shutdown_connections 2024-09-15T20:46:53.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 -- 172.21.15.81:0/2595948960 wait complete. 2024-09-15T20:46:53.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 Processor -- start 2024-09-15T20:46:53.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 -- start start 2024-09-15T20:46:53.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8068c30 0x7fa3a8146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3a8071dc0 0x7fa3a814a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3a80b1f10 0x7fa3a814a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:53.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a814da30 con 0x7fa3a80b1f10 2024-09-15T20:46:53.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a814d8b0 con 0x7fa3a8068c30 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a814dbb0 con 0x7fa3a8071dc0 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8068c30 0x7fa3a8146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8068c30 0x7fa3a8146180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43018/0 (socket says 172.21.15.81:43018) 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a77fe640 1 -- 172.21.15.81:0/119927219 learned_addr learned my addr 172.21.15.81:0/119927219 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a7fff640 1 --2- 172.21.15.81:0/119927219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3a80b1f10 0x7fa3a814a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa39ffff640 1 --2- 172.21.15.81:0/119927219 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3a8071dc0 0x7fa3a814a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a77fe640 1 -- 172.21.15.81:0/119927219 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3a8071dc0 msgr2=0x7fa3a814a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a77fe640 1 --2- 172.21.15.81:0/119927219 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3a8071dc0 0x7fa3a814a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a77fe640 1 -- 172.21.15.81:0/119927219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3a80b1f10 msgr2=0x7fa3a814a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a77fe640 1 --2- 172.21.15.81:0/119927219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3a80b1f10 0x7fa3a814a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a77fe640 1 -- 172.21.15.81:0/119927219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a814ab30 con 0x7fa3a8068c30 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a77fe640 1 --2- 172.21.15.81:0/119927219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8068c30 0x7fa3a8146180 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa39800c7f0 tx=0x7fa39800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:53.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a4ff9640 1 -- 172.21.15.81:0/119927219 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398015070 con 0x7fa3a8068c30 2024-09-15T20:46:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a4ff9640 1 -- 172.21.15.81:0/119927219 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa398004240 con 0x7fa3a8068c30 2024-09-15T20:46:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a4ff9640 1 -- 172.21.15.81:0/119927219 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa398003620 con 0x7fa3a8068c30 2024-09-15T20:46:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 -- 172.21.15.81:0/119927219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a8146760 con 0x7fa3a8068c30 2024-09-15T20:46:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 -- 172.21.15.81:0/119927219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a8145ab0 con 0x7fa3a8068c30 2024-09-15T20:46:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a4ff9640 1 -- 172.21.15.81:0/119927219 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa3980039d0 con 0x7fa3a8068c30 2024-09-15T20:46:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3a4ff9640 1 -- 172.21.15.81:0/119927219 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa3980198e0 con 0x7fa3a8068c30 2024-09-15T20:46:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.847+0000 7fa3ae06a640 1 -- 172.21.15.81:0/119927219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a8072210 con 0x7fa3a8068c30 2024-09-15T20:46:53.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.851+0000 7fa3a4ff9640 1 -- 172.21.15.81:0/119927219 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa398019bc0 con 0x7fa3a8068c30 2024-09-15T20:46:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.919+0000 7fa3ae06a640 1 -- 172.21.15.81:0/119927219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d9b51207-4514-4bfd-967c-32040c0b196f", "id": 3} v 0) -- 0x7fa3a81dbd30 con 0x7fa3a8068c30 2024-09-15T20:46:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.927+0000 7fa3a4ff9640 1 -- 172.21.15.81:0/119927219 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9b51207-4514-4bfd-967c-32040c0b196f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa398019450 con 0x7fa3a8068c30 2024-09-15T20:46:53.934 INFO:teuthology.orchestra.run.smithi081.stdout:3 2024-09-15T20:46:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.927+0000 7fa3ae06a640 1 -- 172.21.15.81:0/119927219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8068c30 msgr2=0x7fa3a8146180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.927+0000 7fa3ae06a640 1 --2- 172.21.15.81:0/119927219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8068c30 0x7fa3a8146180 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa39800c7f0 tx=0x7fa39800ccb0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.927+0000 7fa3ae06a640 1 -- 172.21.15.81:0/119927219 shutdown_connections 2024-09-15T20:46:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.927+0000 7fa3ae06a640 1 --2- 172.21.15.81:0/119927219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa3a80b1f10 0x7fa3a814a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.927+0000 7fa3ae06a640 1 --2- 172.21.15.81:0/119927219 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa3a8071dc0 0x7fa3a814a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.927+0000 7fa3ae06a640 1 --2- 172.21.15.81:0/119927219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3a8068c30 0x7fa3a8146180 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.927+0000 7fa3ae06a640 1 -- 172.21.15.81:0/119927219 >> 172.21.15.81:0/119927219 conn(0x7fa3a806d580 msgr2=0x7fa3a80711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.927+0000 7fa3ae06a640 1 -- 172.21.15.81:0/119927219 shutdown_connections 2024-09-15T20:46:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:53.927+0000 7fa3ae06a640 1 -- 172.21.15.81:0/119927219 wait complete. 2024-09-15T20:46:53.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new bb2fcd47-4202-4b5c-ad02-5dfbe865cbde 4 2024-09-15T20:46:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.055+0000 7f460d06b640 1 Processor -- start 2024-09-15T20:46:54.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.055+0000 7f460d06b640 1 -- start start 2024-09-15T20:46:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460d06b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 0x7f46080746c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460d06b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4608074c00 0x7f46080af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460d06b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46081412a0 con 0x7f4608140660 2024-09-15T20:46:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460d06b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f46080b11d0 con 0x7f4608074c00 2024-09-15T20:46:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460d06b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f4608140a40 con 0x7f4608140e70 2024-09-15T20:46:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460659c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 0x7f46080746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460659c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 0x7f46080746c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.81:55650/0 (socket says 172.21.15.81:55650) 2024-09-15T20:46:54.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460759e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4608074c00 0x7f46080af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460659c640 1 -- 172.21.15.81:0/3758055662 learned_addr learned my addr 172.21.15.81:0/3758055662 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-15T20:46:54.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460659c640 1 -- 172.21.15.81:0/3758055662 >> v2:172.21.15.52:3300/0 conn(0x7f4608074c00 msgr2=0x7f46080af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:54.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460659c640 1 --2- 172.21.15.81:0/3758055662 >> v2:172.21.15.52:3300/0 conn(0x7f4608074c00 0x7f46080af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460659c640 1 -- 172.21.15.81:0/3758055662 >> v1:172.21.15.52:6789/0 conn(0x7f4608140660 legacy=0x7f46080b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460659c640 1 -- 172.21.15.81:0/3758055662 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46080ad090 con 0x7f4608140e70 2024-09-15T20:46:54.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f460659c640 1 --2- 172.21.15.81:0/3758055662 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 0x7f46080746c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009870 tx=0x7f45fc01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a01e9cc8f3169ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:54.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f4605d9b640 1 -- 172.21.15.81:0/3758055662 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0b5070 con 0x7f4608140e70 2024-09-15T20:46:54.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f4605d9b640 1 -- 172.21.15.81:0/3758055662 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45fc0a8a30 con 0x7f4608140e70 2024-09-15T20:46:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.059+0000 7f4605d9b640 1 -- 172.21.15.81:0/3758055662 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0a8e00 con 0x7f4608140e70 2024-09-15T20:46:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 -- 172.21.15.81:0/3758055662 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 msgr2=0x7f46080746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 --2- 172.21.15.81:0/3758055662 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 0x7f46080746c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009870 tx=0x7f45fc01ed30 comp rx=0 tx=0).stop 2024-09-15T20:46:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 -- 172.21.15.81:0/3758055662 shutdown_connections 2024-09-15T20:46:54.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 --2- 172.21.15.81:0/3758055662 >> v2:172.21.15.52:3300/0 conn(0x7f4608074c00 0x7f46080af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 --2- 172.21.15.81:0/3758055662 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 0x7f46080746c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 -- 172.21.15.81:0/3758055662 >> 172.21.15.81:0/3758055662 conn(0x7f46080b6290 msgr2=0x7f46080b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 -- 172.21.15.81:0/3758055662 shutdown_connections 2024-09-15T20:46:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 -- 172.21.15.81:0/3758055662 wait complete. 2024-09-15T20:46:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 Processor -- start 2024-09-15T20:46:54.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 -- start start 2024-09-15T20:46:54.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608074c00 0x7f4608073470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4608140660 0x7f4608143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 0x7f4608144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4608075070 con 0x7f4608074c00 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46080ab5b0 con 0x7f4608140660 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f46080ac130 con 0x7f4608140e70 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4608140660 0x7f4608143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4608140660 0x7f4608143b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43034/0 (socket says 172.21.15.81:43034) 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460659c640 1 -- 172.21.15.81:0/3723531311 learned_addr learned my addr 172.21.15.81:0/3723531311 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460759e640 1 --2- 172.21.15.81:0/3723531311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 0x7f4608144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f4606d9d640 1 --2- 172.21.15.81:0/3723531311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608074c00 0x7f4608073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460659c640 1 -- 172.21.15.81:0/3723531311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 msgr2=0x7f4608144070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460659c640 1 --2- 172.21.15.81:0/3723531311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 0x7f4608144070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460659c640 1 -- 172.21.15.81:0/3723531311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608074c00 msgr2=0x7f4608073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460659c640 1 --2- 172.21.15.81:0/3723531311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608074c00 0x7f4608073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460659c640 1 -- 172.21.15.81:0/3723531311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46081ca120 con 0x7f4608140660 2024-09-15T20:46:54.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460759e640 1 --2- 172.21.15.81:0/3723531311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 0x7f4608144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T20:46:54.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460659c640 1 --2- 172.21.15.81:0/3723531311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4608140660 0x7f4608143b30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f45fc01d3e0 tx=0x7f45fc01bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:54.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f45ef7fe640 1 -- 172.21.15.81:0/3723531311 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0c0070 con 0x7f4608140660 2024-09-15T20:46:54.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f45ef7fe640 1 -- 172.21.15.81:0/3723531311 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45fc0b08c0 con 0x7f4608140660 2024-09-15T20:46:54.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 -- 172.21.15.81:0/3723531311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460813a350 con 0x7f4608140660 2024-09-15T20:46:54.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f45ef7fe640 1 -- 172.21.15.81:0/3723531311 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc0b5040 con 0x7f4608140660 2024-09-15T20:46:54.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f460d06b640 1 -- 172.21.15.81:0/3723531311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4608141700 con 0x7f4608140660 2024-09-15T20:46:54.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f45ef7fe640 1 -- 172.21.15.81:0/3723531311 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f45fc0c3070 con 0x7f4608140660 2024-09-15T20:46:54.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.063+0000 7f45ef7fe640 1 -- 172.21.15.81:0/3723531311 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f45fc0a9530 con 0x7f4608140660 2024-09-15T20:46:54.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.067+0000 7f460d06b640 1 -- 172.21.15.81:0/3723531311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46080ab1d0 con 0x7f4608140660 2024-09-15T20:46:54.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.067+0000 7f45ef7fe640 1 -- 172.21.15.81:0/3723531311 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f45fc0dd860 con 0x7f4608140660 2024-09-15T20:46:54.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.147+0000 7f460d06b640 1 -- 172.21.15.81:0/3723531311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bb2fcd47-4202-4b5c-ad02-5dfbe865cbde", "id": 4} v 0) -- 0x7f4608069fb0 con 0x7f4608140660 2024-09-15T20:46:54.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.155+0000 7f45ef7fe640 1 -- 172.21.15.81:0/3723531311 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb2fcd47-4202-4b5c-ad02-5dfbe865cbde", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f45fc0cb030 con 0x7f4608140660 2024-09-15T20:46:54.163 INFO:teuthology.orchestra.run.smithi081.stdout:4 2024-09-15T20:46:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.155+0000 7f460d06b640 1 -- 172.21.15.81:0/3723531311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4608140660 msgr2=0x7f4608143b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.155+0000 7f460d06b640 1 --2- 172.21.15.81:0/3723531311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4608140660 0x7f4608143b30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f45fc01d3e0 tx=0x7f45fc01bad0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.155+0000 7f460d06b640 1 -- 172.21.15.81:0/3723531311 shutdown_connections 2024-09-15T20:46:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.155+0000 7f460d06b640 1 --2- 172.21.15.81:0/3723531311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4608140e70 0x7f4608144070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.155+0000 7f460d06b640 1 --2- 172.21.15.81:0/3723531311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4608140660 0x7f4608143b30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.155+0000 7f460d06b640 1 --2- 172.21.15.81:0/3723531311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4608074c00 0x7f4608073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.155+0000 7f460d06b640 1 -- 172.21.15.81:0/3723531311 >> 172.21.15.81:0/3723531311 conn(0x7f46080b6290 msgr2=0x7f46080b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.155+0000 7f460d06b640 1 -- 172.21.15.81:0/3723531311 shutdown_connections 2024-09-15T20:46:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.155+0000 7f460d06b640 1 -- 172.21.15.81:0/3723531311 wait complete. 2024-09-15T20:46:54.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 59599740-63cf-4e26-abb0-fe542c98671a 5 2024-09-15T20:46:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.287+0000 7f1305ddd640 1 Processor -- start 2024-09-15T20:46:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.287+0000 7f1305ddd640 1 -- start start 2024-09-15T20:46:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f1305ddd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13000b2d60 0x7f130013b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f1305ddd640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1300074580 con 0x7f13000b3140 2024-09-15T20:46:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f1305ddd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130013ef50 con 0x7f13000b3a30 2024-09-15T20:46:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f1305ddd640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f1300074060 con 0x7f13000b2d60 2024-09-15T20:46:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f12fffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f13000b3a30 0x7f130014bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45510/0 (socket says 172.21.15.81:45510) 2024-09-15T20:46:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f12fffff640 1 -- 172.21.15.81:0/3990901082 learned_addr learned my addr 172.21.15.81:0/3990901082 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-15T20:46:54.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f12ff7fe640 1 --2- 172.21.15.81:0/3990901082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13000b2d60 0x7f130013b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f12fe7fc640 1 -- 172.21.15.81:0/3990901082 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606570778 0 0) 0x7f130013ef50 con 0x7f13000b3a30 2024-09-15T20:46:54.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f12fe7fc640 1 -- 172.21.15.81:0/3990901082 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12e8003530 con 0x7f13000b3a30 2024-09-15T20:46:54.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f12ff7fe640 1 -- 172.21.15.81:0/3990901082 >> v1:172.21.15.81:6789/0 conn(0x7f13000b3a30 legacy=0x7f130014bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f12ff7fe640 1 -- 172.21.15.81:0/3990901082 >> v1:172.21.15.52:6789/0 conn(0x7f13000b3140 legacy=0x7f1300144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f12ff7fe640 1 -- 172.21.15.81:0/3990901082 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13000736d0 con 0x7f13000b2d60 2024-09-15T20:46:54.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f12ff7fe640 1 --2- 172.21.15.81:0/3990901082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13000b2d60 0x7f130013b0f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f12f00097f0 tx=0x7f12f001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b48fbcedbf56d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:54.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f12fe7fc640 1 -- 172.21.15.81:0/3990901082 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f00b0070 con 0x7f13000b2d60 2024-09-15T20:46:54.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f12fe7fc640 1 -- 172.21.15.81:0/3990901082 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f00ab600 con 0x7f13000b2d60 2024-09-15T20:46:54.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f12fe7fc640 1 -- 172.21.15.81:0/3990901082 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f00ab9b0 con 0x7f13000b2d60 2024-09-15T20:46:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f1305ddd640 1 -- 172.21.15.81:0/3990901082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13000b2d60 msgr2=0x7f130013b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f1305ddd640 1 --2- 172.21.15.81:0/3990901082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13000b2d60 0x7f130013b0f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f12f00097f0 tx=0x7f12f001c430 comp rx=0 tx=0).stop 2024-09-15T20:46:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f1305ddd640 1 -- 172.21.15.81:0/3990901082 shutdown_connections 2024-09-15T20:46:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f1305ddd640 1 --2- 172.21.15.81:0/3990901082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f13000b2d60 0x7f130013b0f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.291+0000 7f1305ddd640 1 -- 172.21.15.81:0/3990901082 >> 172.21.15.81:0/3990901082 conn(0x7f13000b3e50 msgr2=0x7f13000b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 -- 172.21.15.81:0/3990901082 shutdown_connections 2024-09-15T20:46:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 -- 172.21.15.81:0/3990901082 wait complete. 2024-09-15T20:46:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 Processor -- start 2024-09-15T20:46:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 -- start start 2024-09-15T20:46:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13000b2d60 0x7f130013dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300145ae0 0x7f130006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f130013e8f0 0x7f13001df820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f130014fe70 con 0x7f13000b2d60 2024-09-15T20:46:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f130014fff0 con 0x7f1300145ae0 2024-09-15T20:46:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f1300150170 con 0x7f130013e8f0 2024-09-15T20:46:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12feffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300145ae0 0x7f130006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12feffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300145ae0 0x7f130006eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43042/0 (socket says 172.21.15.81:43042) 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12feffd640 1 -- 172.21.15.81:0/1243472258 learned_addr learned my addr 172.21.15.81:0/1243472258 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12ff7fe640 1 --2- 172.21.15.81:0/1243472258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13000b2d60 0x7f130013dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12fffff640 1 --2- 172.21.15.81:0/1243472258 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f130013e8f0 0x7f13001df820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12feffd640 1 -- 172.21.15.81:0/1243472258 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f130013e8f0 msgr2=0x7f13001df820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12feffd640 1 --2- 172.21.15.81:0/1243472258 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f130013e8f0 0x7f13001df820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12feffd640 1 -- 172.21.15.81:0/1243472258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13000b2d60 msgr2=0x7f130013dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12feffd640 1 --2- 172.21.15.81:0/1243472258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13000b2d60 0x7f130013dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12feffd640 1 -- 172.21.15.81:0/1243472258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1300146da0 con 0x7f1300145ae0 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12fffff640 1 --2- 172.21.15.81:0/1243472258 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f130013e8f0 0x7f13001df820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12feffd640 1 --2- 172.21.15.81:0/1243472258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300145ae0 0x7f130006eee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f12f400c3c0 tx=0x7f12f400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12e7fff640 1 -- 172.21.15.81:0/1243472258 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4017070 con 0x7f1300145ae0 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12e7fff640 1 -- 172.21.15.81:0/1243472258 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12f40052d0 con 0x7f1300145ae0 2024-09-15T20:46:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 -- 172.21.15.81:0/1243472258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13001dfd60 con 0x7f1300145ae0 2024-09-15T20:46:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12e7fff640 1 -- 172.21.15.81:0/1243472258 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f4003800 con 0x7f1300145ae0 2024-09-15T20:46:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 -- 172.21.15.81:0/1243472258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f130013bba0 con 0x7f1300145ae0 2024-09-15T20:46:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12e7fff640 1 -- 172.21.15.81:0/1243472258 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f12f401a070 con 0x7f1300145ae0 2024-09-15T20:46:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f12e7fff640 1 -- 172.21.15.81:0/1243472258 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f12f401c440 con 0x7f1300145ae0 2024-09-15T20:46:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.295+0000 7f1305ddd640 1 -- 172.21.15.81:0/1243472258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13000b5ad0 con 0x7f1300145ae0 2024-09-15T20:46:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.299+0000 7f12e7fff640 1 -- 172.21.15.81:0/1243472258 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f12f40115f0 con 0x7f1300145ae0 2024-09-15T20:46:54.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.363+0000 7f1305ddd640 1 -- 172.21.15.81:0/1243472258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "59599740-63cf-4e26-abb0-fe542c98671a", "id": 5} v 0) -- 0x7f13000b57f0 con 0x7f1300145ae0 2024-09-15T20:46:54.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.371+0000 7f12e7fff640 1 -- 172.21.15.81:0/1243472258 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "59599740-63cf-4e26-abb0-fe542c98671a", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f12f4011ae0 con 0x7f1300145ae0 2024-09-15T20:46:54.379 INFO:teuthology.orchestra.run.smithi081.stdout:5 2024-09-15T20:46:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.371+0000 7f1305ddd640 1 -- 172.21.15.81:0/1243472258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300145ae0 msgr2=0x7f130006eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.371+0000 7f1305ddd640 1 --2- 172.21.15.81:0/1243472258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300145ae0 0x7f130006eee0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f12f400c3c0 tx=0x7f12f400c880 comp rx=0 tx=0).stop 2024-09-15T20:46:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.371+0000 7f1305ddd640 1 -- 172.21.15.81:0/1243472258 shutdown_connections 2024-09-15T20:46:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.371+0000 7f1305ddd640 1 --2- 172.21.15.81:0/1243472258 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f130013e8f0 0x7f13001df820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.371+0000 7f1305ddd640 1 --2- 172.21.15.81:0/1243472258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1300145ae0 0x7f130006eee0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.371+0000 7f1305ddd640 1 --2- 172.21.15.81:0/1243472258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f13000b2d60 0x7f130013dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.371+0000 7f1305ddd640 1 -- 172.21.15.81:0/1243472258 >> 172.21.15.81:0/1243472258 conn(0x7f13000b3e50 msgr2=0x7f13000b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.371+0000 7f1305ddd640 1 -- 172.21.15.81:0/1243472258 shutdown_connections 2024-09-15T20:46:54.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.371+0000 7f1305ddd640 1 -- 172.21.15.81:0/1243472258 wait complete. 2024-09-15T20:46:54.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new daebb41e-6be2-4689-b9c4-ba5271f2ce69 6 2024-09-15T20:46:54.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe634528640 1 Processor -- start 2024-09-15T20:46:54.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe634528640 1 -- start start 2024-09-15T20:46:54.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe634528640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe62c0b2d60 0x7fe62c13b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe634528640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe62c0b3a30 0x7fe62c1450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe634528640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe62c074580 con 0x7fe62c0b3140 2024-09-15T20:46:54.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe634528640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe62c13ef50 con 0x7fe62c0b3a30 2024-09-15T20:46:54.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe634528640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe62c074060 con 0x7fe62c0b2d60 2024-09-15T20:46:54.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe6322c4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe62c0b2d60 0x7fe62c13b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe6322c4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe62c0b2d60 0x7fe62c13b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43048/0 (socket says 172.21.15.81:43048) 2024-09-15T20:46:54.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe6322c4640 1 -- 172.21.15.81:0/506533393 learned_addr learned my addr 172.21.15.81:0/506533393 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-15T20:46:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe632ac5640 1 --2- 172.21.15.81:0/506533393 >> v2:172.21.15.52:3300/0 conn(0x7fe62c0b3a30 0x7fe62c1450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe6322c4640 1 -- 172.21.15.81:0/506533393 >> v2:172.21.15.52:3300/0 conn(0x7fe62c0b3a30 msgr2=0x7fe62c1450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe6322c4640 1 --2- 172.21.15.81:0/506533393 >> v2:172.21.15.52:3300/0 conn(0x7fe62c0b3a30 0x7fe62c1450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe6322c4640 1 -- 172.21.15.81:0/506533393 >> v1:172.21.15.81:6789/0 conn(0x7fe62c0b3140 legacy=0x7fe62c144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe6322c4640 1 -- 172.21.15.81:0/506533393 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c0736d0 con 0x7fe62c0b2d60 2024-09-15T20:46:54.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.503+0000 7fe6312c2640 1 -- 172.21.15.81:0/506533393 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1651208058 0 0) 0x7fe62c074580 con 0x7fe62c0b3140 2024-09-15T20:46:54.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe6322c4640 1 --2- 172.21.15.81:0/506533393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe62c0b2d60 0x7fe62c13b0f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0b4c10 tx=0x7fe62801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=564d5b520818bad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:54.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe6312c2640 1 -- 172.21.15.81:0/506533393 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6280b0070 con 0x7fe62c0b2d60 2024-09-15T20:46:54.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe6312c2640 1 -- 172.21.15.81:0/506533393 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6280ab600 con 0x7fe62c0b2d60 2024-09-15T20:46:54.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe6312c2640 1 -- 172.21.15.81:0/506533393 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6280ab9d0 con 0x7fe62c0b2d60 2024-09-15T20:46:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 -- 172.21.15.81:0/506533393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe62c0b2d60 msgr2=0x7fe62c13b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 --2- 172.21.15.81:0/506533393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe62c0b2d60 0x7fe62c13b0f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0b4c10 tx=0x7fe62801c470 comp rx=0 tx=0).stop 2024-09-15T20:46:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 -- 172.21.15.81:0/506533393 shutdown_connections 2024-09-15T20:46:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 --2- 172.21.15.81:0/506533393 >> v2:172.21.15.52:3300/0 conn(0x7fe62c0b3a30 0x7fe62c1450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 --2- 172.21.15.81:0/506533393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe62c0b2d60 0x7fe62c13b0f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 -- 172.21.15.81:0/506533393 >> 172.21.15.81:0/506533393 conn(0x7fe62c0b3e50 msgr2=0x7fe62c0b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 -- 172.21.15.81:0/506533393 shutdown_connections 2024-09-15T20:46:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 -- 172.21.15.81:0/506533393 wait complete. 2024-09-15T20:46:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 Processor -- start 2024-09-15T20:46:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 -- start start 2024-09-15T20:46:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe62c141700 0x7fe62c13dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe62c13d230 0x7fe62c13e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe62c1df040 0x7fe62c1df4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c14e750 con 0x7fe62c1df040 2024-09-15T20:46:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c14e8d0 con 0x7fe62c13d230 2024-09-15T20:46:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fe62c14ea50 con 0x7fe62c141700 2024-09-15T20:46:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe631ac3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe62c13d230 0x7fe62c13e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe631ac3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe62c13d230 0x7fe62c13e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43060/0 (socket says 172.21.15.81:43060) 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe631ac3640 1 -- 172.21.15.81:0/2963716726 learned_addr learned my addr 172.21.15.81:0/2963716726 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe632ac5640 1 --2- 172.21.15.81:0/2963716726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe62c1df040 0x7fe62c1df4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe6322c4640 1 --2- 172.21.15.81:0/2963716726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe62c141700 0x7fe62c13dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe631ac3640 1 -- 172.21.15.81:0/2963716726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe62c141700 msgr2=0x7fe62c13dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe631ac3640 1 --2- 172.21.15.81:0/2963716726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe62c141700 0x7fe62c13dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe631ac3640 1 -- 172.21.15.81:0/2963716726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe62c1df040 msgr2=0x7fe62c1df4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe631ac3640 1 --2- 172.21.15.81:0/2963716726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe62c1df040 0x7fe62c1df4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe631ac3640 1 -- 172.21.15.81:0/2963716726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c13e7e0 con 0x7fe62c13d230 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe631ac3640 1 --2- 172.21.15.81:0/2963716726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe62c13d230 0x7fe62c13e2a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c500 tx=0x7fe62000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe61effd640 1 -- 172.21.15.81:0/2963716726 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620017070 con 0x7fe62c13d230 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe61effd640 1 -- 172.21.15.81:0/2963716726 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe620003600 con 0x7fe62c13d230 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 -- 172.21.15.81:0/2963716726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62c0ab240 con 0x7fe62c13d230 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe61effd640 1 -- 172.21.15.81:0/2963716726 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620003a30 con 0x7fe62c13d230 2024-09-15T20:46:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe634528640 1 -- 172.21.15.81:0/2963716726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62c0ab800 con 0x7fe62c13d230 2024-09-15T20:46:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe61effd640 1 -- 172.21.15.81:0/2963716726 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe62001a070 con 0x7fe62c13d230 2024-09-15T20:46:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.507+0000 7fe61effd640 1 -- 172.21.15.81:0/2963716726 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fe6200129f0 con 0x7fe62c13d230 2024-09-15T20:46:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.511+0000 7fe634528640 1 -- 172.21.15.81:0/2963716726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62c13b0f0 con 0x7fe62c13d230 2024-09-15T20:46:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.511+0000 7fe61effd640 1 -- 172.21.15.81:0/2963716726 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe620021020 con 0x7fe62c13d230 2024-09-15T20:46:54.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.579+0000 7fe634528640 1 -- 172.21.15.81:0/2963716726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "daebb41e-6be2-4689-b9c4-ba5271f2ce69", "id": 6} v 0) -- 0x7fe62c0b5c00 con 0x7fe62c13d230 2024-09-15T20:46:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.583+0000 7fe61effd640 1 -- 172.21.15.81:0/2963716726 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "daebb41e-6be2-4689-b9c4-ba5271f2ce69", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fe620003d60 con 0x7fe62c13d230 2024-09-15T20:46:54.590 INFO:teuthology.orchestra.run.smithi081.stdout:6 2024-09-15T20:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.583+0000 7fe634528640 1 -- 172.21.15.81:0/2963716726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe62c13d230 msgr2=0x7fe62c13e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.583+0000 7fe634528640 1 --2- 172.21.15.81:0/2963716726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe62c13d230 0x7fe62c13e2a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c500 tx=0x7fe62000c9c0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.583+0000 7fe634528640 1 -- 172.21.15.81:0/2963716726 shutdown_connections 2024-09-15T20:46:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.583+0000 7fe634528640 1 --2- 172.21.15.81:0/2963716726 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe62c1df040 0x7fe62c1df4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.583+0000 7fe634528640 1 --2- 172.21.15.81:0/2963716726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe62c13d230 0x7fe62c13e2a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.583+0000 7fe634528640 1 --2- 172.21.15.81:0/2963716726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe62c141700 0x7fe62c13dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.583+0000 7fe634528640 1 -- 172.21.15.81:0/2963716726 >> 172.21.15.81:0/2963716726 conn(0x7fe62c0b3e50 msgr2=0x7fe62c0b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.583+0000 7fe634528640 1 -- 172.21.15.81:0/2963716726 shutdown_connections 2024-09-15T20:46:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.583+0000 7fe634528640 1 -- 172.21.15.81:0/2963716726 wait complete. 2024-09-15T20:46:54.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new ed8914a3-1f7c-4942-bd5e-0453369f009b 7 2024-09-15T20:46:54.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8da5fe640 1 Processor -- start 2024-09-15T20:46:54.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8da5fe640 1 -- start start 2024-09-15T20:46:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8da5fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8d4068c30 0x7ff8d4071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8da5fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8d40b1f10 0x7ff8d4072390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8da5fe640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8d4073920 con 0x7ff8d4140430 2024-09-15T20:46:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8da5fe640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff8d4069010 con 0x7ff8d4068c30 2024-09-15T20:46:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8da5fe640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d4073fb0 con 0x7ff8d40b1f10 2024-09-15T20:46:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8d8b9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff8d4140430 0x7ff8d41439b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45522/0 (socket says 172.21.15.81:45522) 2024-09-15T20:46:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8d8b9b640 1 -- 172.21.15.81:0/3373422040 learned_addr learned my addr 172.21.15.81:0/3373422040 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8d37fe640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8d40b1f10 0x7ff8d4072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8d3fff640 1 --2- 172.21.15.81:0/3373422040 >> v2:172.21.15.52:3300/0 conn(0x7ff8d4068c30 0x7ff8d4071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3819171653 0 0) 0x7ff8d4073920 con 0x7ff8d4140430 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8bc003530 con 0x7ff8d4140430 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 <== mon.1 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2593920412 0 0) 0x7ff8bc003530 con 0x7ff8d4140430 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8d40b1f10 msgr2=0x7ff8d4072390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.711+0000 7ff8d2ffd640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8d40b1f10 0x7ff8d4072390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 >> v2:172.21.15.52:3300/0 conn(0x7ff8d4068c30 msgr2=0x7ff8d4071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 --2- 172.21.15.81:0/3373422040 >> v2:172.21.15.52:3300/0 conn(0x7ff8d4068c30 0x7ff8d4071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d40741e0 con 0x7ff8d4140430 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 <== mon.1 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 282972984 0 0) 0x7ff8cc001a80 con 0x7ff8d4140430 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d3fff640 1 --2- 172.21.15.81:0/3373422040 >> v2:172.21.15.52:3300/0 conn(0x7ff8d4068c30 0x7ff8d4071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T20:46:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 >> v1:172.21.15.81:6789/0 conn(0x7ff8d4140430 legacy=0x7ff8d41439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8bc003a10 0x7ff8bc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8d40b1f10 0x7ff8bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc004d50 0x7ff8bc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc00ba80 con 0x7ff8bc004d50 2024-09-15T20:46:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8bc00bc00 con 0x7ff8bc003a10 2024-09-15T20:46:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ff8bc00bdb0 con 0x7ff8d40b1f10 2024-09-15T20:46:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d3fff640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8bc003a10 0x7ff8bc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d37fe640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8d40b1f10 0x7ff8bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d8b9b640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc004d50 0x7ff8bc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d3fff640 1 -- 172.21.15.81:0/3373422040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8d40b1f10 msgr2=0x7ff8bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d3fff640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8d40b1f10 0x7ff8bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d3fff640 1 -- 172.21.15.81:0/3373422040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc004d50 msgr2=0x7ff8bc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d3fff640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc004d50 0x7ff8bc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d3fff640 1 -- 172.21.15.81:0/3373422040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc003530 con 0x7ff8bc003a10 2024-09-15T20:46:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d8b9b640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8bc004d50 0x7ff8bc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:46:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d3fff640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8bc003a10 0x7ff8bc003e30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40098d0 tx=0x7ff8c401c630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76d29a8b1df78f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40ac070 con 0x7ff8bc003a10 2024-09-15T20:46:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c40a6640 con 0x7ff8bc003a10 2024-09-15T20:46:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d2ffd640 1 -- 172.21.15.81:0/3373422040 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400f040 con 0x7ff8bc003a10 2024-09-15T20:46:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8da5fe640 1 -- 172.21.15.81:0/3373422040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8bc003a10 msgr2=0x7ff8bc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8da5fe640 1 --2- 172.21.15.81:0/3373422040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8bc003a10 0x7ff8bc003e30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40098d0 tx=0x7ff8c401c630 comp rx=0 tx=0).stop 2024-09-15T20:46:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8d8b9b640 1 -- 172.21.15.81:0/3373422040 reap_dead start 2024-09-15T20:46:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8da5fe640 1 -- 172.21.15.81:0/3373422040 shutdown_connections 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8da5fe640 1 -- 172.21.15.81:0/3373422040 >> 172.21.15.81:0/3373422040 conn(0x7ff8d406d580 msgr2=0x7ff8d40b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8da5fe640 1 -- 172.21.15.81:0/3373422040 shutdown_connections 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.715+0000 7ff8da5fe640 1 -- 172.21.15.81:0/3373422040 wait complete. 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8da5fe640 1 Processor -- start 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8da5fe640 1 -- start start 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8da5fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8bc003a10 0x7ff8d40ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8da5fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d40af480 0x7ff8d40acc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8da5fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d40aa4e0 0x7ff8d4139640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8da5fe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d4074880 con 0x7ff8d40aa4e0 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8da5fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d4074700 con 0x7ff8d40af480 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8da5fe640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ff8d4072390 con 0x7ff8bc003a10 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d40af480 0x7ff8d40acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d40af480 0x7ff8d40acc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43090/0 (socket says 172.21.15.81:43090) 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d37fe640 1 -- 172.21.15.81:0/883914974 learned_addr learned my addr 172.21.15.81:0/883914974 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d3fff640 1 --2- 172.21.15.81:0/883914974 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8bc003a10 0x7ff8d40ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d8b9b640 1 --2- 172.21.15.81:0/883914974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d40aa4e0 0x7ff8d4139640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d37fe640 1 -- 172.21.15.81:0/883914974 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8bc003a10 msgr2=0x7ff8d40ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d37fe640 1 --2- 172.21.15.81:0/883914974 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8bc003a10 0x7ff8d40ad560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d37fe640 1 -- 172.21.15.81:0/883914974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d40aa4e0 msgr2=0x7ff8d4139640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d37fe640 1 --2- 172.21.15.81:0/883914974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d40aa4e0 0x7ff8d4139640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d37fe640 1 -- 172.21.15.81:0/883914974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8d40ae9c0 con 0x7ff8d40af480 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d8b9b640 1 --2- 172.21.15.81:0/883914974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d40aa4e0 0x7ff8d4139640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d37fe640 1 --2- 172.21.15.81:0/883914974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d40af480 0x7ff8d40acc30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80115c0 tx=0x7ff8c8011a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d0ff9640 1 -- 172.21.15.81:0/883914974 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8004220 con 0x7ff8d40af480 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d0ff9640 1 -- 172.21.15.81:0/883914974 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c80043c0 con 0x7ff8d40af480 2024-09-15T20:46:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8da5fe640 1 -- 172.21.15.81:0/883914974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8d40aeca0 con 0x7ff8d40af480 2024-09-15T20:46:54.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d0ff9640 1 -- 172.21.15.81:0/883914974 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c800f8f0 con 0x7ff8d40af480 2024-09-15T20:46:54.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8da5fe640 1 -- 172.21.15.81:0/883914974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d40aa930 con 0x7ff8d40af480 2024-09-15T20:46:54.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d0ff9640 1 -- 172.21.15.81:0/883914974 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff8c8003620 con 0x7ff8d40af480 2024-09-15T20:46:54.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8d0ff9640 1 -- 172.21.15.81:0/883914974 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff8c801d400 con 0x7ff8d40af480 2024-09-15T20:46:54.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.719+0000 7ff8da5fe640 1 -- 172.21.15.81:0/883914974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8d4071e50 con 0x7ff8d40af480 2024-09-15T20:46:54.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.723+0000 7ff8d0ff9640 1 -- 172.21.15.81:0/883914974 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff8c8019030 con 0x7ff8d40af480 2024-09-15T20:46:54.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.795+0000 7ff8da5fe640 1 -- 172.21.15.81:0/883914974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ed8914a3-1f7c-4942-bd5e-0453369f009b", "id": 7} v 0) -- 0x7ff8d413a290 con 0x7ff8d40af480 2024-09-15T20:46:54.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.799+0000 7ff8d0ff9640 1 -- 172.21.15.81:0/883914974 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ed8914a3-1f7c-4942-bd5e-0453369f009b", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff8c800fe20 con 0x7ff8d40af480 2024-09-15T20:46:54.806 INFO:teuthology.orchestra.run.smithi081.stdout:7 2024-09-15T20:46:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.799+0000 7ff8da5fe640 1 -- 172.21.15.81:0/883914974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d40af480 msgr2=0x7ff8d40acc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.799+0000 7ff8da5fe640 1 --2- 172.21.15.81:0/883914974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d40af480 0x7ff8d40acc30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80115c0 tx=0x7ff8c8011a80 comp rx=0 tx=0).stop 2024-09-15T20:46:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.799+0000 7ff8da5fe640 1 -- 172.21.15.81:0/883914974 shutdown_connections 2024-09-15T20:46:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.799+0000 7ff8da5fe640 1 --2- 172.21.15.81:0/883914974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8d40aa4e0 0x7ff8d4139640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.799+0000 7ff8da5fe640 1 --2- 172.21.15.81:0/883914974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8d40af480 0x7ff8d40acc30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.799+0000 7ff8da5fe640 1 --2- 172.21.15.81:0/883914974 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff8bc003a10 0x7ff8d40ad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.799+0000 7ff8da5fe640 1 -- 172.21.15.81:0/883914974 >> 172.21.15.81:0/883914974 conn(0x7ff8d406d580 msgr2=0x7ff8d413e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.799+0000 7ff8da5fe640 1 -- 172.21.15.81:0/883914974 shutdown_connections 2024-09-15T20:46:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-15T20:46:54.799+0000 7ff8da5fe640 1 -- 172.21.15.81:0/883914974 wait complete. 2024-09-15T20:46:54.823 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T20:46:54.823 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-15T20:46:54.825 INFO:tasks.ceph.osd.0:Started 2024-09-15T20:46:54.825 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T20:46:54.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-15T20:46:54.828 INFO:tasks.ceph.osd.1:Started 2024-09-15T20:46:54.828 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T20:46:54.828 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-15T20:46:54.830 INFO:tasks.ceph.osd.2:Started 2024-09-15T20:46:54.830 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-15T20:46:54.830 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-15T20:46:54.832 INFO:tasks.ceph.osd.3:Started 2024-09-15T20:46:54.832 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-15T20:46:54.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-15T20:46:54.834 INFO:tasks.ceph.osd.4:Started 2024-09-15T20:46:54.835 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-15T20:46:54.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-15T20:46:54.836 INFO:tasks.ceph.osd.5:Started 2024-09-15T20:46:54.837 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-15T20:46:54.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-15T20:46:54.839 INFO:tasks.ceph.osd.6:Started 2024-09-15T20:46:54.839 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-15T20:46:54.839 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-15T20:46:54.841 INFO:tasks.ceph.osd.7:Started 2024-09-15T20:46:54.841 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T20:46:54.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.973+0000 7fa5dd9b8640 1 Processor -- start 2024-09-15T20:46:54.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.973+0000 7fa5dd9b8640 1 -- start start 2024-09-15T20:46:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5dd9b8640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa5d81471c0 0x7fa5d8140690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5dd9b8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa5d8140bd0 0x7fa5d814de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5dd9b8640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5d80ac200 con 0x7fa5d80b9ad0 2024-09-15T20:46:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5dd9b8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa5d80b9eb0 con 0x7fa5d8140bd0 2024-09-15T20:46:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5dd9b8640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fa5d80ac4e0 con 0x7fa5d81471c0 2024-09-15T20:46:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa5d8140bd0 0x7fa5d814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d67fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa5d81471c0 0x7fa5d8140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d77fe640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa5d8140bd0 0x7fa5d814de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45246/0 (socket says 172.21.15.52:45246) 2024-09-15T20:46:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d77fe640 1 -- 172.21.15.52:0/1561896286 learned_addr learned my addr 172.21.15.52:0/1561896286 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:46:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d77fe640 1 -- 172.21.15.52:0/1561896286 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa5d81471c0 msgr2=0x7fa5d8140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d77fe640 1 --2- 172.21.15.52:0/1561896286 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa5d81471c0 0x7fa5d8140690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d77fe640 1 -- 172.21.15.52:0/1561896286 >> v1:172.21.15.52:6789/0 conn(0x7fa5d80b9ad0 legacy=0x7fa5d8146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d5ffb640 1 -- 172.21.15.52:0/1561896286 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4055332045 0 0) 0x7fa5d80ac200 con 0x7fa5d80b9ad0 2024-09-15T20:46:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d77fe640 1 -- 172.21.15.52:0/1561896286 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d80ac7c0 con 0x7fa5d8140bd0 2024-09-15T20:46:54.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d77fe640 1 --2- 172.21.15.52:0/1561896286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5d8140bd0 0x7fa5d814de40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009e50 tx=0x7fa5d001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b49275cd24b5c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:54.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d5ffb640 1 -- 172.21.15.52:0/1561896286 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00a5840 con 0x7fa5d8140bd0 2024-09-15T20:46:54.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d5ffb640 1 -- 172.21.15.52:0/1561896286 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d00a59e0 con 0x7fa5d8140bd0 2024-09-15T20:46:54.982 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.977+0000 7fa5d5ffb640 1 -- 172.21.15.52:0/1561896286 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00a5db0 con 0x7fa5d8140bd0 2024-09-15T20:46:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/1561896286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5d8140bd0 msgr2=0x7fa5d814de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 --2- 172.21.15.52:0/1561896286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5d8140bd0 0x7fa5d814de40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa5d0009e50 tx=0x7fa5d001c9e0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/1561896286 shutdown_connections 2024-09-15T20:46:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 --2- 172.21.15.52:0/1561896286 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5d8140bd0 0x7fa5d814de40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 --2- 172.21.15.52:0/1561896286 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa5d81471c0 0x7fa5d8140690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/1561896286 >> 172.21.15.52:0/1561896286 conn(0x7fa5d8068fd0 msgr2=0x7fa5d80b9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/1561896286 shutdown_connections 2024-09-15T20:46:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/1561896286 wait complete. 2024-09-15T20:46:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 Processor -- start 2024-09-15T20:46:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 -- start start 2024-09-15T20:46:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d80b9ad0 0x7fa5d8137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa5d8140bd0 0x7fa5d81de970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5d81471c0 0x7fa5d81db3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d80b37a0 con 0x7fa5d81471c0 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d80b3620 con 0x7fa5d80b9ad0 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fa5d8150ba0 con 0x7fa5d8140bd0 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5d81471c0 0x7fa5d81db3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5d67fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa5d8140bd0 0x7fa5d81de970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5d81471c0 0x7fa5d81db3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45248/0 (socket says 172.21.15.52:45248) 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5d77fe640 1 -- 172.21.15.52:0/3950900165 learned_addr learned my addr 172.21.15.52:0/3950900165 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5d6ffd640 1 --2- 172.21.15.52:0/3950900165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d80b9ad0 0x7fa5d8137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5d77fe640 1 -- 172.21.15.52:0/3950900165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa5d8140bd0 msgr2=0x7fa5d81de970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5d77fe640 1 --2- 172.21.15.52:0/3950900165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa5d8140bd0 0x7fa5d81de970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5d77fe640 1 -- 172.21.15.52:0/3950900165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d80b9ad0 msgr2=0x7fa5d8137ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5d77fe640 1 --2- 172.21.15.52:0/3950900165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d80b9ad0 0x7fa5d8137ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5d77fe640 1 -- 172.21.15.52:0/3950900165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d813d8e0 con 0x7fa5d81471c0 2024-09-15T20:46:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5d77fe640 1 --2- 172.21.15.52:0/3950900165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5d81471c0 0x7fa5d81db3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa5d00af040 tx=0x7fa5d0019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5cffff640 1 -- 172.21.15.52:0/3950900165 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00b8670 con 0x7fa5d81471c0 2024-09-15T20:46:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5cffff640 1 -- 172.21.15.52:0/3950900165 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d00be070 con 0x7fa5d81471c0 2024-09-15T20:46:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/3950900165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5d813dbc0 con 0x7fa5d81471c0 2024-09-15T20:46:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5cffff640 1 -- 172.21.15.52:0/3950900165 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d00b8ab0 con 0x7fa5d81471c0 2024-09-15T20:46:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/3950900165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5d81df730 con 0x7fa5d81471c0 2024-09-15T20:46:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5cffff640 1 -- 172.21.15.52:0/3950900165 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa5d00039a0 con 0x7fa5d81471c0 2024-09-15T20:46:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.981+0000 7fa5cffff640 1 -- 172.21.15.52:0/3950900165 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa5d0004570 con 0x7fa5d81471c0 2024-09-15T20:46:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.985+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/3950900165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5d8140690 con 0x7fa5d81471c0 2024-09-15T20:46:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:54.985+0000 7fa5cffff640 1 -- 172.21.15.52:0/3950900165 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa5d0016600 con 0x7fa5d81471c0 2024-09-15T20:46:55.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:55.045+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/3950900165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5d80b7e30 con 0x7fa5d81471c0 2024-09-15T20:46:55.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:55.045+0000 7fa5cffff640 1 -- 172.21.15.52:0/3950900165 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa5d00047c0 con 0x7fa5d81471c0 2024-09-15T20:46:55.049 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:46:55.049 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":10,"fsid":"5b0b6dfd-6a20-4023-acf9-e3c53f9607bc","created":"2024-09-15T20:46:52.315149+0000","modified":"2024-09-15T20:46:54.803112+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T20:46:54.803112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b99fda03-8405-4cd4-aea3-a8cc67bc0fe6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1d555c27-c8c2-4d30-9a50-be7cf9a60db5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8d5f33c4-cf45-4c87-b9ea-f0b474dfcada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d9b51207-4514-4bfd-967c-32040c0b196f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bb2fcd47-4202-4b5c-ad02-5dfbe865cbde","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"59599740-63cf-4e26-abb0-fe542c98671a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"daebb41e-6be2-4689-b9c4-ba5271f2ce69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ed8914a3-1f7c-4942-bd5e-0453369f009b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T20:46:55.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:55.045+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/3950900165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5d81471c0 msgr2=0x7fa5d81db3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:55.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:55.045+0000 7fa5dd9b8640 1 --2- 172.21.15.52:0/3950900165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5d81471c0 0x7fa5d81db3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa5d00af040 tx=0x7fa5d0019780 comp rx=0 tx=0).stop 2024-09-15T20:46:55.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:55.045+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/3950900165 shutdown_connections 2024-09-15T20:46:55.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:55.045+0000 7fa5dd9b8640 1 --2- 172.21.15.52:0/3950900165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5d81471c0 0x7fa5d81db3f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:55.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:55.045+0000 7fa5dd9b8640 1 --2- 172.21.15.52:0/3950900165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa5d8140bd0 0x7fa5d81de970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:55.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:55.045+0000 7fa5dd9b8640 1 --2- 172.21.15.52:0/3950900165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5d80b9ad0 0x7fa5d8137ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:55.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:55.045+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/3950900165 >> 172.21.15.52:0/3950900165 conn(0x7fa5d8068fd0 msgr2=0x7fa5d80b6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:55.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:55.049+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/3950900165 shutdown_connections 2024-09-15T20:46:55.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:46:55.049+0000 7fa5dd9b8640 1 -- 172.21.15.52:0/3950900165 wait complete. 2024-09-15T20:46:55.065 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T20:46:55.065 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T20:46:55.365 INFO:tasks.ceph.mgr.x.smithi081.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-15T20:46:55.366 INFO:tasks.ceph.mgr.x.smithi081.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-15T20:46:55.366 INFO:tasks.ceph.mgr.x.smithi081.stderr: from numpy import show_config as show_numpy_config 2024-09-15T20:46:55.591 INFO:tasks.ceph.mgr.y.smithi052.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-15T20:46:55.591 INFO:tasks.ceph.mgr.y.smithi052.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-15T20:46:55.591 INFO:tasks.ceph.mgr.y.smithi052.stderr: from numpy import show_config as show_numpy_config 2024-09-15T20:46:55.870 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T20:46:55.986 INFO:tasks.ceph.osd.6.smithi081.stderr:2024-09-15T20:46:55.979+0000 7f24c13b57c0 -1 Falling back to public interface 2024-09-15T20:46:55.987 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc49abfb640 1 Processor -- start 2024-09-15T20:46:55.988 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc49abfb640 1 -- start start 2024-09-15T20:46:55.990 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc49abfb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc4940b44c0 0x7fc4941469e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:55.990 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc49abfb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc49406e980 0x7fc494140530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:55.990 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc49abfb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4940af520 con 0x7fc49406eda0 2024-09-15T20:46:55.990 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc49abfb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc4940b48a0 con 0x7fc4940b44c0 2024-09-15T20:46:55.990 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc49abfb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc4940af800 con 0x7fc49406e980 2024-09-15T20:46:55.990 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc498997640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc4940b44c0 0x7fc4941469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:55.990 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc499198640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc49406eda0 0x7fc4940b2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57780/0 (socket says 172.21.15.52:57780) 2024-09-15T20:46:55.990 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc499198640 1 -- 172.21.15.52:0/891185190 learned_addr learned my addr 172.21.15.52:0/891185190 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:46:55.990 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc493fff640 1 --2- 172.21.15.52:0/891185190 >> v2:172.21.15.81:3300/0 conn(0x7fc49406e980 0x7fc494140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:55.990 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc498997640 1 -- 172.21.15.52:0/891185190 >> v2:172.21.15.81:3300/0 conn(0x7fc49406e980 msgr2=0x7fc494140530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:46:55.990 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc498997640 1 --2- 172.21.15.52:0/891185190 >> v2:172.21.15.81:3300/0 conn(0x7fc49406e980 0x7fc494140530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:55.991 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc498997640 1 -- 172.21.15.52:0/891185190 >> v1:172.21.15.52:6789/0 conn(0x7fc49406eda0 legacy=0x7fc4940b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:55.991 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.985+0000 7fc498997640 1 -- 172.21.15.52:0/891185190 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49406f900 con 0x7fc4940b44c0 2024-09-15T20:46:55.991 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc498997640 1 --2- 172.21.15.52:0/891185190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4940b44c0 0x7fc4941469e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc494146940 tx=0x7fc48801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba1b2ab7b2e35ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:55.992 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc4937fe640 1 -- 172.21.15.52:0/891185190 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4880b0070 con 0x7fc4940b44c0 2024-09-15T20:46:55.992 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc4937fe640 1 -- 172.21.15.52:0/891185190 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4880ab600 con 0x7fc4940b44c0 2024-09-15T20:46:55.992 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc4937fe640 1 -- 172.21.15.52:0/891185190 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4880ab9d0 con 0x7fc4940b44c0 2024-09-15T20:46:55.993 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc49abfb640 1 -- 172.21.15.52:0/891185190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4940b44c0 msgr2=0x7fc4941469e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:55.993 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc49abfb640 1 --2- 172.21.15.52:0/891185190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4940b44c0 0x7fc4941469e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc494146940 tx=0x7fc48801c460 comp rx=0 tx=0).stop 2024-09-15T20:46:55.993 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc49abfb640 1 -- 172.21.15.52:0/891185190 shutdown_connections 2024-09-15T20:46:55.993 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc49abfb640 1 --2- 172.21.15.52:0/891185190 >> v2:172.21.15.81:3300/0 conn(0x7fc49406e980 0x7fc494140530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:55.993 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc49abfb640 1 --2- 172.21.15.52:0/891185190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4940b44c0 0x7fc4941469e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:55.993 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc49abfb640 1 -- 172.21.15.52:0/891185190 >> 172.21.15.52:0/891185190 conn(0x7fc4940b7650 msgr2=0x7fc4940b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:55.993 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc49abfb640 1 -- 172.21.15.52:0/891185190 shutdown_connections 2024-09-15T20:46:55.993 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc49abfb640 1 -- 172.21.15.52:0/891185190 wait complete. 2024-09-15T20:46:55.995 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc49abfb640 1 Processor -- start 2024-09-15T20:46:55.995 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.989+0000 7fc49abfb640 1 -- start start 2024-09-15T20:46:55.995 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc49abfb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49406e980 0x7fc494147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc49abfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc49406eda0 0x7fc494143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc49abfb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4940b44c0 0x7fc4941dba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc49abfb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc494150fa0 con 0x7fc49406eda0 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc49abfb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc494151120 con 0x7fc49406e980 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc49abfb640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fc4941512a0 con 0x7fc4940b44c0 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc493fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc49406eda0 0x7fc494143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc499198640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4940b44c0 0x7fc4941dba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc493fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc49406eda0 0x7fc494143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45260/0 (socket says 172.21.15.52:45260) 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc493fff640 1 -- 172.21.15.52:0/2869370264 learned_addr learned my addr 172.21.15.52:0/2869370264 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc498997640 1 --2- 172.21.15.52:0/2869370264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49406e980 0x7fc494147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc493fff640 1 -- 172.21.15.52:0/2869370264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4940b44c0 msgr2=0x7fc4941dba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc493fff640 1 --2- 172.21.15.52:0/2869370264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4940b44c0 0x7fc4941dba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:55.996 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc493fff640 1 -- 172.21.15.52:0/2869370264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49406e980 msgr2=0x7fc494147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:55.997 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc493fff640 1 --2- 172.21.15.52:0/2869370264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49406e980 0x7fc494147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:55.997 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc493fff640 1 -- 172.21.15.52:0/2869370264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4941439e0 con 0x7fc49406eda0 2024-09-15T20:46:55.997 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc498997640 1 --2- 172.21.15.52:0/2869370264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49406e980 0x7fc494147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:46:55.997 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc493fff640 1 --2- 172.21.15.52:0/2869370264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc49406eda0 0x7fc494143f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc48400e930 tx=0x7fc48400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:46:55.997 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc4917fa640 1 -- 172.21.15.52:0/2869370264 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484017070 con 0x7fc49406eda0 2024-09-15T20:46:55.997 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc4917fa640 1 -- 172.21.15.52:0/2869370264 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48400ca00 con 0x7fc49406eda0 2024-09-15T20:46:55.997 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc49abfb640 1 -- 172.21.15.52:0/2869370264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc49413de90 con 0x7fc49406eda0 2024-09-15T20:46:55.997 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc4917fa640 1 -- 172.21.15.52:0/2869370264 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48400cdb0 con 0x7fc49406eda0 2024-09-15T20:46:55.997 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc49abfb640 1 -- 172.21.15.52:0/2869370264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4941dc160 con 0x7fc49406eda0 2024-09-15T20:46:55.997 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc4917fa640 1 -- 172.21.15.52:0/2869370264 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc48401a070 con 0x7fc49406eda0 2024-09-15T20:46:55.997 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc4917fa640 1 -- 172.21.15.52:0/2869370264 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc4840066b0 con 0x7fc49406eda0 2024-09-15T20:46:55.998 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.993+0000 7fc49abfb640 1 -- 172.21.15.52:0/2869370264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc494140530 con 0x7fc49406eda0 2024-09-15T20:46:55.998 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:55.997+0000 7fc4917fa640 1 -- 172.21.15.52:0/2869370264 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc484006000 con 0x7fc49406eda0 2024-09-15T20:46:56.060 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:56.057+0000 7fc49abfb640 1 -- 172.21.15.52:0/2869370264 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc494069d60 con 0x7fc49406eda0 2024-09-15T20:46:56.060 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:56.057+0000 7fc4917fa640 1 -- 172.21.15.52:0/2869370264 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc4840061e0 con 0x7fc49406eda0 2024-09-15T20:46:56.061 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-15T20:46:56.061 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"5b0b6dfd-6a20-4023-acf9-e3c53f9607bc","created":"2024-09-15T20:46:52.315149+0000","modified":"2024-09-15T20:46:54.803112+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T20:46:54.803112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b99fda03-8405-4cd4-aea3-a8cc67bc0fe6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1d555c27-c8c2-4d30-9a50-be7cf9a60db5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8d5f33c4-cf45-4c87-b9ea-f0b474dfcada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d9b51207-4514-4bfd-967c-32040c0b196f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bb2fcd47-4202-4b5c-ad02-5dfbe865cbde","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"59599740-63cf-4e26-abb0-fe542c98671a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"daebb41e-6be2-4689-b9c4-ba5271f2ce69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ed8914a3-1f7c-4942-bd5e-0453369f009b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T20:46:56.062 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:56.057+0000 7fc49abfb640 1 -- 172.21.15.52:0/2869370264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc49406eda0 msgr2=0x7fc494143f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:46:56.062 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:56.057+0000 7fc49abfb640 1 --2- 172.21.15.52:0/2869370264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc49406eda0 0x7fc494143f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc48400e930 tx=0x7fc48400edf0 comp rx=0 tx=0).stop 2024-09-15T20:46:56.062 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:56.057+0000 7fc49abfb640 1 -- 172.21.15.52:0/2869370264 shutdown_connections 2024-09-15T20:46:56.062 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:56.057+0000 7fc49abfb640 1 --2- 172.21.15.52:0/2869370264 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc4940b44c0 0x7fc4941dba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:56.062 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:56.057+0000 7fc49abfb640 1 --2- 172.21.15.52:0/2869370264 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc49406eda0 0x7fc494143f40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:56.062 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:56.057+0000 7fc49abfb640 1 --2- 172.21.15.52:0/2869370264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49406e980 0x7fc494147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:46:56.062 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:56.057+0000 7fc49abfb640 1 -- 172.21.15.52:0/2869370264 >> 172.21.15.52:0/2869370264 conn(0x7fc4940b7650 msgr2=0x7fc4940b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:46:56.062 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:56.057+0000 7fc49abfb640 1 -- 172.21.15.52:0/2869370264 shutdown_connections 2024-09-15T20:46:56.063 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:46:56.061+0000 7fc49abfb640 1 -- 172.21.15.52:0/2869370264 wait complete. 2024-09-15T20:46:56.079 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-15T20:46:56.198 INFO:tasks.ceph.osd.5.smithi081.stderr:2024-09-15T20:46:56.191+0000 7f76517b07c0 -1 Falling back to public interface 2024-09-15T20:46:56.199 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-09-15T20:46:56.197+0000 7f27760d27c0 -1 Falling back to public interface 2024-09-15T20:46:56.205 INFO:tasks.ceph.osd.4.smithi081.stderr:2024-09-15T20:46:56.199+0000 7f098f9cf7c0 -1 Falling back to public interface 2024-09-15T20:46:56.211 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-09-15T20:46:56.209+0000 7f7991dcd7c0 -1 Falling back to public interface 2024-09-15T20:46:56.231 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-09-15T20:46:56.229+0000 7f9eb45cb7c0 -1 Falling back to public interface 2024-09-15T20:46:56.478 INFO:tasks.ceph.osd.7.smithi081.stderr:2024-09-15T20:46:56.471+0000 7faa91f5e7c0 -1 Falling back to public interface 2024-09-15T20:46:56.696 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-09-15T20:46:56.693+0000 7ff6ef7037c0 -1 Falling back to public interface 2024-09-15T20:46:58.232 INFO:tasks.ceph.mgr.x.smithi081.stderr:2024-09-15T20:46:58.223+0000 7fd6b56c8640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-15T20:46:58.232 INFO:tasks.ceph.mgr.x.smithi081.stderr:2024-09-15T20:46:58.223+0000 7fd6b56c8640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-15T20:47:00.067 INFO:tasks.ceph.osd.6.smithi081.stderr:2024-09-15T20:47:00.059+0000 7f24c13b57c0 -1 osd.6 0 log_to_monitors true 2024-09-15T20:47:00.281 INFO:tasks.ceph.osd.4.smithi081.stderr:2024-09-15T20:47:00.275+0000 7f098f9cf7c0 -1 osd.4 0 log_to_monitors true 2024-09-15T20:47:00.281 INFO:tasks.ceph.osd.5.smithi081.stderr:2024-09-15T20:47:00.275+0000 7f76517b07c0 -1 osd.5 0 log_to_monitors true 2024-09-15T20:47:00.497 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-09-15T20:47:00.493+0000 7f27760d27c0 -1 osd.0 0 log_to_monitors true 2024-09-15T20:47:00.513 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-09-15T20:47:00.509+0000 7f7991dcd7c0 -1 osd.3 0 log_to_monitors true 2024-09-15T20:47:00.534 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-09-15T20:47:00.529+0000 7f9eb45cb7c0 -1 osd.1 0 log_to_monitors true 2024-09-15T20:47:00.759 INFO:tasks.ceph.osd.7.smithi081.stderr:2024-09-15T20:47:00.751+0000 7faa91f5e7c0 -1 osd.7 0 log_to_monitors true 2024-09-15T20:47:00.989 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-09-15T20:47:00.985+0000 7ff6ef7037c0 -1 osd.2 0 log_to_monitors true 2024-09-15T20:47:01.386 INFO:tasks.ceph.osd.4.smithi081.stderr:2024-09-15T20:47:01.379+0000 7f098b978640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T20:47:01.423 INFO:tasks.ceph.osd.4.smithi081.stderr:2024-09-15T20:47:01.415+0000 7f09877b2640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T20:47:02.383 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-09-15T20:47:02.381+0000 7f798dd76640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T20:47:02.384 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-09-15T20:47:02.381+0000 7ff6eb6ac640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T20:47:02.403 INFO:tasks.ceph.osd.3.smithi052.stderr:2024-09-15T20:47:02.401+0000 7f7989bb0640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T20:47:02.414 INFO:tasks.ceph.osd.2.smithi052.stderr:2024-09-15T20:47:02.413+0000 7ff6e74e6640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T20:47:02.827 INFO:tasks.ceph.osd.6.smithi081.stderr:2024-09-15T20:47:02.819+0000 7f24bd35e640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T20:47:02.848 INFO:tasks.ceph.osd.5.smithi081.stderr:2024-09-15T20:47:02.839+0000 7f764d759640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T20:47:02.867 INFO:tasks.ceph.osd.6.smithi081.stderr:2024-09-15T20:47:02.859+0000 7f24b5190640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T20:47:02.873 INFO:tasks.ceph.osd.5.smithi081.stderr:2024-09-15T20:47:02.867+0000 7f764558b640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T20:47:02.887 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T20:47:03.043 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56bac4e640 1 Processor -- start 2024-09-15T20:47:03.043 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56bac4e640 1 -- start start 2024-09-15T20:47:03.044 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56bac4e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f56b4068d10 0x7f56b4146b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:03.044 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56bac4e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f56b4140780 0x7f56b4140c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:03.044 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56bac4e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b40b1760 con 0x7f56b40b1960 2024-09-15T20:47:03.045 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56bac4e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f56b40690f0 con 0x7f56b4140780 2024-09-15T20:47:03.045 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56bac4e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f56b40b1080 con 0x7f56b4068d10 2024-09-15T20:47:03.045 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56b91eb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f56b4140780 0x7f56b4140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:03.045 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56b3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f56b40b1960 0x7f56b41470a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.52:51948/0 (socket says 172.21.15.52:51948) 2024-09-15T20:47:03.045 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56b3fff640 1 -- 172.21.15.52:0/2926369726 learned_addr learned my addr 172.21.15.52:0/2926369726 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:03.045 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56b89ea640 1 --2- 172.21.15.52:0/2926369726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f56b4068d10 0x7f56b4146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:03.046 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56b91eb640 1 -- 172.21.15.52:0/2926369726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f56b4068d10 msgr2=0x7f56b4146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:03.046 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56b91eb640 1 --2- 172.21.15.52:0/2926369726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f56b4068d10 0x7f56b4146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:03.046 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56b91eb640 1 -- 172.21.15.52:0/2926369726 >> v1:172.21.15.81:6789/0 conn(0x7f56b40b1960 legacy=0x7f56b41470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:03.046 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56b91eb640 1 -- 172.21.15.52:0/2926369726 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b4071170 con 0x7f56b4140780 2024-09-15T20:47:03.046 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56b37fe640 1 -- 172.21.15.52:0/2926369726 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116301956 0 0) 0x7f56a0001120 con 0x7f56b40b1960 2024-09-15T20:47:03.046 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.041+0000 7f56b89ea640 1 --2- 172.21.15.52:0/2926369726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f56b4068d10 0x7f56b4146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T20:47:03.048 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.045+0000 7f56b91eb640 1 --2- 172.21.15.52:0/2926369726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b4140780 0x7f56b4140c30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009dc0 tx=0x7f56ac01c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa8bdef47f89634f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:03.048 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.045+0000 7f56b37fe640 1 -- 172.21.15.52:0/2926369726 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0b2070 con 0x7f56b4140780 2024-09-15T20:47:03.048 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.045+0000 7f56b37fe640 1 -- 172.21.15.52:0/2926369726 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ac0a5780 con 0x7f56b4140780 2024-09-15T20:47:03.048 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.045+0000 7f56b37fe640 1 -- 172.21.15.52:0/2926369726 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0a5b50 con 0x7f56b4140780 2024-09-15T20:47:03.049 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.045+0000 7f56bac4e640 1 -- 172.21.15.52:0/2926369726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b4140780 msgr2=0x7f56b4140c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:03.050 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.045+0000 7f56bac4e640 1 --2- 172.21.15.52:0/2926369726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b4140780 0x7f56b4140c30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009dc0 tx=0x7f56ac01c810 comp rx=0 tx=0).stop 2024-09-15T20:47:03.050 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.045+0000 7f56bac4e640 1 -- 172.21.15.52:0/2926369726 shutdown_connections 2024-09-15T20:47:03.050 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.045+0000 7f56bac4e640 1 --2- 172.21.15.52:0/2926369726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b4140780 0x7f56b4140c30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:03.050 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.045+0000 7f56bac4e640 1 --2- 172.21.15.52:0/2926369726 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f56b4068d10 0x7f56b4146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:03.050 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.045+0000 7f56bac4e640 1 -- 172.21.15.52:0/2926369726 >> 172.21.15.52:0/2926369726 conn(0x7f56b40b5740 msgr2=0x7f56b40b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:03.050 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.045+0000 7f56bac4e640 1 -- 172.21.15.52:0/2926369726 shutdown_connections 2024-09-15T20:47:03.050 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.045+0000 7f56bac4e640 1 -- 172.21.15.52:0/2926369726 wait complete. 2024-09-15T20:47:03.051 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56bac4e640 1 Processor -- start 2024-09-15T20:47:03.051 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56bac4e640 1 -- start start 2024-09-15T20:47:03.052 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56bac4e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b4068d10 0x7f56b4138f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:03.052 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56bac4e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b40b1960 0x7f56b41420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:03.052 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56bac4e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f56b4140780 0x7f56b4143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:03.052 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56bac4e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56b4150920 con 0x7f56b40b1960 2024-09-15T20:47:03.052 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56bac4e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56b40b05b0 con 0x7f56b4068d10 2024-09-15T20:47:03.052 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56bac4e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f56b4150aa0 con 0x7f56b4140780 2024-09-15T20:47:03.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56b3fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b40b1960 0x7f56b41420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:03.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56b89ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b4068d10 0x7f56b4138f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:03.053 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56b89ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b4068d10 0x7f56b4138f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.52:51818/0 (socket says 172.21.15.52:51818) 2024-09-15T20:47:03.054 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56b89ea640 1 -- 172.21.15.52:0/2110938534 learned_addr learned my addr 172.21.15.52:0/2110938534 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:03.054 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56b3fff640 1 -- 172.21.15.52:0/2110938534 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f56b4140780 msgr2=0x7f56b4143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:03.054 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56b3fff640 1 --2- 172.21.15.52:0/2110938534 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f56b4140780 0x7f56b4143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:03.054 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56b3fff640 1 -- 172.21.15.52:0/2110938534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b4068d10 msgr2=0x7f56b4138f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:03.054 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56b3fff640 1 --2- 172.21.15.52:0/2110938534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b4068d10 0x7f56b4138f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:03.054 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56b3fff640 1 -- 172.21.15.52:0/2110938534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b41425e0 con 0x7f56b40b1960 2024-09-15T20:47:03.054 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.049+0000 7f56b3fff640 1 --2- 172.21.15.52:0/2110938534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b40b1960 0x7f56b41420a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f56a000c400 tx=0x7f56a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:03.055 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.053+0000 7f56b17fa640 1 -- 172.21.15.52:0/2110938534 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a00074e0 con 0x7f56b40b1960 2024-09-15T20:47:03.055 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.053+0000 7f56bac4e640 1 -- 172.21.15.52:0/2110938534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b41413e0 con 0x7f56b40b1960 2024-09-15T20:47:03.055 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.053+0000 7f56bac4e640 1 -- 172.21.15.52:0/2110938534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b4141e70 con 0x7f56b40b1960 2024-09-15T20:47:03.055 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.053+0000 7f56b17fa640 1 -- 172.21.15.52:0/2110938534 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a0007680 con 0x7f56b40b1960 2024-09-15T20:47:03.055 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.053+0000 7f56b17fa640 1 -- 172.21.15.52:0/2110938534 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0004a30 con 0x7f56b40b1960 2024-09-15T20:47:03.055 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.053+0000 7f56bac4e640 1 -- 172.21.15.52:0/2110938534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5694005090 con 0x7f56b40b1960 2024-09-15T20:47:03.056 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.053+0000 7f56b17fa640 1 -- 172.21.15.52:0/2110938534 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) ==== 97024+0+0 (secure 0 0 0) 0x7f56a0011070 con 0x7f56b40b1960 2024-09-15T20:47:03.066 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.065+0000 7f56b17fa640 1 --2- 172.21.15.52:0/2110938534 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5698072e80 0x7f5698075340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:03.066 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.065+0000 7f56b17fa640 1 -- 172.21.15.52:0/2110938534 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f56a0092600 con 0x7f56b40b1960 2024-09-15T20:47:03.066 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.065+0000 7f56b17fa640 1 -- 172.21.15.52:0/2110938534 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f56b40b1760 con 0x7f56b40b1960 2024-09-15T20:47:03.067 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.065+0000 7f56b89ea640 1 --2- 172.21.15.52:0/2110938534 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5698072e80 0x7f5698075340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:03.068 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.065+0000 7f56b89ea640 1 --2- 172.21.15.52:0/2110938534 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5698072e80 0x7f5698075340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009a10 tx=0x7f56a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:03.352 INFO:tasks.ceph.osd.7.smithi081.stderr:2024-09-15T20:47:03.343+0000 7faa8e719640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T20:47:03.361 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-09-15T20:47:03.357+0000 7f277288d640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T20:47:03.374 INFO:tasks.ceph.osd.7.smithi081.stderr:2024-09-15T20:47:03.367+0000 7faa85d39640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T20:47:03.381 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.377+0000 7f56bac4e640 1 -- 172.21.15.52:0/2110938534 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5694005380 con 0x7f56b40b1960 2024-09-15T20:47:03.384 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.381+0000 7f56b17fa640 1 -- 172.21.15.52:0/2110938534 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9474 (secure 0 0 0) 0x7f56a005e870 con 0x7f56b40b1960 2024-09-15T20:47:03.385 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-15T20:47:03.385 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":14,"fsid":"5b0b6dfd-6a20-4023-acf9-e3c53f9607bc","created":"2024-09-15T20:46:52.315149+0000","modified":"2024-09-15T20:47:03.373021+0000","last_up_change":"2024-09-15T20:47:03.373021+0000","last_in_change":"2024-09-15T20:46:54.803112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b99fda03-8405-4cd4-aea3-a8cc67bc0fe6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1d555c27-c8c2-4d30-9a50-be7cf9a60db5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8d5f33c4-cf45-4c87-b9ea-f0b474dfcada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6825","nonce":4164590883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6827","nonce":4164590883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6831","nonce":4164590883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6829","nonce":4164590883}]},"public_addr":"172.21.15.52:6825/4164590883","cluster_addr":"172.21.15.52:6827/4164590883","heartbeat_back_addr":"172.21.15.52:6831/4164590883","heartbeat_front_addr":"172.21.15.52:6829/4164590883","state":["exists","up"]},{"osd":3,"uuid":"d9b51207-4514-4bfd-967c-32040c0b196f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6809","nonce":4053631670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6811","nonce":4053631670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6815","nonce":4053631670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6813","nonce":4053631670}]},"public_addr":"172.21.15.52:6809/4053631670","cluster_addr":"172.21.15.52:6811/4053631670","heartbeat_back_addr":"172.21.15.52:6815/4053631670","heartbeat_front_addr":"172.21.15.52:6813/4053631670","state":["exists","up"]},{"osd":4,"uuid":"bb2fcd47-4202-4b5c-ad02-5dfbe865cbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6817","nonce":1105997015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6819","nonce":1105997015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6823","nonce":1105997015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6821","nonce":1105997015}]},"public_addr":"172.21.15.81:6817/1105997015","cluster_addr":"172.21.15.81:6819/1105997015","heartbeat_back_addr":"172.21.15.81:6823/1105997015","heartbeat_front_addr":"172.21.15.81:6821/1105997015","state":["exists","up"]},{"osd":5,"uuid":"59599740-63cf-4e26-abb0-fe542c98671a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6809","nonce":1585962119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6811","nonce":1585962119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6815","nonce":1585962119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6813","nonce":1585962119}]},"public_addr":"172.21.15.81:6809/1585962119","cluster_addr":"172.21.15.81:6811/1585962119","heartbeat_back_addr":"172.21.15.81:6815/1585962119","heartbeat_front_addr":"172.21.15.81:6813/1585962119","state":["exists","up"]},{"osd":6,"uuid":"daebb41e-6be2-4689-b9c4-ba5271f2ce69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6801","nonce":1367983121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6803","nonce":1367983121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6807","nonce":1367983121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6805","nonce":1367983121}]},"public_addr":"172.21.15.81:6801/1367983121","cluster_addr":"172.21.15.81:6803/1367983121","heartbeat_back_addr":"172.21.15.81:6807/1367983121","heartbeat_front_addr":"172.21.15.81:6805/1367983121","state":["exists","up"]},{"osd":7,"uuid":"ed8914a3-1f7c-4942-bd5e-0453369f009b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.327079+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T20:47:03.387 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.385+0000 7f56bac4e640 1 -- 172.21.15.52:0/2110938534 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5698072e80 msgr2=0x7f5698075340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:03.387 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.385+0000 7f56bac4e640 1 --2- 172.21.15.52:0/2110938534 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5698072e80 0x7f5698075340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009a10 tx=0x7f56a8008040 comp rx=0 tx=0).stop 2024-09-15T20:47:03.387 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.385+0000 7f56bac4e640 1 -- 172.21.15.52:0/2110938534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b40b1960 msgr2=0x7f56b41420a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:03.387 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.385+0000 7f56bac4e640 1 --2- 172.21.15.52:0/2110938534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b40b1960 0x7f56b41420a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f56a000c400 tx=0x7f56a000c8c0 comp rx=0 tx=0).stop 2024-09-15T20:47:03.387 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.385+0000 7f56bac4e640 1 -- 172.21.15.52:0/2110938534 shutdown_connections 2024-09-15T20:47:03.388 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.385+0000 7f56bac4e640 1 --2- 172.21.15.52:0/2110938534 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5698072e80 0x7f5698075340 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:03.388 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.385+0000 7f56bac4e640 1 --2- 172.21.15.52:0/2110938534 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f56b4140780 0x7f56b4143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:03.388 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.385+0000 7f56bac4e640 1 --2- 172.21.15.52:0/2110938534 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b40b1960 0x7f56b41420a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:03.388 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.385+0000 7f56bac4e640 1 --2- 172.21.15.52:0/2110938534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b4068d10 0x7f56b4138f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:03.388 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.385+0000 7f56bac4e640 1 -- 172.21.15.52:0/2110938534 >> 172.21.15.52:0/2110938534 conn(0x7f56b40b5740 msgr2=0x7f56b40aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:03.388 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.385+0000 7f56bac4e640 1 -- 172.21.15.52:0/2110938534 shutdown_connections 2024-09-15T20:47:03.388 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:03.385+0000 7f56bac4e640 1 -- 172.21.15.52:0/2110938534 wait complete. 2024-09-15T20:47:03.390 INFO:tasks.ceph.osd.0.smithi052.stderr:2024-09-15T20:47:03.389+0000 7f2769ead640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T20:47:03.391 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-09-15T20:47:03.389+0000 7f9eb0574640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T20:47:03.405 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-09-15T20:47:03.422 INFO:tasks.ceph.osd.1.smithi052.stderr:2024-09-15T20:47:03.421+0000 7f9ea83a6640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T20:47:10.212 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T20:47:10.338 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f190a96c640 1 Processor -- start 2024-09-15T20:47:10.338 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f190a96c640 1 -- start start 2024-09-15T20:47:10.339 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f190a96c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1904068e90 0x7f1904146a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.339 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f190a96c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19040718f0 con 0x7f1904068ab0 2024-09-15T20:47:10.339 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f190a96c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1904141010 con 0x7f1904140730 2024-09-15T20:47:10.340 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f190a96c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1904074bd0 con 0x7f1904068e90 2024-09-15T20:47:10.340 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1903fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1904068ab0 0x7f19040b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47324/0 (socket says 172.21.15.52:47324) 2024-09-15T20:47:10.340 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1903fff640 1 -- 172.21.15.52:0/1811225953 learned_addr learned my addr 172.21.15.52:0/1811225953 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:10.340 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743265339 0 0) 0x7f19040718f0 con 0x7f1904068ab0 2024-09-15T20:47:10.340 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18ec003530 con 0x7f1904068ab0 2024-09-15T20:47:10.340 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f19037fe640 1 --2- 172.21.15.52:0/1811225953 >> v2:172.21.15.81:3300/0 conn(0x7f1904068e90 0x7f1904146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.341 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1685258990 0 0) 0x7f18ec003530 con 0x7f1904068ab0 2024-09-15T20:47:10.342 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 >> v2:172.21.15.81:3300/0 conn(0x7f1904068e90 msgr2=0x7f1904146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:10.342 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 --2- 172.21.15.52:0/1811225953 >> v2:172.21.15.81:3300/0 conn(0x7f1904068e90 0x7f1904146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.342 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 >> v1:172.21.15.81:6789/0 conn(0x7f1904140730 legacy=0x7f190414dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:10.342 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19040b0ee0 con 0x7f1904068ab0 2024-09-15T20:47:10.342 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 282972984 0 0) 0x7f18f8001700 con 0x7f1904068ab0 2024-09-15T20:47:10.342 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 >> v1:172.21.15.52:6789/0 conn(0x7f1904068ab0 legacy=0x7f19040b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:10.342 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 --2- 172.21.15.52:0/1811225953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18ec003ab0 0x7f18ec003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.342 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 --2- 172.21.15.52:0/1811225953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18ec004810 0x7f18ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.342 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 --2- 172.21.15.52:0/1811225953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec0052f0 0x7f18ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.342 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1904074bd0 con 0x7f18ec003ab0 2024-09-15T20:47:10.342 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec00c1f0 con 0x7f18ec0052f0 2024-09-15T20:47:10.342 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f18ec00c3f0 con 0x7f18ec004810 2024-09-15T20:47:10.343 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f19037fe640 1 --2- 172.21.15.52:0/1811225953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18ec004810 0x7f18ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.343 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1903fff640 1 --2- 172.21.15.52:0/1811225953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18ec003ab0 0x7f18ec003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.343 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1908f09640 1 --2- 172.21.15.52:0/1811225953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec0052f0 0x7f18ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.343 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f19037fe640 1 -- 172.21.15.52:0/1811225953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec0052f0 msgr2=0x7f18ec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:10.343 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f19037fe640 1 --2- 172.21.15.52:0/1811225953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec0052f0 0x7f18ec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.343 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f19037fe640 1 -- 172.21.15.52:0/1811225953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18ec003ab0 msgr2=0x7f18ec003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:10.343 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f19037fe640 1 --2- 172.21.15.52:0/1811225953 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f18ec003ab0 0x7f18ec003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.343 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f19037fe640 1 -- 172.21.15.52:0/1811225953 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec003530 con 0x7f18ec004810 2024-09-15T20:47:10.343 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.337+0000 7f1908f09640 1 -- 172.21.15.52:0/1811225953 reap_dead start 2024-09-15T20:47:10.346 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f19037fe640 1 --2- 172.21.15.52:0/1811225953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18ec004810 0x7f18ec004c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009ae0 tx=0x7f18f401ca50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45d97c74fb8f2711 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:10.346 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f40096b0 con 0x7f18ec004810 2024-09-15T20:47:10.346 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f40a6430 con 0x7f18ec004810 2024-09-15T20:47:10.346 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f1902ffd640 1 -- 172.21.15.52:0/1811225953 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f40a6820 con 0x7f18ec004810 2024-09-15T20:47:10.347 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 -- 172.21.15.52:0/1811225953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18ec004810 msgr2=0x7f18ec004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:10.347 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 --2- 172.21.15.52:0/1811225953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18ec004810 0x7f18ec004c90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009ae0 tx=0x7f18f401ca50 comp rx=0 tx=0).stop 2024-09-15T20:47:10.347 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 -- 172.21.15.52:0/1811225953 shutdown_connections 2024-09-15T20:47:10.347 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 --2- 172.21.15.52:0/1811225953 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f18ec004810 0x7f18ec004c90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.347 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 -- 172.21.15.52:0/1811225953 >> 172.21.15.52:0/1811225953 conn(0x7f19040b5d20 msgr2=0x7f19040b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:10.347 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 -- 172.21.15.52:0/1811225953 shutdown_connections 2024-09-15T20:47:10.347 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 -- 172.21.15.52:0/1811225953 wait complete. 2024-09-15T20:47:10.347 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 Processor -- start 2024-09-15T20:47:10.347 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 -- start start 2024-09-15T20:47:10.347 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec004810 0x7f190413b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.347 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f190413aae0 0x7f190413af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.348 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1904138a00 0x7f1904138e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.348 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f19040aec00 con 0x7f190413aae0 2024-09-15T20:47:10.348 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19040aea80 con 0x7f18ec004810 2024-09-15T20:47:10.348 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f190a96c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f19040aed80 con 0x7f1904138a00 2024-09-15T20:47:10.348 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f1908f09640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1904138a00 0x7f1904138e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.348 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f19037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f190413aae0 0x7f190413af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.348 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f19037fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f190413aae0 0x7f190413af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45300/0 (socket says 172.21.15.52:45300) 2024-09-15T20:47:10.348 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f19037fe640 1 -- 172.21.15.52:0/522910082 learned_addr learned my addr 172.21.15.52:0/522910082 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:10.348 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.341+0000 7f1903fff640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec004810 0x7f190413b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.348 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1908f09640 1 -- 172.21.15.52:0/522910082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec004810 msgr2=0x7f190413b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:10.349 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1908f09640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec004810 0x7f190413b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.349 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1908f09640 1 -- 172.21.15.52:0/522910082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f190413aae0 msgr2=0x7f190413af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:10.349 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1908f09640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f190413aae0 0x7f190413af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.349 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1908f09640 1 -- 172.21.15.52:0/522910082 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190413d5d0 con 0x7f1904138a00 2024-09-15T20:47:10.349 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f19037fe640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f190413aae0 0x7f190413af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:10.349 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1908f09640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1904138a00 0x7f1904138e80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f19040717d0 tx=0x7f18fc00fd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:10.349 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1900ff9640 1 -- 172.21.15.52:0/522910082 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc003b90 con 0x7f1904138a00 2024-09-15T20:47:10.349 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1900ff9640 1 -- 172.21.15.52:0/522910082 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18fc018070 con 0x7f1904138a00 2024-09-15T20:47:10.349 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f190a96c640 1 -- 172.21.15.52:0/522910082 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190413b480 con 0x7f1904138a00 2024-09-15T20:47:10.349 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1900ff9640 1 -- 172.21.15.52:0/522910082 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0050d0 con 0x7f1904138a00 2024-09-15T20:47:10.349 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f190a96c640 1 -- 172.21.15.52:0/522910082 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f190413d1b0 con 0x7f1904138a00 2024-09-15T20:47:10.350 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f190a96c640 1 -- 172.21.15.52:0/522910082 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1904076980 con 0x7f1904138a00 2024-09-15T20:47:10.350 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1900ff9640 1 -- 172.21.15.52:0/522910082 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f18fc005270 con 0x7f1904138a00 2024-09-15T20:47:10.350 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1900ff9640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f18f0072ef0 0x7f18f00753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.350 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1900ff9640 1 -- 172.21.15.52:0/522910082 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f18fc0936d0 con 0x7f1904138a00 2024-09-15T20:47:10.351 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1903fff640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f18f0072ef0 0x7f18f00753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.351 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.345+0000 7f1903fff640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f18f0072ef0 0x7f18f00753b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18f8000fc0 tx=0x7f18f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:10.353 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.349+0000 7f1900ff9640 1 -- 172.21.15.52:0/522910082 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f18fc05ed00 con 0x7f1904138a00 2024-09-15T20:47:10.525 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.521+0000 7f190a96c640 1 -- 172.21.15.52:0/522910082 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19040afd90 con 0x7f1904138a00 2024-09-15T20:47:10.527 INFO:teuthology.misc.health.smithi052.stdout: 2024-09-15T20:47:10.527 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":18,"fsid":"5b0b6dfd-6a20-4023-acf9-e3c53f9607bc","created":"2024-09-15T20:46:52.315149+0000","modified":"2024-09-15T20:47:07.416695+0000","last_up_change":"2024-09-15T20:47:04.394216+0000","last_in_change":"2024-09-15T20:46:54.803112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T20:47:05.257147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b99fda03-8405-4cd4-aea3-a8cc67bc0fe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6801","nonce":1039594647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6803","nonce":1039594647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6807","nonce":1039594647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6805","nonce":1039594647}]},"public_addr":"172.21.15.52:6801/1039594647","cluster_addr":"172.21.15.52:6803/1039594647","heartbeat_back_addr":"172.21.15.52:6807/1039594647","heartbeat_front_addr":"172.21.15.52:6805/1039594647","state":["exists","up"]},{"osd":1,"uuid":"1d555c27-c8c2-4d30-9a50-be7cf9a60db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6817","nonce":1590363289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6819","nonce":1590363289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6823","nonce":1590363289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6821","nonce":1590363289}]},"public_addr":"172.21.15.52:6817/1590363289","cluster_addr":"172.21.15.52:6819/1590363289","heartbeat_back_addr":"172.21.15.52:6823/1590363289","heartbeat_front_addr":"172.21.15.52:6821/1590363289","state":["exists","up"]},{"osd":2,"uuid":"8d5f33c4-cf45-4c87-b9ea-f0b474dfcada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6825","nonce":4164590883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6827","nonce":4164590883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6831","nonce":4164590883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6829","nonce":4164590883}]},"public_addr":"172.21.15.52:6825/4164590883","cluster_addr":"172.21.15.52:6827/4164590883","heartbeat_back_addr":"172.21.15.52:6831/4164590883","heartbeat_front_addr":"172.21.15.52:6829/4164590883","state":["exists","up"]},{"osd":3,"uuid":"d9b51207-4514-4bfd-967c-32040c0b196f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6809","nonce":4053631670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6811","nonce":4053631670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6815","nonce":4053631670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6813","nonce":4053631670}]},"public_addr":"172.21.15.52:6809/4053631670","cluster_addr":"172.21.15.52:6811/4053631670","heartbeat_back_addr":"172.21.15.52:6815/4053631670","heartbeat_front_addr":"172.21.15.52:6813/4053631670","state":["exists","up"]},{"osd":4,"uuid":"bb2fcd47-4202-4b5c-ad02-5dfbe865cbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6817","nonce":1105997015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6819","nonce":1105997015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6823","nonce":1105997015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6821","nonce":1105997015}]},"public_addr":"172.21.15.81:6817/1105997015","cluster_addr":"172.21.15.81:6819/1105997015","heartbeat_back_addr":"172.21.15.81:6823/1105997015","heartbeat_front_addr":"172.21.15.81:6821/1105997015","state":["exists","up"]},{"osd":5,"uuid":"59599740-63cf-4e26-abb0-fe542c98671a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6809","nonce":1585962119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6811","nonce":1585962119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6815","nonce":1585962119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6813","nonce":1585962119}]},"public_addr":"172.21.15.81:6809/1585962119","cluster_addr":"172.21.15.81:6811/1585962119","heartbeat_back_addr":"172.21.15.81:6815/1585962119","heartbeat_front_addr":"172.21.15.81:6813/1585962119","state":["exists","up"]},{"osd":6,"uuid":"daebb41e-6be2-4689-b9c4-ba5271f2ce69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6801","nonce":1367983121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6803","nonce":1367983121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6807","nonce":1367983121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6805","nonce":1367983121}]},"public_addr":"172.21.15.81:6801/1367983121","cluster_addr":"172.21.15.81:6803/1367983121","heartbeat_back_addr":"172.21.15.81:6807/1367983121","heartbeat_front_addr":"172.21.15.81:6805/1367983121","state":["exists","up"]},{"osd":7,"uuid":"ed8914a3-1f7c-4942-bd5e-0453369f009b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6825","nonce":579210364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6827","nonce":579210364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6831","nonce":579210364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6829","nonce":579210364}]},"public_addr":"172.21.15.81:6825/579210364","cluster_addr":"172.21.15.81:6827/579210364","heartbeat_back_addr":"172.21.15.81:6831/579210364","heartbeat_front_addr":"172.21.15.81:6829/579210364","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.527985+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.518897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.982136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.494599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.327079+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.271634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.089410+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.736530+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T20:47:10.528 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f1900ff9640 1 -- 172.21.15.52:0/522910082 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12860 (secure 0 0 0) 0x7f18fc05e600 con 0x7f1904138a00 2024-09-15T20:47:10.530 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f190a96c640 1 -- 172.21.15.52:0/522910082 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f18f0072ef0 msgr2=0x7f18f00753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:10.530 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f190a96c640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f18f0072ef0 0x7f18f00753b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18f8000fc0 tx=0x7f18f8009040 comp rx=0 tx=0).stop 2024-09-15T20:47:10.530 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f190a96c640 1 -- 172.21.15.52:0/522910082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1904138a00 msgr2=0x7f1904138e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:10.530 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f190a96c640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1904138a00 0x7f1904138e80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f19040717d0 tx=0x7f18fc00fd40 comp rx=0 tx=0).stop 2024-09-15T20:47:10.530 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f190a96c640 1 -- 172.21.15.52:0/522910082 shutdown_connections 2024-09-15T20:47:10.530 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f190a96c640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f18f0072ef0 0x7f18f00753b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.530 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f190a96c640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f1904138a00 0x7f1904138e80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.530 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f190a96c640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f190413aae0 0x7f190413af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.530 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f190a96c640 1 --2- 172.21.15.52:0/522910082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18ec004810 0x7f190413b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.530 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f190a96c640 1 -- 172.21.15.52:0/522910082 >> 172.21.15.52:0/522910082 conn(0x7f19040b5d20 msgr2=0x7f19041d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:10.530 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f190a96c640 1 -- 172.21.15.52:0/522910082 shutdown_connections 2024-09-15T20:47:10.531 INFO:teuthology.misc.health.smithi052.stderr:2024-09-15T20:47:10.525+0000 7f190a96c640 1 -- 172.21.15.52:0/522910082 wait complete. 2024-09-15T20:47:10.545 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-15T20:47:10.545 INFO:tasks.ceph:Creating RBD pool 2024-09-15T20:47:10.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-15T20:47:10.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff44f0cb640 1 Processor -- start 2024-09-15T20:47:10.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff44f0cb640 1 -- start start 2024-09-15T20:47:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff44f0cb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480b1730 0x7ff448074200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff44f0cb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff448073870 con 0x7ff4480723d0 2024-09-15T20:47:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff44f0cb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff448073b50 con 0x7ff4480b1350 2024-09-15T20:47:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff44f0cb640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ff448140a60 con 0x7ff4480b1730 2024-09-15T20:47:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff447fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480b1730 0x7ff448074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff447fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480b1730 0x7ff448074200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44646/0 (socket says 172.21.15.52:44646) 2024-09-15T20:47:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff44d668640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff4480723d0 0x7ff448074740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47338/0 (socket says 172.21.15.52:47338) 2024-09-15T20:47:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff447fff640 1 -- 172.21.15.52:0/2442526530 learned_addr learned my addr 172.21.15.52:0/2442526530 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:10.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff447fff640 1 -- 172.21.15.52:0/2442526530 >> v1:172.21.15.81:6789/0 conn(0x7ff4480b1350 legacy=0x7ff44813ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:10.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff447fff640 1 -- 172.21.15.52:0/2442526530 >> v1:172.21.15.52:6789/0 conn(0x7ff4480723d0 legacy=0x7ff448074740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:10.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff4477fe640 1 -- 172.21.15.52:0/2442526530 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 558865283 0 0) 0x7ff448073870 con 0x7ff4480723d0 2024-09-15T20:47:10.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.661+0000 7ff447fff640 1 -- 172.21.15.52:0/2442526530 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff44813d690 con 0x7ff4480b1730 2024-09-15T20:47:10.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff447fff640 1 --2- 172.21.15.52:0/2442526530 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480b1730 0x7ff448074200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00aa40 tx=0x7ff43c01d8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c83917db17b9542c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:10.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff4477fe640 1 -- 172.21.15.52:0/2442526530 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0b3070 con 0x7ff4480b1730 2024-09-15T20:47:10.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff4477fe640 1 -- 172.21.15.52:0/2442526530 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff43c0a6710 con 0x7ff4480b1730 2024-09-15T20:47:10.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff4477fe640 1 -- 172.21.15.52:0/2442526530 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43c00b040 con 0x7ff4480b1730 2024-09-15T20:47:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 -- 172.21.15.52:0/2442526530 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480b1730 msgr2=0x7ff448074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 --2- 172.21.15.52:0/2442526530 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480b1730 0x7ff448074200 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff43c00aa40 tx=0x7ff43c01d8c0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 -- 172.21.15.52:0/2442526530 shutdown_connections 2024-09-15T20:47:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 --2- 172.21.15.52:0/2442526530 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480b1730 0x7ff448074200 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 -- 172.21.15.52:0/2442526530 >> 172.21.15.52:0/2442526530 conn(0x7ff4480b1bb0 msgr2=0x7ff4480b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 -- 172.21.15.52:0/2442526530 shutdown_connections 2024-09-15T20:47:10.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 -- 172.21.15.52:0/2442526530 wait complete. 2024-09-15T20:47:10.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 Processor -- start 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 -- start start 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480723d0 0x7ff4480b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480b1350 0x7ff4481342c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff448134800 0x7ff448138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff44814e020 con 0x7ff448134800 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff44814dea0 con 0x7ff4480b1350 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ff44814e1a0 con 0x7ff4480723d0 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44ce67640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480723d0 0x7ff4480b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44d668640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff448134800 0x7ff448138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44ce67640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480723d0 0x7ff4480b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44648/0 (socket says 172.21.15.52:44648) 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44ce67640 1 -- 172.21.15.52:0/3491215528 learned_addr learned my addr 172.21.15.52:0/3491215528 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff447fff640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480b1350 0x7ff4481342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44ce67640 1 -- 172.21.15.52:0/3491215528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480b1350 msgr2=0x7ff4481342c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:10.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44ce67640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480b1350 0x7ff4481342c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44ce67640 1 -- 172.21.15.52:0/3491215528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff448134800 msgr2=0x7ff448138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44ce67640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff448134800 0x7ff448138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44ce67640 1 -- 172.21.15.52:0/3491215528 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4480ab2b0 con 0x7ff4480723d0 2024-09-15T20:47:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44d668640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff448134800 0x7ff448138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44ce67640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480723d0 0x7ff4480b3c90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c4b0 tx=0x7ff43800c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff4457fa640 1 -- 172.21.15.52:0/3491215528 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4380052d0 con 0x7ff4480723d0 2024-09-15T20:47:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff4457fa640 1 -- 172.21.15.52:0/3491215528 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff438005470 con 0x7ff4480723d0 2024-09-15T20:47:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 -- 172.21.15.52:0/3491215528 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4480ab590 con 0x7ff4480723d0 2024-09-15T20:47:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff4457fa640 1 -- 172.21.15.52:0/3491215528 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438012850 con 0x7ff4480723d0 2024-09-15T20:47:10.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.665+0000 7ff44f0cb640 1 -- 172.21.15.52:0/3491215528 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff448134c70 con 0x7ff4480723d0 2024-09-15T20:47:10.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.669+0000 7ff44f0cb640 1 -- 172.21.15.52:0/3491215528 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff44813ce90 con 0x7ff4480723d0 2024-09-15T20:47:10.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.669+0000 7ff4457fa640 1 -- 172.21.15.52:0/3491215528 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7ff4380129f0 con 0x7ff4480723d0 2024-09-15T20:47:10.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.669+0000 7ff4457fa640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff434072ec0 0x7ff434075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:10.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.669+0000 7ff4457fa640 1 -- 172.21.15.52:0/3491215528 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff4380934f0 con 0x7ff4480723d0 2024-09-15T20:47:10.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.669+0000 7ff447fff640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff434072ec0 0x7ff434075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:10.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.669+0000 7ff447fff640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff434072ec0 0x7ff434075380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0b0000 tx=0x7ff43c00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:10.675 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.673+0000 7ff4457fa640 1 -- 172.21.15.52:0/3491215528 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7ff43805ea10 con 0x7ff4480723d0 2024-09-15T20:47:10.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:10.845+0000 7ff44f0cb640 1 -- 172.21.15.52:0/3491215528 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7ff44813e010 con 0x7ff4480723d0 2024-09-15T20:47:11.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.449+0000 7ff4457fa640 1 -- 172.21.15.52:0/3491215528 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v19) ==== 109+0+0 (secure 0 0 0) 0x7ff43805e310 con 0x7ff4480723d0 2024-09-15T20:47:11.453 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'rbd' created 2024-09-15T20:47:11.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.453+0000 7ff44f0cb640 1 -- 172.21.15.52:0/3491215528 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff434072ec0 msgr2=0x7ff434075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:11.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.453+0000 7ff44f0cb640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff434072ec0 0x7ff434075380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0b0000 tx=0x7ff43c00c040 comp rx=0 tx=0).stop 2024-09-15T20:47:11.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.453+0000 7ff44f0cb640 1 -- 172.21.15.52:0/3491215528 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480723d0 msgr2=0x7ff4480b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:11.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.453+0000 7ff44f0cb640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480723d0 0x7ff4480b3c90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c4b0 tx=0x7ff43800c970 comp rx=0 tx=0).stop 2024-09-15T20:47:11.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.453+0000 7ff44f0cb640 1 -- 172.21.15.52:0/3491215528 shutdown_connections 2024-09-15T20:47:11.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.453+0000 7ff44f0cb640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff434072ec0 0x7ff434075380 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:11.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.453+0000 7ff44f0cb640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff448134800 0x7ff448138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:11.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.453+0000 7ff44f0cb640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4480b1350 0x7ff4481342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:11.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.453+0000 7ff44f0cb640 1 --2- 172.21.15.52:0/3491215528 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4480723d0 0x7ff4480b3c90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:11.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.453+0000 7ff44f0cb640 1 -- 172.21.15.52:0/3491215528 >> 172.21.15.52:0/3491215528 conn(0x7ff4480b1bb0 msgr2=0x7ff4481431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:11.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.453+0000 7ff44f0cb640 1 -- 172.21.15.52:0/3491215528 shutdown_connections 2024-09-15T20:47:11.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.453+0000 7ff44f0cb640 1 -- 172.21.15.52:0/3491215528 wait complete. 2024-09-15T20:47:11.476 DEBUG:teuthology.orchestra.run.smithi052:> rbd --cluster ceph pool init rbd 2024-09-15T20:47:11.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8779e81100 1 Processor -- start 2024-09-15T20:47:11.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8779e81100 1 -- start start 2024-09-15T20:47:11.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8779e81100 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55c566514140 0x55c5665a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:11.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8779e81100 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55c566356c80 con 0x55c5665acc60 2024-09-15T20:47:11.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8779e81100 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55c566514be0 con 0x55c566513d60 2024-09-15T20:47:11.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8779e81100 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x55c5663d8160 con 0x55c566514140 2024-09-15T20:47:11.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8779bec640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x55c5665acc60 0x55c5665a9630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47352/0 (socket says 172.21.15.52:47352) 2024-09-15T20:47:11.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8778189640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55c566514140 0x55c5665a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:11.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8779bec640 1 -- 172.21.15.52:0/2962614362 learned_addr learned my addr 172.21.15.52:0/2962614362 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:11.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8778189640 1 -- 172.21.15.52:0/2962614362 >> v1:172.21.15.81:6789/0 conn(0x55c566513d60 legacy=0x55c5665ac550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:11.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8777988640 1 -- 172.21.15.52:0/2962614362 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382579464 0 0) 0x55c566356c80 con 0x55c5665acc60 2024-09-15T20:47:11.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8778189640 1 -- 172.21.15.52:0/2962614362 >> v1:172.21.15.52:6789/0 conn(0x55c5665acc60 legacy=0x55c5665a9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:11.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.517+0000 7f8778189640 1 -- 172.21.15.52:0/2962614362 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c566514e50 con 0x55c566514140 2024-09-15T20:47:11.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8778189640 1 --2- 172.21.15.52:0/2962614362 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55c566514140 0x55c5665a90f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f876c00a530 tx=0x7f876c01b340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f9038d1accea78 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:11.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8777988640 1 -- 172.21.15.52:0/2962614362 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c0af070 con 0x55c566514140 2024-09-15T20:47:11.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8777988640 1 -- 172.21.15.52:0/2962614362 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876c0aa600 con 0x55c566514140 2024-09-15T20:47:11.525 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8777988640 1 -- 172.21.15.52:0/2962614362 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876c0aa9d0 con 0x55c566514140 2024-09-15T20:47:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 -- 172.21.15.52:0/2962614362 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55c566514140 msgr2=0x55c5665a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 --2- 172.21.15.52:0/2962614362 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55c566514140 0x55c5665a90f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f876c00a530 tx=0x7f876c01b340 comp rx=0 tx=0).stop 2024-09-15T20:47:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 -- 172.21.15.52:0/2962614362 shutdown_connections 2024-09-15T20:47:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 --2- 172.21.15.52:0/2962614362 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55c566514140 0x55c5665a90f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 -- 172.21.15.52:0/2962614362 >> 172.21.15.52:0/2962614362 conn(0x55c56651f1c0 msgr2=0x55c56651f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 -- 172.21.15.52:0/2962614362 shutdown_connections 2024-09-15T20:47:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 -- 172.21.15.52:0/2962614362 wait complete. 2024-09-15T20:47:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 Processor -- start 2024-09-15T20:47:11.526 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 -- start start 2024-09-15T20:47:11.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c566513d60 0x55c5665adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:11.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c566514140 0x55c5665164a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:11.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55c5665acc60 0x55c566517040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:11.528 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c5663dbf70 con 0x55c566514140 2024-09-15T20:47:11.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c5663e8d30 con 0x55c566513d60 2024-09-15T20:47:11.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.521+0000 7f8779e81100 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x55c56637da70 con 0x55c5665acc60 2024-09-15T20:47:11.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8778189640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c566514140 0x55c5665164a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:11.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8779bec640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55c5665acc60 0x55c566517040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:11.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8779bec640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55c5665acc60 0x55c566517040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44662/0 (socket says 172.21.15.52:44662) 2024-09-15T20:47:11.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8779bec640 1 -- 172.21.15.52:0/10760773 learned_addr learned my addr 172.21.15.52:0/10760773 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:11.529 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8778189640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c566514140 0x55c5665164a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45318/0 (socket says 172.21.15.52:45318) 2024-09-15T20:47:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f877898a640 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c566513d60 0x55c5665adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8779bec640 1 -- 172.21.15.52:0/10760773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c566513d60 msgr2=0x55c5665adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8779bec640 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c566513d60 0x55c5665adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8779bec640 1 -- 172.21.15.52:0/10760773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c566514140 msgr2=0x55c5665164a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8779bec640 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c566514140 0x55c5665164a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8779bec640 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5665af5e0 con 0x55c5665acc60 2024-09-15T20:47:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8778189640 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c566514140 0x55c5665164a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8779bec640 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55c5665acc60 0x55c566517040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8770002130 tx=0x7f877000b4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87700062d0 con 0x55c5665acc60 2024-09-15T20:47:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8770003460 con 0x55c5665acc60 2024-09-15T20:47:11.530 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c5665af8c0 con 0x55c5665acc60 2024-09-15T20:47:11.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87700038d0 con 0x55c5665acc60 2024-09-15T20:47:11.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55c5665afc00 con 0x55c5665acc60 2024-09-15T20:47:11.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f8770010070 con 0x55c5665acc60 2024-09-15T20:47:11.531 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8775183640 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f875c0717b0 0x7f875c073c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:11.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 5199+0+0 (secure 0 0 0) 0x7f8770091f70 con 0x55c5665acc60 2024-09-15T20:47:11.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f877898a640 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f875c0717b0 0x7f875c073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:11.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.525+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55c5665ae480 con 0x55c5665acc60 2024-09-15T20:47:11.532 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:11.529+0000 7f877898a640 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f875c0717b0 0x7f875c073c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8768000f70 tx=0x7f8768001840 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:12.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.453+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v20) ==== 141+0+0 (secure 0 0 0) 0x55c5665afc00 con 0x55c5665acc60 2024-09-15T20:47:12.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.453+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f876c0aa600 con 0x55c5665acc60 2024-09-15T20:47:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.457+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f87700594d0 con 0x55c5665acc60 2024-09-15T20:47:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.457+0000 7f8777187640 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=20}) -- 0x7f8754002af0 con 0x55c5665acc60 2024-09-15T20:47:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.457+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 <== mon.2 v2:172.21.15.52:3301/0 8 ==== osd_map(20..20 src has 1..20) ==== 658+0+0 (secure 0 0 0) 0x7f87700907b0 con 0x55c5665acc60 2024-09-15T20:47:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.457+0000 7f8779e81100 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x55c5665c2180 0x55c5665c2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:12.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.457+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20) -- 0x55c5665cb010 con 0x55c5665c2180 2024-09-15T20:47:12.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.461+0000 7f8778189640 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x55c5665c2180 0x55c5665c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:12.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.461+0000 7f8778189640 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x55c5665c2180 0x55c5665c2560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:12.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.469+0000 7f8778189640 1 -- 172.21.15.52:0/10760773 <== osd.3 v2:172.21.15.52:6808/4053631670 1 ==== osd_op_reply(1 rbd_trash [create] v20'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f876c0b2040 con 0x55c5665c2180 2024-09-15T20:47:12.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.473+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20) -- 0x55c56661d890 con 0x55c5665c2180 2024-09-15T20:47:12.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.473+0000 7f8778189640 1 -- 172.21.15.52:0/10760773 <== osd.3 v2:172.21.15.52:6808/4053631670 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f876c0b2040 con 0x55c5665c2180 2024-09-15T20:47:12.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.473+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20) -- 0x55c56661c850 con 0x55c5665c2180 2024-09-15T20:47:12.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.477+0000 7f8778189640 1 -- 172.21.15.52:0/10760773 <== osd.3 v2:172.21.15.52:6808/4053631670 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f876c0b2040 con 0x55c5665c2180 2024-09-15T20:47:12.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:12.477+0000 7f8776986640 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f8758001f10 con 0x55c5665acc60 2024-09-15T20:47:13.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:13.469+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 <== mon.2 v2:172.21.15.52:3301/0 9 ==== pool_op_reply(tid 4 (0) Success v21) ==== 55+0+0 (secure 0 0 0) 0x7f877007e420 con 0x55c5665acc60 2024-09-15T20:47:13.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:13.469+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=21}) -- 0x7f875c077ee0 con 0x55c5665acc60 2024-09-15T20:47:13.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:13.469+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 <== mon.2 v2:172.21.15.52:3301/0 10 ==== osd_map(21..21 src has 1..21) ==== 626+0+0 (secure 0 0 0) 0x7f877007a020 con 0x55c5665acc60 2024-09-15T20:47:13.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:13.469+0000 7f8777187640 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x7f87540057b0 con 0x55c5665c2180 2024-09-15T20:47:13.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:13.477+0000 7f8778189640 1 -- 172.21.15.52:0/10760773 <== osd.3 v2:172.21.15.52:6808/4053631670 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v21'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f876c0b2040 con 0x55c5665c2180 2024-09-15T20:47:13.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:13.477+0000 7f8776986640 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v21) -- 0x7f8758003360 con 0x55c5665acc60 2024-09-15T20:47:14.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.473+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 <== mon.2 v2:172.21.15.52:3301/0 11 ==== pool_op_reply(tid 6 (0) Success v22) ==== 43+0+0 (secure 0 0 0) 0x7f877005ce80 con 0x55c5665acc60 2024-09-15T20:47:14.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.473+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=22}) -- 0x7f875c0780b0 con 0x55c5665acc60 2024-09-15T20:47:14.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.473+0000 7f8775183640 1 -- 172.21.15.52:0/10760773 <== mon.2 v2:172.21.15.52:3301/0 12 ==== osd_map(22..22 src has 1..22) ==== 654+0+0 (secure 0 0 0) 0x7f87700662d0 con 0x55c5665acc60 2024-09-15T20:47:14.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.473+0000 7f8777187640 1 -- 172.21.15.52:0/10760773 --> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22) -- 0x7f8754005b50 con 0x55c5665c2180 2024-09-15T20:47:14.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.477+0000 7f8778189640 1 -- 172.21.15.52:0/10760773 <== osd.3 v2:172.21.15.52:6808/4053631670 5 ==== osd_op_reply(7 rbd_info [write 0~19] v22'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f876c0b2040 con 0x55c5665c2180 2024-09-15T20:47:14.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.477+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x55c5665c2180 msgr2=0x55c5665c2560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:14.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.477+0000 7f8779e81100 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x55c5665c2180 0x55c5665c2560 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:14.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.477+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f875c0717b0 msgr2=0x7f875c073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:14.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.477+0000 7f8779e81100 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f875c0717b0 0x7f875c073c70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8768000f70 tx=0x7f8768001840 comp rx=0 tx=0).stop 2024-09-15T20:47:14.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.477+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55c5665acc60 msgr2=0x55c566517040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:14.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.477+0000 7f8779e81100 1 --2- 172.21.15.52:0/10760773 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x55c5665acc60 0x55c566517040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8770002130 tx=0x7f877000b4b0 comp rx=0 tx=0).stop 2024-09-15T20:47:14.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.477+0000 7f8779bec640 1 -- 172.21.15.52:0/10760773 reap_dead start 2024-09-15T20:47:14.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.477+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 shutdown_connections 2024-09-15T20:47:14.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.477+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 >> 172.21.15.52:0/10760773 conn(0x55c56651f1c0 msgr2=0x55c5665b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:14.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.477+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 shutdown_connections 2024-09-15T20:47:14.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.477+0000 7f8779e81100 1 -- 172.21.15.52:0/10760773 wait complete. 2024-09-15T20:47:14.500 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T20:47:14.501 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-15T20:47:14.501 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T20:47:14.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba388f640 1 Processor -- start 2024-09-15T20:47:14.677 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba388f640 1 -- start start 2024-09-15T20:47:14.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba388f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06e7c0 0x7fdb9c1408c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:14.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba388f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb9c140e00 0x7fdb9c1472b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:14.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba388f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb9c073310 con 0x7fdb9c06eba0 2024-09-15T20:47:14.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba388f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fdb9c06f940 con 0x7fdb9c140e00 2024-09-15T20:47:14.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba388f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fdb9c06f5d0 con 0x7fdb9c06e7c0 2024-09-15T20:47:14.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba162b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06e7c0 0x7fdb9c1408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:14.678 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba1e2c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb9c140e00 0x7fdb9c1472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:14.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba1e2c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb9c140e00 0x7fdb9c1472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45324/0 (socket says 172.21.15.52:45324) 2024-09-15T20:47:14.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba0e2a640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdb9c06eba0 0x7fdb9c146ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47362/0 (socket says 172.21.15.52:47362) 2024-09-15T20:47:14.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba162b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06e7c0 0x7fdb9c1408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44668/0 (socket says 172.21.15.52:44668) 2024-09-15T20:47:14.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.673+0000 7fdba1e2c640 1 -- 172.21.15.52:0/3129180156 learned_addr learned my addr 172.21.15.52:0/3129180156 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:14.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba1e2c640 1 -- 172.21.15.52:0/3129180156 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06e7c0 msgr2=0x7fdb9c1408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:14.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba1e2c640 1 --2- 172.21.15.52:0/3129180156 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06e7c0 0x7fdb9c1408c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:14.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba1e2c640 1 -- 172.21.15.52:0/3129180156 >> v1:172.21.15.52:6789/0 conn(0x7fdb9c06eba0 legacy=0x7fdb9c146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:14.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba1e2c640 1 -- 172.21.15.52:0/3129180156 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9c1477f0 con 0x7fdb9c140e00 2024-09-15T20:47:14.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdb93fff640 1 -- 172.21.15.52:0/3129180156 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 114650952 0 0) 0x7fdb9c073310 con 0x7fdb9c06eba0 2024-09-15T20:47:14.679 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba162b640 1 --2- 172.21.15.52:0/3129180156 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06e7c0 0x7fdb9c1408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:14.680 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba1e2c640 1 --2- 172.21.15.52:0/3129180156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c140e00 0x7fdb9c1472b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009e50 tx=0x7fdb9401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d391f1d2dad43f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:14.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdb93fff640 1 -- 172.21.15.52:0/3129180156 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb940a57f0 con 0x7fdb9c140e00 2024-09-15T20:47:14.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdb93fff640 1 -- 172.21.15.52:0/3129180156 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb940a5990 con 0x7fdb9c140e00 2024-09-15T20:47:14.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdb93fff640 1 -- 172.21.15.52:0/3129180156 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb940a5d60 con 0x7fdb9c140e00 2024-09-15T20:47:14.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba388f640 1 -- 172.21.15.52:0/3129180156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c140e00 msgr2=0x7fdb9c1472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:14.681 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba388f640 1 --2- 172.21.15.52:0/3129180156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c140e00 0x7fdb9c1472b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009e50 tx=0x7fdb9401ca10 comp rx=0 tx=0).stop 2024-09-15T20:47:14.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba388f640 1 -- 172.21.15.52:0/3129180156 shutdown_connections 2024-09-15T20:47:14.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba388f640 1 --2- 172.21.15.52:0/3129180156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c140e00 0x7fdb9c1472b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:14.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba388f640 1 --2- 172.21.15.52:0/3129180156 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06e7c0 0x7fdb9c1408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:14.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba388f640 1 -- 172.21.15.52:0/3129180156 >> 172.21.15.52:0/3129180156 conn(0x7fdb9c0b7750 msgr2=0x7fdb9c0b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:14.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba388f640 1 -- 172.21.15.52:0/3129180156 shutdown_connections 2024-09-15T20:47:14.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.677+0000 7fdba388f640 1 -- 172.21.15.52:0/3129180156 wait complete. 2024-09-15T20:47:14.682 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba388f640 1 Processor -- start 2024-09-15T20:47:14.683 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba388f640 1 -- start start 2024-09-15T20:47:14.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba388f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb9c06e7c0 0x7fdb9c13daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:14.684 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba388f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06eba0 0x7fdb9c134540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:14.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba388f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c140e00 0x7fdb9c134a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:14.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba388f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c1509e0 con 0x7fdb9c140e00 2024-09-15T20:47:14.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba388f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9c150860 con 0x7fdb9c06e7c0 2024-09-15T20:47:14.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba388f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fdb9c150b60 con 0x7fdb9c06eba0 2024-09-15T20:47:14.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba0e2a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06eba0 0x7fdb9c134540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:14.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba1e2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c140e00 0x7fdb9c134a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:14.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba0e2a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06eba0 0x7fdb9c134540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44680/0 (socket says 172.21.15.52:44680) 2024-09-15T20:47:14.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba1e2c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c140e00 0x7fdb9c134a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45330/0 (socket says 172.21.15.52:45330) 2024-09-15T20:47:14.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba0e2a640 1 -- 172.21.15.52:0/3680504307 learned_addr learned my addr 172.21.15.52:0/3680504307 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:14.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba162b640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb9c06e7c0 0x7fdb9c13daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:14.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba1e2c640 1 -- 172.21.15.52:0/3680504307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06eba0 msgr2=0x7fdb9c134540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:14.685 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba1e2c640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06eba0 0x7fdb9c134540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:14.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba1e2c640 1 -- 172.21.15.52:0/3680504307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb9c06e7c0 msgr2=0x7fdb9c13daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:14.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba1e2c640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb9c06e7c0 0x7fdb9c13daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:14.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba1e2c640 1 -- 172.21.15.52:0/3680504307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9c13e030 con 0x7fdb9c140e00 2024-09-15T20:47:14.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba162b640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb9c06e7c0 0x7fdb9c13daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:47:14.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba0e2a640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06eba0 0x7fdb9c134540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:14.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba1e2c640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c140e00 0x7fdb9c134a80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdb940ab000 tx=0x7fdb940197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:14.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdb91ffb640 1 -- 172.21.15.52:0/3680504307 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb940bc030 con 0x7fdb9c140e00 2024-09-15T20:47:14.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdb91ffb640 1 -- 172.21.15.52:0/3680504307 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb940b8680 con 0x7fdb9c140e00 2024-09-15T20:47:14.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdb91ffb640 1 -- 172.21.15.52:0/3680504307 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb94009510 con 0x7fdb9c140e00 2024-09-15T20:47:14.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba388f640 1 -- 172.21.15.52:0/3680504307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9c142280 con 0x7fdb9c140e00 2024-09-15T20:47:14.686 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba388f640 1 -- 172.21.15.52:0/3680504307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb9c134fc0 con 0x7fdb9c140e00 2024-09-15T20:47:14.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.681+0000 7fdba388f640 1 -- 172.21.15.52:0/3680504307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb9c1408c0 con 0x7fdb9c140e00 2024-09-15T20:47:14.687 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.685+0000 7fdb91ffb640 1 -- 172.21.15.52:0/3680504307 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fdb940bf070 con 0x7fdb9c140e00 2024-09-15T20:47:14.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.685+0000 7fdb91ffb640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fdb80072ec0 0x7fdb80075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:14.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.685+0000 7fdb91ffb640 1 -- 172.21.15.52:0/3680504307 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7fdb9412f1a0 con 0x7fdb9c140e00 2024-09-15T20:47:14.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.685+0000 7fdba162b640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fdb80072ec0 0x7fdb80075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:14.688 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.685+0000 7fdba162b640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fdb80072ec0 0x7fdb80075380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009a40 tx=0x7fdb98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:14.691 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.689+0000 7fdb91ffb640 1 -- 172.21.15.52:0/3680504307 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fdb94016600 con 0x7fdb9c140e00 2024-09-15T20:47:14.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.861+0000 7fdba388f640 1 -- 172.21.15.52:0/3680504307 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fdb9c13e980 con 0x7fdb9c140e00 2024-09-15T20:47:14.864 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.861+0000 7fdb91ffb640 1 -- 172.21.15.52:0/3680504307 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v6) ==== 86+0+159 (secure 0 0 0) 0x7fdb940fa630 con 0x7fdb9c140e00 2024-09-15T20:47:14.865 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:47:14.867 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.865+0000 7fdba388f640 1 -- 172.21.15.52:0/3680504307 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fdb80072ec0 msgr2=0x7fdb80075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.865+0000 7fdba388f640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fdb80072ec0 0x7fdb80075380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009a40 tx=0x7fdb98008040 comp rx=0 tx=0).stop 2024-09-15T20:47:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.865+0000 7fdba388f640 1 -- 172.21.15.52:0/3680504307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c140e00 msgr2=0x7fdb9c134a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.865+0000 7fdba388f640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c140e00 0x7fdb9c134a80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdb940ab000 tx=0x7fdb940197b0 comp rx=0 tx=0).stop 2024-09-15T20:47:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.865+0000 7fdba388f640 1 -- 172.21.15.52:0/3680504307 shutdown_connections 2024-09-15T20:47:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.865+0000 7fdba388f640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fdb80072ec0 0x7fdb80075380 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.865+0000 7fdba388f640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb9c140e00 0x7fdb9c134a80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.865+0000 7fdba388f640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fdb9c06eba0 0x7fdb9c134540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.865+0000 7fdba388f640 1 --2- 172.21.15.52:0/3680504307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb9c06e7c0 0x7fdb9c13daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.865+0000 7fdba388f640 1 -- 172.21.15.52:0/3680504307 >> 172.21.15.52:0/3680504307 conn(0x7fdb9c0b7750 msgr2=0x7fdb9c074030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.865+0000 7fdba388f640 1 -- 172.21.15.52:0/3680504307 shutdown_connections 2024-09-15T20:47:14.868 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:14.865+0000 7fdba388f640 1 -- 172.21.15.52:0/3680504307 wait complete. 2024-09-15T20:47:14.885 INFO:teuthology.orchestra.run.smithi052.stdout:[{"version":6,"timestamp":"2024-09-15T20:47:03.392561+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"5756.116664"}]}] 2024-09-15T20:47:14.885 INFO:tasks.ceph_manager:config epoch is 6 2024-09-15T20:47:14.885 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T20:47:14.885 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T20:47:14.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T20:47:15.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0da1e36640 1 Processor -- start 2024-09-15T20:47:15.003 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0da1e36640 1 -- start start 2024-09-15T20:47:15.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0da1e36640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0d9c0b2bf0 0x7f0d9c13af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0da1e36640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c0b2fd0 0x7f0d9c144900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0da1e36640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d9c0aa660 con 0x7f0d9c13b4c0 2024-09-15T20:47:15.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0da1e36640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0d9c13eec0 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.004 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0da1e36640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c073c90 con 0x7f0d9c0b2fd0 2024-09-15T20:47:15.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0d9affd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c0b2fd0 0x7f0d9c144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0d9affd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c0b2fd0 0x7f0d9c144900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44696/0 (socket says 172.21.15.52:44696) 2024-09-15T20:47:15.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0d9affd640 1 -- 172.21.15.52:0/721040742 learned_addr learned my addr 172.21.15.52:0/721040742 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:15.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0d9b7fe640 1 --2- 172.21.15.52:0/721040742 >> v2:172.21.15.52:3300/0 conn(0x7f0d9c0b2bf0 0x7f0d9c13af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0d9affd640 1 -- 172.21.15.52:0/721040742 >> v2:172.21.15.52:3300/0 conn(0x7f0d9c0b2bf0 msgr2=0x7f0d9c13af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:15.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0d9affd640 1 --2- 172.21.15.52:0/721040742 >> v2:172.21.15.52:3300/0 conn(0x7f0d9c0b2bf0 0x7f0d9c13af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0d9affd640 1 -- 172.21.15.52:0/721040742 >> v1:172.21.15.81:6789/0 conn(0x7f0d9c13b4c0 legacy=0x7f0d9c144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:15.005 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.001+0000 7f0d9affd640 1 -- 172.21.15.52:0/721040742 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c0b3710 con 0x7f0d9c0b2fd0 2024-09-15T20:47:15.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9affd640 1 --2- 172.21.15.52:0/721040742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c0b2fd0 0x7f0d9c144900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009870 tx=0x7f0d9001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff2497a47a30dae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:15.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9a7fc640 1 -- 172.21.15.52:0/721040742 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d900b0070 con 0x7f0d9c0b2fd0 2024-09-15T20:47:15.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9a7fc640 1 -- 172.21.15.52:0/721040742 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d900ab600 con 0x7f0d9c0b2fd0 2024-09-15T20:47:15.006 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9a7fc640 1 -- 172.21.15.52:0/721040742 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d900ab9d0 con 0x7f0d9c0b2fd0 2024-09-15T20:47:15.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 -- 172.21.15.52:0/721040742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c0b2fd0 msgr2=0x7f0d9c144900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 --2- 172.21.15.52:0/721040742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c0b2fd0 0x7f0d9c144900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009870 tx=0x7f0d9001c4b0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 -- 172.21.15.52:0/721040742 shutdown_connections 2024-09-15T20:47:15.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 --2- 172.21.15.52:0/721040742 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c0b2fd0 0x7f0d9c144900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.007 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 --2- 172.21.15.52:0/721040742 >> v2:172.21.15.52:3300/0 conn(0x7f0d9c0b2bf0 0x7f0d9c13af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 -- 172.21.15.52:0/721040742 >> 172.21.15.52:0/721040742 conn(0x7f0d9c0b3ce0 msgr2=0x7f0d9c0b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:15.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 -- 172.21.15.52:0/721040742 shutdown_connections 2024-09-15T20:47:15.008 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 -- 172.21.15.52:0/721040742 wait complete. 2024-09-15T20:47:15.010 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 Processor -- start 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 -- start start 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c0b2bf0 0x7f0d9c06f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c13b4c0 0x7f0d9c06f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c14a550 0x7f0d9c1deda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c14e840 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c14e6c0 con 0x7f0d9c13b4c0 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c14e9c0 con 0x7f0d9c14a550 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c0b2bf0 0x7f0d9c06f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9bfff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c14a550 0x7f0d9c1deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c0b2bf0 0x7f0d9c06f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45350/0 (socket says 172.21.15.52:45350) 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9b7fe640 1 -- 172.21.15.52:0/1424737682 learned_addr learned my addr 172.21.15.52:0/1424737682 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9affd640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c13b4c0 0x7f0d9c06f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.011 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9b7fe640 1 -- 172.21.15.52:0/1424737682 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c14a550 msgr2=0x7f0d9c1deda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9b7fe640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c14a550 0x7f0d9c1deda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9b7fe640 1 -- 172.21.15.52:0/1424737682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c13b4c0 msgr2=0x7f0d9c06f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9b7fe640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c13b4c0 0x7f0d9c06f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9b7fe640 1 -- 172.21.15.52:0/1424737682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c0ab930 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9bfff640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c14a550 0x7f0d9c1deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d9b7fe640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c0b2bf0 0x7f0d9c06f010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00d830 tx=0x7f0d8c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d83fff640 1 -- 172.21.15.52:0/1424737682 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00b660 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d83fff640 1 -- 172.21.15.52:0/1424737682 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d8c019070 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0da1e36640 1 -- 172.21.15.52:0/1424737682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c06fab0 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.005+0000 7f0d83fff640 1 -- 172.21.15.52:0/1424737682 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00ba00 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.009+0000 7f0da1e36640 1 -- 172.21.15.52:0/1424737682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c1df500 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.012 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.009+0000 7f0da1e36640 1 -- 172.21.15.52:0/1424737682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9c13af80 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.009+0000 7f0d83fff640 1 -- 172.21.15.52:0/1424737682 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f0d8c01e460 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.009+0000 7f0d83fff640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0d88072ec0 0x7f0d88075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.009+0000 7f0d83fff640 1 -- 172.21.15.52:0/1424737682 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f0d8c094020 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.009+0000 7f0d9affd640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0d88072ec0 0x7f0d88075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.009+0000 7f0d9affd640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0d88072ec0 0x7f0d88075380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d900ad000 tx=0x7f0d90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:15.017 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.013+0000 7f0d83fff640 1 -- 172.21.15.52:0/1424737682 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f0d8c05f420 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.229+0000 7f0da1e36640 1 -- 172.21.15.52:0/1424737682 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0d9c076dd0 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.233+0000 7f0d83fff640 1 -- 172.21.15.52:0/1424737682 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+186082 (secure 0 0 0) 0x7f0d8c05ed20 con 0x7f0d9c0b2bf0 2024-09-15T20:47:15.239 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:47:15.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.237+0000 7f0da1e36640 1 -- 172.21.15.52:0/1424737682 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0d88072ec0 msgr2=0x7f0d88075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.237+0000 7f0da1e36640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0d88072ec0 0x7f0d88075380 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d900ad000 tx=0x7f0d90008040 comp rx=0 tx=0).stop 2024-09-15T20:47:15.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.237+0000 7f0da1e36640 1 -- 172.21.15.52:0/1424737682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c0b2bf0 msgr2=0x7f0d9c06f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.237+0000 7f0da1e36640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c0b2bf0 0x7f0d9c06f010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00d830 tx=0x7f0d8c00dcf0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.237+0000 7f0da1e36640 1 -- 172.21.15.52:0/1424737682 shutdown_connections 2024-09-15T20:47:15.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.237+0000 7f0da1e36640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0d88072ec0 0x7f0d88075380 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.237+0000 7f0da1e36640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d9c14a550 0x7f0d9c1deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.237+0000 7f0da1e36640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d9c13b4c0 0x7f0d9c06f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.237+0000 7f0da1e36640 1 --2- 172.21.15.52:0/1424737682 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d9c0b2bf0 0x7f0d9c06f010 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.237+0000 7f0da1e36640 1 -- 172.21.15.52:0/1424737682 >> 172.21.15.52:0/1424737682 conn(0x7f0d9c0b3ce0 msgr2=0x7f0d9c144b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:15.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.237+0000 7f0da1e36640 1 -- 172.21.15.52:0/1424737682 shutdown_connections 2024-09-15T20:47:15.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.237+0000 7f0da1e36640 1 -- 172.21.15.52:0/1424737682 wait complete. 2024-09-15T20:47:15.256 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3693261179},{"type":"v1","addr":"172.21.15.81:6833","nonce":3693261179}]},"active_addr":"172.21.15.81:6833/3693261179","active_change":"2024-09-15T20:46:57.204258+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":177819601}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3738239398}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2435282546}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":4027226578}]}]} 2024-09-15T20:47:15.263 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T20:47:15.263 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T20:47:15.263 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T20:47:15.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff67eb08640 1 Processor -- start 2024-09-15T20:47:15.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff67eb08640 1 -- start start 2024-09-15T20:47:15.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff67eb08640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff6780b04a0 0x7ff678143770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff67eb08640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff678140dc0 0x7ff678143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff67eb08640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6780b10c0 con 0x7ff678068c30 2024-09-15T20:47:15.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff67eb08640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff678069010 con 0x7ff6780b04a0 2024-09-15T20:47:15.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff67eb08640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff6781412b0 con 0x7ff678140dc0 2024-09-15T20:47:15.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff66ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff6780b04a0 0x7ff678143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff66ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff6780b04a0 0x7ff678143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45366/0 (socket says 172.21.15.52:45366) 2024-09-15T20:47:15.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff66ffff640 1 -- 172.21.15.52:0/1926621278 learned_addr learned my addr 172.21.15.52:0/1926621278 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:15.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff67d0a5640 1 --2- 172.21.15.52:0/1926621278 >> v2:172.21.15.81:3300/0 conn(0x7ff678140dc0 0x7ff678143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff66ffff640 1 -- 172.21.15.52:0/1926621278 >> v2:172.21.15.81:3300/0 conn(0x7ff678140dc0 msgr2=0x7ff678143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:15.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff66ffff640 1 --2- 172.21.15.52:0/1926621278 >> v2:172.21.15.81:3300/0 conn(0x7ff678140dc0 0x7ff678143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff66ffff640 1 -- 172.21.15.52:0/1926621278 >> v1:172.21.15.81:6789/0 conn(0x7ff678068c30 legacy=0x7ff6781406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:15.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.377+0000 7ff66ffff640 1 -- 172.21.15.52:0/1926621278 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6780b0930 con 0x7ff6780b04a0 2024-09-15T20:47:15.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66ffff640 1 --2- 172.21.15.52:0/1926621278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6780b04a0 0x7ff678143770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6780afbf0 tx=0x7ff66801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148914eb9554e54a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:15.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66f7fe640 1 -- 172.21.15.52:0/1926621278 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6680b1070 con 0x7ff6780b04a0 2024-09-15T20:47:15.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66f7fe640 1 -- 172.21.15.52:0/1926621278 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6680ac630 con 0x7ff6780b04a0 2024-09-15T20:47:15.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66f7fe640 1 -- 172.21.15.52:0/1926621278 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6680a8050 con 0x7ff6780b04a0 2024-09-15T20:47:15.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 -- 172.21.15.52:0/1926621278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6780b04a0 msgr2=0x7ff678143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 --2- 172.21.15.52:0/1926621278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6780b04a0 0x7ff678143770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6780afbf0 tx=0x7ff66801c500 comp rx=0 tx=0).stop 2024-09-15T20:47:15.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 -- 172.21.15.52:0/1926621278 shutdown_connections 2024-09-15T20:47:15.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 --2- 172.21.15.52:0/1926621278 >> v2:172.21.15.81:3300/0 conn(0x7ff678140dc0 0x7ff678143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 --2- 172.21.15.52:0/1926621278 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff6780b04a0 0x7ff678143770 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 -- 172.21.15.52:0/1926621278 >> 172.21.15.52:0/1926621278 conn(0x7ff67806d630 msgr2=0x7ff6780b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:15.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 -- 172.21.15.52:0/1926621278 shutdown_connections 2024-09-15T20:47:15.383 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 -- 172.21.15.52:0/1926621278 wait complete. 2024-09-15T20:47:15.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 Processor -- start 2024-09-15T20:47:15.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 -- start start 2024-09-15T20:47:15.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff678068c30 0x7ff6781489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff678140dc0 0x7ff6781496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff678145f30 0x7ff6781df170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff678150c30 con 0x7ff678145f30 2024-09-15T20:47:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff678150ab0 con 0x7ff678068c30 2024-09-15T20:47:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ff678150db0 con 0x7ff678140dc0 2024-09-15T20:47:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff678140dc0 0x7ff6781496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67d0a5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff678145f30 0x7ff6781df170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff678140dc0 0x7ff6781496e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44716/0 (socket says 172.21.15.52:44716) 2024-09-15T20:47:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66ffff640 1 -- 172.21.15.52:0/3625226192 learned_addr learned my addr 172.21.15.52:0/3625226192 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67c8a4640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff678068c30 0x7ff6781489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66ffff640 1 -- 172.21.15.52:0/3625226192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff678068c30 msgr2=0x7ff6781489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66ffff640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff678068c30 0x7ff6781489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66ffff640 1 -- 172.21.15.52:0/3625226192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff678145f30 msgr2=0x7ff6781df170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66ffff640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff678145f30 0x7ff6781df170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66ffff640 1 -- 172.21.15.52:0/3625226192 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67814a580 con 0x7ff678140dc0 2024-09-15T20:47:15.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66ffff640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff678140dc0 0x7ff6781496e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff66801cda0 tx=0x7ff6680192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:15.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66d7fa640 1 -- 172.21.15.52:0/3625226192 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6680b1040 con 0x7ff678140dc0 2024-09-15T20:47:15.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66d7fa640 1 -- 172.21.15.52:0/3625226192 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6680ba070 con 0x7ff678140dc0 2024-09-15T20:47:15.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 -- 172.21.15.52:0/3625226192 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67814a860 con 0x7ff678140dc0 2024-09-15T20:47:15.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff66d7fa640 1 -- 172.21.15.52:0/3625226192 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6680a8040 con 0x7ff678140dc0 2024-09-15T20:47:15.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.381+0000 7ff67eb08640 1 -- 172.21.15.52:0/3625226192 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67814ae20 con 0x7ff678140dc0 2024-09-15T20:47:15.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.385+0000 7ff67eb08640 1 -- 172.21.15.52:0/3625226192 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6781406b0 con 0x7ff678140dc0 2024-09-15T20:47:15.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.385+0000 7ff66d7fa640 1 -- 172.21.15.52:0/3625226192 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7ff6680b5660 con 0x7ff678140dc0 2024-09-15T20:47:15.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.385+0000 7ff66d7fa640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff664072ec0 0x7ff664075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.385+0000 7ff66d7fa640 1 -- 172.21.15.52:0/3625226192 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7ff66812e2d0 con 0x7ff678140dc0 2024-09-15T20:47:15.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.385+0000 7ff67c8a4640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff664072ec0 0x7ff664075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.385+0000 7ff67c8a4640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff664072ec0 0x7ff664075380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff674004e30 tx=0x7ff674009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:15.391 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.389+0000 7ff66d7fa640 1 -- 172.21.15.52:0/3625226192 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7ff6680160f0 con 0x7ff678140dc0 2024-09-15T20:47:15.565 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.561+0000 7ff67eb08640 1 -- 172.21.15.52:0/3625226192 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6780afd10 con 0x7ff678140dc0 2024-09-15T20:47:15.566 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.561+0000 7ff66d7fa640 1 -- 172.21.15.52:0/3625226192 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+14837 (secure 0 0 0) 0x7ff6680f9740 con 0x7ff678140dc0 2024-09-15T20:47:15.566 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:47:15.566 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"5b0b6dfd-6a20-4023-acf9-e3c53f9607bc","created":"2024-09-15T20:46:52.315149+0000","modified":"2024-09-15T20:47:14.465562+0000","last_up_change":"2024-09-15T20:47:04.394216+0000","last_in_change":"2024-09-15T20:46:54.803112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T20:47:05.257147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T20:47:10.855815+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b99fda03-8405-4cd4-aea3-a8cc67bc0fe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6801","nonce":1039594647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6803","nonce":1039594647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6807","nonce":1039594647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6805","nonce":1039594647}]},"public_addr":"172.21.15.52:6801/1039594647","cluster_addr":"172.21.15.52:6803/1039594647","heartbeat_back_addr":"172.21.15.52:6807/1039594647","heartbeat_front_addr":"172.21.15.52:6805/1039594647","state":["exists","up"]},{"osd":1,"uuid":"1d555c27-c8c2-4d30-9a50-be7cf9a60db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6817","nonce":1590363289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6819","nonce":1590363289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6823","nonce":1590363289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6821","nonce":1590363289}]},"public_addr":"172.21.15.52:6817/1590363289","cluster_addr":"172.21.15.52:6819/1590363289","heartbeat_back_addr":"172.21.15.52:6823/1590363289","heartbeat_front_addr":"172.21.15.52:6821/1590363289","state":["exists","up"]},{"osd":2,"uuid":"8d5f33c4-cf45-4c87-b9ea-f0b474dfcada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6825","nonce":4164590883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6827","nonce":4164590883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6831","nonce":4164590883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6829","nonce":4164590883}]},"public_addr":"172.21.15.52:6825/4164590883","cluster_addr":"172.21.15.52:6827/4164590883","heartbeat_back_addr":"172.21.15.52:6831/4164590883","heartbeat_front_addr":"172.21.15.52:6829/4164590883","state":["exists","up"]},{"osd":3,"uuid":"d9b51207-4514-4bfd-967c-32040c0b196f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6809","nonce":4053631670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6811","nonce":4053631670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6815","nonce":4053631670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6813","nonce":4053631670}]},"public_addr":"172.21.15.52:6809/4053631670","cluster_addr":"172.21.15.52:6811/4053631670","heartbeat_back_addr":"172.21.15.52:6815/4053631670","heartbeat_front_addr":"172.21.15.52:6813/4053631670","state":["exists","up"]},{"osd":4,"uuid":"bb2fcd47-4202-4b5c-ad02-5dfbe865cbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6817","nonce":1105997015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6819","nonce":1105997015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6823","nonce":1105997015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6821","nonce":1105997015}]},"public_addr":"172.21.15.81:6817/1105997015","cluster_addr":"172.21.15.81:6819/1105997015","heartbeat_back_addr":"172.21.15.81:6823/1105997015","heartbeat_front_addr":"172.21.15.81:6821/1105997015","state":["exists","up"]},{"osd":5,"uuid":"59599740-63cf-4e26-abb0-fe542c98671a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6809","nonce":1585962119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6811","nonce":1585962119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6815","nonce":1585962119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6813","nonce":1585962119}]},"public_addr":"172.21.15.81:6809/1585962119","cluster_addr":"172.21.15.81:6811/1585962119","heartbeat_back_addr":"172.21.15.81:6815/1585962119","heartbeat_front_addr":"172.21.15.81:6813/1585962119","state":["exists","up"]},{"osd":6,"uuid":"daebb41e-6be2-4689-b9c4-ba5271f2ce69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6801","nonce":1367983121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6803","nonce":1367983121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6807","nonce":1367983121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6805","nonce":1367983121}]},"public_addr":"172.21.15.81:6801/1367983121","cluster_addr":"172.21.15.81:6803/1367983121","heartbeat_back_addr":"172.21.15.81:6807/1367983121","heartbeat_front_addr":"172.21.15.81:6805/1367983121","state":["exists","up"]},{"osd":7,"uuid":"ed8914a3-1f7c-4942-bd5e-0453369f009b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6825","nonce":579210364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6827","nonce":579210364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6831","nonce":579210364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6829","nonce":579210364}]},"public_addr":"172.21.15.81:6825/579210364","cluster_addr":"172.21.15.81:6827/579210364","heartbeat_back_addr":"172.21.15.81:6831/579210364","heartbeat_front_addr":"172.21.15.81:6829/579210364","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.527985+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.518897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.982136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.494599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.327079+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.271634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.089410+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.736530+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T20:47:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.565+0000 7ff67eb08640 1 -- 172.21.15.52:0/3625226192 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff664072ec0 msgr2=0x7ff664075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.565+0000 7ff67eb08640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff664072ec0 0x7ff664075380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff674004e30 tx=0x7ff674009040 comp rx=0 tx=0).stop 2024-09-15T20:47:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.565+0000 7ff67eb08640 1 -- 172.21.15.52:0/3625226192 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff678140dc0 msgr2=0x7ff6781496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.565+0000 7ff67eb08640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff678140dc0 0x7ff6781496e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff66801cda0 tx=0x7ff6680192a0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.565+0000 7ff67eb08640 1 -- 172.21.15.52:0/3625226192 shutdown_connections 2024-09-15T20:47:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.565+0000 7ff67eb08640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff664072ec0 0x7ff664075380 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.565+0000 7ff67eb08640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff678145f30 0x7ff6781df170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.565+0000 7ff67eb08640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff678140dc0 0x7ff6781496e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.565+0000 7ff67eb08640 1 --2- 172.21.15.52:0/3625226192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff678068c30 0x7ff6781489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.565+0000 7ff67eb08640 1 -- 172.21.15.52:0/3625226192 >> 172.21.15.52:0/3625226192 conn(0x7ff67806d630 msgr2=0x7ff6780b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:15.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.565+0000 7ff67eb08640 1 -- 172.21.15.52:0/3625226192 shutdown_connections 2024-09-15T20:47:15.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.565+0000 7ff67eb08640 1 -- 172.21.15.52:0/3625226192 wait complete. 2024-09-15T20:47:15.586 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T20:47:15.586 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T20:47:15.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f24020c7640 1 Processor -- start 2024-09-15T20:47:15.711 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f24020c7640 1 -- start start 2024-09-15T20:47:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f24020c7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23fc0b2630 0x7f23fc070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f24020c7640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23fc145300 0x7f23fc13ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f24020c7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23fc145730 con 0x7f23fc13e630 2024-09-15T20:47:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f24020c7640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f23fc0b2a10 con 0x7f23fc145300 2024-09-15T20:47:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f24020c7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f23fc141290 con 0x7f23fc0b2630 2024-09-15T20:47:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f23fbfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23fc145300 0x7f23fc13ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f23fbfff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f23fc145300 0x7f23fc13ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45390/0 (socket says 172.21.15.52:45390) 2024-09-15T20:47:15.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f23fbfff640 1 -- 172.21.15.52:0/1052088820 learned_addr learned my addr 172.21.15.52:0/1052088820 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:15.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/1052088820 >> v2:172.21.15.81:3300/0 conn(0x7f23fc0b2630 0x7f23fc070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f23fbfff640 1 -- 172.21.15.52:0/1052088820 >> v2:172.21.15.81:3300/0 conn(0x7f23fc0b2630 msgr2=0x7f23fc070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:15.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f23fbfff640 1 --2- 172.21.15.52:0/1052088820 >> v2:172.21.15.81:3300/0 conn(0x7f23fc0b2630 0x7f23fc070900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f23fbfff640 1 -- 172.21.15.52:0/1052088820 >> v1:172.21.15.81:6789/0 conn(0x7f23fc13e630 legacy=0x7f23fc144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.709+0000 7f23fbfff640 1 -- 172.21.15.52:0/1052088820 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc074fe0 con 0x7f23fc145300 2024-09-15T20:47:15.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fbfff640 1 --2- 172.21.15.52:0/1052088820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc145300 0x7f23fc13ea60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0b2bd0 tx=0x7f23f401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbc1b6510684ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:15.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fa7fc640 1 -- 172.21.15.52:0/1052088820 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f40a5600 con 0x7f23fc145300 2024-09-15T20:47:15.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fa7fc640 1 -- 172.21.15.52:0/1052088820 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f40a57a0 con 0x7f23fc145300 2024-09-15T20:47:15.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fa7fc640 1 -- 172.21.15.52:0/1052088820 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f40a5b70 con 0x7f23fc145300 2024-09-15T20:47:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 -- 172.21.15.52:0/1052088820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc145300 msgr2=0x7f23fc13ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 --2- 172.21.15.52:0/1052088820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc145300 0x7f23fc13ea60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0b2bd0 tx=0x7f23f401c940 comp rx=0 tx=0).stop 2024-09-15T20:47:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 -- 172.21.15.52:0/1052088820 shutdown_connections 2024-09-15T20:47:15.715 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 --2- 172.21.15.52:0/1052088820 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc145300 0x7f23fc13ea60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 --2- 172.21.15.52:0/1052088820 >> v2:172.21.15.81:3300/0 conn(0x7f23fc0b2630 0x7f23fc070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 -- 172.21.15.52:0/1052088820 >> 172.21.15.52:0/1052088820 conn(0x7f23fc0b57c0 msgr2=0x7f23fc0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:15.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 -- 172.21.15.52:0/1052088820 shutdown_connections 2024-09-15T20:47:15.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 -- 172.21.15.52:0/1052088820 wait complete. 2024-09-15T20:47:15.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 Processor -- start 2024-09-15T20:47:15.716 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 -- start start 2024-09-15T20:47:15.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc0b2630 0x7f23fc1371f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc13e630 0x7f23fc1dcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23fc145300 0x7f23fc1dd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc14e750 con 0x7f23fc0b2630 2024-09-15T20:47:15.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc14e5d0 con 0x7f23fc13e630 2024-09-15T20:47:15.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f24020c7640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f23fc14e8d0 con 0x7f23fc145300 2024-09-15T20:47:15.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc0b2630 0x7f23fc1371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fb7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc0b2630 0x7f23fc1371f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45392/0 (socket says 172.21.15.52:45392) 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fbfff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23fc145300 0x7f23fc1dd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fb7fe640 1 -- 172.21.15.52:0/2315190310 learned_addr learned my addr 172.21.15.52:0/2315190310 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23faffd640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc13e630 0x7f23fc1dcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fb7fe640 1 -- 172.21.15.52:0/2315190310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23fc145300 msgr2=0x7f23fc1dd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23fc145300 0x7f23fc1dd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fb7fe640 1 -- 172.21.15.52:0/2315190310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc13e630 msgr2=0x7f23fc1dcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc13e630 0x7f23fc1dcf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fb7fe640 1 -- 172.21.15.52:0/2315190310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc144380 con 0x7f23fc0b2630 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.713+0000 7f23fb7fe640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc0b2630 0x7f23fc1371f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f23e400d5f0 tx=0x7f23e400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.717+0000 7f23f3fff640 1 -- 172.21.15.52:0/2315190310 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e40125f0 con 0x7f23fc0b2630 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.717+0000 7f23f3fff640 1 -- 172.21.15.52:0/2315190310 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e4019070 con 0x7f23fc0b2630 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.717+0000 7f24020c7640 1 -- 172.21.15.52:0/2315190310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23fc139e20 con 0x7f23fc0b2630 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.717+0000 7f23f3fff640 1 -- 172.21.15.52:0/2315190310 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e40129d0 con 0x7f23fc0b2630 2024-09-15T20:47:15.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.717+0000 7f24020c7640 1 -- 172.21.15.52:0/2315190310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23fc1ddb80 con 0x7f23fc0b2630 2024-09-15T20:47:15.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.717+0000 7f24020c7640 1 -- 172.21.15.52:0/2315190310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23fc070900 con 0x7f23fc0b2630 2024-09-15T20:47:15.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.717+0000 7f23f3fff640 1 -- 172.21.15.52:0/2315190310 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f23e4012b70 con 0x7f23fc0b2630 2024-09-15T20:47:15.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.717+0000 7f23f3fff640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f23dc072ec0 0x7f23dc075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:15.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.717+0000 7f23f3fff640 1 -- 172.21.15.52:0/2315190310 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f23e4093dc0 con 0x7f23fc0b2630 2024-09-15T20:47:15.720 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.717+0000 7f23faffd640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f23dc072ec0 0x7f23dc075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:15.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.717+0000 7f23faffd640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f23dc072ec0 0x7f23dc075380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23fc1439a0 tx=0x7f23ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:15.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.721+0000 7f23f3fff640 1 -- 172.21.15.52:0/2315190310 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f23e405f1b0 con 0x7f23fc0b2630 2024-09-15T20:47:15.895 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.893+0000 7f24020c7640 1 -- 172.21.15.52:0/2315190310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23fc137790 con 0x7f23fc0b2630 2024-09-15T20:47:15.897 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.893+0000 7f23f3fff640 1 -- 172.21.15.52:0/2315190310 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+14837 (secure 0 0 0) 0x7f23e405eab0 con 0x7f23fc0b2630 2024-09-15T20:47:15.897 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:47:15.898 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":22,"fsid":"5b0b6dfd-6a20-4023-acf9-e3c53f9607bc","created":"2024-09-15T20:46:52.315149+0000","modified":"2024-09-15T20:47:14.465562+0000","last_up_change":"2024-09-15T20:47:04.394216+0000","last_in_change":"2024-09-15T20:46:54.803112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T20:47:05.257147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T20:47:10.855815+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b99fda03-8405-4cd4-aea3-a8cc67bc0fe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6801","nonce":1039594647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6803","nonce":1039594647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6807","nonce":1039594647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6805","nonce":1039594647}]},"public_addr":"172.21.15.52:6801/1039594647","cluster_addr":"172.21.15.52:6803/1039594647","heartbeat_back_addr":"172.21.15.52:6807/1039594647","heartbeat_front_addr":"172.21.15.52:6805/1039594647","state":["exists","up"]},{"osd":1,"uuid":"1d555c27-c8c2-4d30-9a50-be7cf9a60db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6817","nonce":1590363289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6819","nonce":1590363289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6823","nonce":1590363289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6821","nonce":1590363289}]},"public_addr":"172.21.15.52:6817/1590363289","cluster_addr":"172.21.15.52:6819/1590363289","heartbeat_back_addr":"172.21.15.52:6823/1590363289","heartbeat_front_addr":"172.21.15.52:6821/1590363289","state":["exists","up"]},{"osd":2,"uuid":"8d5f33c4-cf45-4c87-b9ea-f0b474dfcada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6825","nonce":4164590883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6827","nonce":4164590883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6831","nonce":4164590883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6829","nonce":4164590883}]},"public_addr":"172.21.15.52:6825/4164590883","cluster_addr":"172.21.15.52:6827/4164590883","heartbeat_back_addr":"172.21.15.52:6831/4164590883","heartbeat_front_addr":"172.21.15.52:6829/4164590883","state":["exists","up"]},{"osd":3,"uuid":"d9b51207-4514-4bfd-967c-32040c0b196f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6809","nonce":4053631670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6811","nonce":4053631670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6815","nonce":4053631670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6813","nonce":4053631670}]},"public_addr":"172.21.15.52:6809/4053631670","cluster_addr":"172.21.15.52:6811/4053631670","heartbeat_back_addr":"172.21.15.52:6815/4053631670","heartbeat_front_addr":"172.21.15.52:6813/4053631670","state":["exists","up"]},{"osd":4,"uuid":"bb2fcd47-4202-4b5c-ad02-5dfbe865cbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6817","nonce":1105997015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6819","nonce":1105997015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6823","nonce":1105997015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6821","nonce":1105997015}]},"public_addr":"172.21.15.81:6817/1105997015","cluster_addr":"172.21.15.81:6819/1105997015","heartbeat_back_addr":"172.21.15.81:6823/1105997015","heartbeat_front_addr":"172.21.15.81:6821/1105997015","state":["exists","up"]},{"osd":5,"uuid":"59599740-63cf-4e26-abb0-fe542c98671a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6809","nonce":1585962119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6811","nonce":1585962119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6815","nonce":1585962119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6813","nonce":1585962119}]},"public_addr":"172.21.15.81:6809/1585962119","cluster_addr":"172.21.15.81:6811/1585962119","heartbeat_back_addr":"172.21.15.81:6815/1585962119","heartbeat_front_addr":"172.21.15.81:6813/1585962119","state":["exists","up"]},{"osd":6,"uuid":"daebb41e-6be2-4689-b9c4-ba5271f2ce69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6801","nonce":1367983121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6803","nonce":1367983121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6807","nonce":1367983121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6805","nonce":1367983121}]},"public_addr":"172.21.15.81:6801/1367983121","cluster_addr":"172.21.15.81:6803/1367983121","heartbeat_back_addr":"172.21.15.81:6807/1367983121","heartbeat_front_addr":"172.21.15.81:6805/1367983121","state":["exists","up"]},{"osd":7,"uuid":"ed8914a3-1f7c-4942-bd5e-0453369f009b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6825","nonce":579210364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6827","nonce":579210364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6831","nonce":579210364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6829","nonce":579210364}]},"public_addr":"172.21.15.81:6825/579210364","cluster_addr":"172.21.15.81:6827/579210364","heartbeat_back_addr":"172.21.15.81:6831/579210364","heartbeat_front_addr":"172.21.15.81:6829/579210364","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.527985+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.518897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.982136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.494599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.327079+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.271634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.089410+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.736530+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T20:47:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.897+0000 7f24020c7640 1 -- 172.21.15.52:0/2315190310 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f23dc072ec0 msgr2=0x7f23dc075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.897+0000 7f24020c7640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f23dc072ec0 0x7f23dc075380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23fc1439a0 tx=0x7f23ec009040 comp rx=0 tx=0).stop 2024-09-15T20:47:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.897+0000 7f24020c7640 1 -- 172.21.15.52:0/2315190310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc0b2630 msgr2=0x7f23fc1371f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.897+0000 7f24020c7640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc0b2630 0x7f23fc1371f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f23e400d5f0 tx=0x7f23e400dab0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.897+0000 7f24020c7640 1 -- 172.21.15.52:0/2315190310 shutdown_connections 2024-09-15T20:47:15.900 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.897+0000 7f24020c7640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f23dc072ec0 0x7f23dc075380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.897+0000 7f24020c7640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f23fc145300 0x7f23fc1dd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.897+0000 7f24020c7640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc13e630 0x7f23fc1dcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.897+0000 7f24020c7640 1 --2- 172.21.15.52:0/2315190310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f23fc0b2630 0x7f23fc1371f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:15.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.897+0000 7f24020c7640 1 -- 172.21.15.52:0/2315190310 >> 172.21.15.52:0/2315190310 conn(0x7f23fc0b57c0 msgr2=0x7f23fc0b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:15.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.897+0000 7f24020c7640 1 -- 172.21.15.52:0/2315190310 shutdown_connections 2024-09-15T20:47:15.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:15.897+0000 7f24020c7640 1 -- 172.21.15.52:0/2315190310 wait complete. 2024-09-15T20:47:15.917 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T20:47:15.917 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T20:47:15.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T20:47:15.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-15T20:47:15.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-15T20:47:15.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-15T20:47:15.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-15T20:47:15.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-15T20:47:16.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.097+0000 7fce5ffff640 1 Processor -- start 2024-09-15T20:47:16.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.097+0000 7fce5ffff640 1 -- start start 2024-09-15T20:47:16.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.097+0000 7fa28a704640 1 Processor -- start 2024-09-15T20:47:16.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.097+0000 7fa28a704640 1 -- start start 2024-09-15T20:47:16.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.097+0000 7fa28a704640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa27c0345f0 0x7fa27c02fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.097+0000 7fa28a704640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa27c031840 0x7fa27c0cc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.097+0000 7fa28a704640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa27c032590 con 0x7fa27c0cc5c0 2024-09-15T20:47:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.097+0000 7fa28a704640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa27c0349d0 con 0x7fa27c0345f0 2024-09-15T20:47:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.097+0000 7fa28a704640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fa27c0cb910 con 0x7fa27c031840 2024-09-15T20:47:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.097+0000 7fce5ffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fce600b5a60 0x7fce600afe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fce5ffff640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce60073070 con 0x7fce601428b0 2024-09-15T20:47:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fce5ffff640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce60070860 con 0x7fce6013c300 2024-09-15T20:47:16.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fce5ffff640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fce60071a00 con 0x7fce600b5a60 2024-09-15T20:47:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fa2837fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa27c031840 0x7fa27c0cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fa2837fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa27c031840 0x7fa27c0cc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44726/0 (socket says 172.21.15.52:44726) 2024-09-15T20:47:16.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fce5effd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fce600b5a60 0x7fce600afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fce5effd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fce600b5a60 0x7fce600afe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45396/0 (socket says 172.21.15.52:45396) 2024-09-15T20:47:16.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fce5effd640 1 -- 172.21.15.52:0/597904755 learned_addr learned my addr 172.21.15.52:0/597904755 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fa283fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa27c0345f0 0x7fa27c02fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fa288ca1640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa27c0cc5c0 0x7fa27c0c8c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.52:52408/0 (socket says 172.21.15.52:52408) 2024-09-15T20:47:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fa288ca1640 1 -- 172.21.15.52:0/3772694933 learned_addr learned my addr 172.21.15.52:0/3772694933 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:16.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88dd424640 1 Processor -- start 2024-09-15T20:47:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88dd424640 1 -- start start 2024-09-15T20:47:16.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fce5dffb640 1 -- 172.21.15.52:0/597904755 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392827816 0 0) 0x7fce60070860 con 0x7fce6013c300 2024-09-15T20:47:16.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fce5dffb640 1 -- 172.21.15.52:0/597904755 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce48003530 con 0x7fce6013c300 2024-09-15T20:47:16.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87fa9d640 1 Processor -- start 2024-09-15T20:47:16.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fce5effd640 1 -- 172.21.15.52:0/597904755 >> v1:172.21.15.81:6789/0 conn(0x7fce6013c300 legacy=0x7fce6013c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fce5effd640 1 -- 172.21.15.52:0/597904755 >> v1:172.21.15.52:6789/0 conn(0x7fce601428b0 legacy=0x7fce60143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fce5effd640 1 -- 172.21.15.52:0/597904755 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce600710e0 con 0x7fce600b5a60 2024-09-15T20:47:16.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fa2837fe640 1 -- 172.21.15.52:0/3772694933 >> v2:172.21.15.81:3300/0 conn(0x7fa27c0345f0 msgr2=0x7fa27c02fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fa2837fe640 1 --2- 172.21.15.52:0/3772694933 >> v2:172.21.15.81:3300/0 conn(0x7fa27c0345f0 0x7fa27c02fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fa2837fe640 1 -- 172.21.15.52:0/3772694933 >> v1:172.21.15.81:6789/0 conn(0x7fa27c0cc5c0 legacy=0x7fa27c0c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fa2837fe640 1 -- 172.21.15.52:0/3772694933 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c032800 con 0x7fa27c031840 2024-09-15T20:47:16.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88dd424640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f88d8143640 0x7f88d8071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88dd424640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88d8072ca0 0x7f88d813d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88dd424640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88d8073e10 con 0x7f88d80afec0 2024-09-15T20:47:16.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88dd424640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f88d80b02a0 con 0x7f88d8143640 2024-09-15T20:47:16.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88dd424640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f88d80744a0 con 0x7f88d8072ca0 2024-09-15T20:47:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87fa9d640 1 -- start start 2024-09-15T20:47:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87fa9d640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd878145160 0x7fd8780afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87fa9d640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd878072710 con 0x7fd878070d70 2024-09-15T20:47:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87fa9d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd878071960 con 0x7fd878070990 2024-09-15T20:47:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87fa9d640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd878072980 con 0x7fd878145160 2024-09-15T20:47:16.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f01162e9640 1 Processor -- start 2024-09-15T20:47:16.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88d6ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f88d80afec0 0x7f88d8074980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47384/0 (socket says 172.21.15.52:47384) 2024-09-15T20:47:16.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88d67fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f88d8143640 0x7f88d8071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88d6ffd640 1 -- 172.21.15.52:0/2942324101 learned_addr learned my addr 172.21.15.52:0/2942324101 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:16.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88d77fe640 1 --2- 172.21.15.52:0/2942324101 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88d8072ca0 0x7f88d813d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87e03a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd878145160 0x7fd8780afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87e03a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd878145160 0x7fd8780afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45406/0 (socket says 172.21.15.52:45406) 2024-09-15T20:47:16.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87d839640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd878070990 0x7fd87814b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.52:52434/0 (socket says 172.21.15.52:52434) 2024-09-15T20:47:16.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87d839640 1 -- 172.21.15.52:0/3577198932 learned_addr learned my addr 172.21.15.52:0/3577198932 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:16.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88d67fc640 1 -- 172.21.15.52:0/2942324101 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88d8072ca0 msgr2=0x7f88d813d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88d67fc640 1 --2- 172.21.15.52:0/2942324101 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88d8072ca0 0x7f88d813d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88d67fc640 1 -- 172.21.15.52:0/2942324101 >> v1:172.21.15.52:6789/0 conn(0x7f88d80afec0 legacy=0x7f88d8074980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88d67fc640 1 -- 172.21.15.52:0/2942324101 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d8075090 con 0x7f88d8143640 2024-09-15T20:47:16.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f88d5ffb640 1 -- 172.21.15.52:0/2942324101 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 751356036 0 0) 0x7f88d8073e10 con 0x7f88d80afec0 2024-09-15T20:47:16.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f47cac25640 1 Processor -- start 2024-09-15T20:47:16.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87c837640 1 -- 172.21.15.52:0/3577198932 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 13952144 0 0) 0x7fd878071960 con 0x7fd878070990 2024-09-15T20:47:16.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87c837640 1 -- 172.21.15.52:0/3577198932 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd864003530 con 0x7fd878070990 2024-09-15T20:47:16.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fd87c837640 1 -- 172.21.15.52:0/3577198932 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331444856 0 0) 0x7fd878072710 con 0x7fd878070d70 2024-09-15T20:47:16.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7fce5effd640 1 --2- 172.21.15.52:0/597904755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce600b5a60 0x7fce600afe40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce50009870 tx=0x7fce5001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c41c049309bd05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fd87e03a640 1 -- 172.21.15.52:0/3577198932 >> v1:172.21.15.81:6789/0 conn(0x7fd878070990 legacy=0x7fd87814b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fd87e03a640 1 -- 172.21.15.52:0/3577198932 >> v1:172.21.15.52:6789/0 conn(0x7fd878070d70 legacy=0x7fd878144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fce5dffb640 1 -- 172.21.15.52:0/597904755 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce500b0070 con 0x7fce600b5a60 2024-09-15T20:47:16.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f01162e9640 1 -- start start 2024-09-15T20:47:16.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fd87e03a640 1 -- 172.21.15.52:0/3577198932 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd878072c60 con 0x7fd878145160 2024-09-15T20:47:16.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fce5dffb640 1 -- 172.21.15.52:0/597904755 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce500ab600 con 0x7fce600b5a60 2024-09-15T20:47:16.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fce5dffb640 1 -- 172.21.15.52:0/597904755 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce500ab9b0 con 0x7fce600b5a60 2024-09-15T20:47:16.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa2837fe640 1 --2- 172.21.15.52:0/3772694933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa27c031840 0x7fa27c0cc080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa2700097c0 tx=0x7fa27001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb688ab8cb37e3f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa282ffd640 1 -- 172.21.15.52:0/3772694933 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2700b1070 con 0x7fa27c031840 2024-09-15T20:47:16.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.101+0000 7f47cac25640 1 -- start start 2024-09-15T20:47:16.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47cac25640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c4071020 0x7f47c4147e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47cac25640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47c4148360 0x7f47c4152120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47cac25640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c41487d0 con 0x7f47c414b030 2024-09-15T20:47:16.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47cac25640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f47c4072030 con 0x7f47c4148360 2024-09-15T20:47:16.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f01162e9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01100b1b50 0x7f0110140710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f01162e9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01100aef60 0x7f0110140c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f01162e9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0110143630 0x7f0110143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f01162e9640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f01100b1f30 con 0x7f0110143630 2024-09-15T20:47:16.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f01162e9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f01100aecf0 con 0x7f01100aef60 2024-09-15T20:47:16.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f01162e9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f01100b0370 con 0x7f01100b1b50 2024-09-15T20:47:16.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47cac25640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f47c40af8d0 con 0x7f47c4071020 2024-09-15T20:47:16.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fce5ffff640 1 -- 172.21.15.52:0/597904755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce600b5a60 msgr2=0x7fce600afe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fce5ffff640 1 --2- 172.21.15.52:0/597904755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce600b5a60 0x7fce600afe40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fce50009870 tx=0x7fce5001c340 comp rx=0 tx=0).stop 2024-09-15T20:47:16.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c4071020 0x7f47c4147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fce5ffff640 1 -- 172.21.15.52:0/597904755 shutdown_connections 2024-09-15T20:47:16.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fce5ffff640 1 --2- 172.21.15.52:0/597904755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce600b5a60 0x7fce600afe40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fce5ffff640 1 -- 172.21.15.52:0/597904755 >> 172.21.15.52:0/597904755 conn(0x7fce600b4f40 msgr2=0x7fce600b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30c08db640 1 Processor -- start 2024-09-15T20:47:16.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f010f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01100aef60 0x7f0110140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c4071020 0x7f47c4147e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44738/0 (socket says 172.21.15.52:44738) 2024-09-15T20:47:16.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47c3fff640 1 -- 172.21.15.52:0/51468569 learned_addr learned my addr 172.21.15.52:0/51468569 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47c91c2640 1 --2- 172.21.15.52:0/51468569 >> v2:172.21.15.52:3300/0 conn(0x7f47c4148360 0x7f47c4152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47c3fff640 1 -- 172.21.15.52:0/51468569 >> v2:172.21.15.52:3300/0 conn(0x7f47c4148360 msgr2=0x7f47c4152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f010ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01100b1b50 0x7f0110140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f0114886640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0110143630 0x7f0110143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa282ffd640 1 -- 172.21.15.52:0/3772694933 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2700a8050 con 0x7fa27c031840 2024-09-15T20:47:16.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa282ffd640 1 -- 172.21.15.52:0/3772694933 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2700ac860 con 0x7fa27c031840 2024-09-15T20:47:16.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa28a704640 1 -- 172.21.15.52:0/3772694933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa27c031840 msgr2=0x7fa27c0cc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa28a704640 1 --2- 172.21.15.52:0/3772694933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa27c031840 0x7fa27c0cc080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa2700097c0 tx=0x7fa27001c400 comp rx=0 tx=0).stop 2024-09-15T20:47:16.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f0114886640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0110143630 0x7f0110143ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45418/0 (socket says 172.21.15.52:45418) 2024-09-15T20:47:16.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f0114886640 1 -- 172.21.15.52:0/2732245275 learned_addr learned my addr 172.21.15.52:0/2732245275 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f010ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01100b1b50 0x7f0110140710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44744/0 (socket says 172.21.15.52:44744) 2024-09-15T20:47:16.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa28a704640 1 -- 172.21.15.52:0/3772694933 shutdown_connections 2024-09-15T20:47:16.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa28a704640 1 --2- 172.21.15.52:0/3772694933 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa27c031840 0x7fa27c0cc080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa28a704640 1 --2- 172.21.15.52:0/3772694933 >> v2:172.21.15.81:3300/0 conn(0x7fa27c0345f0 0x7fa27c02fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa28a704640 1 -- 172.21.15.52:0/3772694933 >> 172.21.15.52:0/3772694933 conn(0x7fa27c005c30 msgr2=0x7fa27c006040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47c3fff640 1 --2- 172.21.15.52:0/51468569 >> v2:172.21.15.52:3300/0 conn(0x7f47c4148360 0x7f47c4152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47c3fff640 1 -- 172.21.15.52:0/51468569 >> v1:172.21.15.81:6789/0 conn(0x7f47c414b030 legacy=0x7f47c414b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47c3fff640 1 -- 172.21.15.52:0/51468569 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c40b10d0 con 0x7f47c4071020 2024-09-15T20:47:16.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f47c91c2640 1 --2- 172.21.15.52:0/51468569 >> v2:172.21.15.52:3300/0 conn(0x7f47c4148360 0x7f47c4152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:47:16.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fce5ffff640 1 -- 172.21.15.52:0/597904755 shutdown_connections 2024-09-15T20:47:16.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa28a704640 1 -- 172.21.15.52:0/3772694933 shutdown_connections 2024-09-15T20:47:16.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa28a704640 1 -- 172.21.15.52:0/3772694933 wait complete. 2024-09-15T20:47:16.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30c08db640 1 -- start start 2024-09-15T20:47:16.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30c08db640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f30bc0b0e00 0x7f30bc071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30c08db640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f30bc13c770 0x7f30bc13cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30c08db640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30bc13f410 0x7f30bc13f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30c08db640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f30bc0b11e0 con 0x7f30bc13c770 2024-09-15T20:47:16.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30c08db640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f30bc0b17d0 con 0x7f30bc0b0e00 2024-09-15T20:47:16.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30c08db640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f30bc0af760 con 0x7f30bc13f410 2024-09-15T20:47:16.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f88d67fc640 1 --2- 172.21.15.52:0/2942324101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88d8143640 0x7f88d8071d30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00ba60 tx=0x7f88cc01eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d34f3d90a17edee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30bbfff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30bc13f410 0x7f30bc13f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30bbfff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30bc13f410 0x7f30bc13f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44760/0 (socket says 172.21.15.52:44760) 2024-09-15T20:47:16.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30bbfff640 1 -- 172.21.15.52:0/4071268338 learned_addr learned my addr 172.21.15.52:0/4071268338 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f88d5ffb640 1 -- 172.21.15.52:0/2942324101 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0b4070 con 0x7f88d8143640 2024-09-15T20:47:16.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f88d5ffb640 1 -- 172.21.15.52:0/2942324101 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc0a7ab0 con 0x7f88d8143640 2024-09-15T20:47:16.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f88d5ffb640 1 -- 172.21.15.52:0/2942324101 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0af440 con 0x7f88d8143640 2024-09-15T20:47:16.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30bbfff640 1 -- 172.21.15.52:0/4071268338 >> v2:172.21.15.81:3300/0 conn(0x7f30bc0b0e00 msgr2=0x7f30bc071750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T20:47:16.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30bbfff640 1 --2- 172.21.15.52:0/4071268338 >> v2:172.21.15.81:3300/0 conn(0x7f30bc0b0e00 0x7f30bc071750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30bbfff640 1 -- 172.21.15.52:0/4071268338 >> v2:172.21.15.52:3300/0 conn(0x7f30bc13c770 msgr2=0x7f30bc13cba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T20:47:16.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30bbfff640 1 --2- 172.21.15.52:0/4071268338 >> v2:172.21.15.52:3300/0 conn(0x7f30bc13c770 0x7f30bc13cba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f30bbfff640 1 -- 172.21.15.52:0/4071268338 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc0721f0 con 0x7f30bc13f410 2024-09-15T20:47:16.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa28a704640 1 Processor -- start 2024-09-15T20:47:16.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fa28a704640 1 -- start start 2024-09-15T20:47:16.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fce5ffff640 1 -- 172.21.15.52:0/597904755 wait complete. 2024-09-15T20:47:16.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fce5ffff640 1 Processor -- start 2024-09-15T20:47:16.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f88dd424640 1 -- 172.21.15.52:0/2942324101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88d8143640 msgr2=0x7f88d8071d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7f88dd424640 1 --2- 172.21.15.52:0/2942324101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88d8143640 0x7f88d8071d30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00ba60 tx=0x7f88cc01eac0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f88dd424640 1 -- 172.21.15.52:0/2942324101 shutdown_connections 2024-09-15T20:47:16.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f88dd424640 1 --2- 172.21.15.52:0/2942324101 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88d8072ca0 0x7f88d813d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f88dd424640 1 --2- 172.21.15.52:0/2942324101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88d8143640 0x7f88d8071d30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f88dd424640 1 -- 172.21.15.52:0/2942324101 >> 172.21.15.52:0/2942324101 conn(0x7f88d80b5290 msgr2=0x7f88d80b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa28a704640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa27c031840 0x7fa27c0d5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa28a704640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa27c0345f0 0x7fa27c029f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa28a704640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa27c02a540 0x7fa27c02a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa28a704640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c0d8ae0 con 0x7fa27c0345f0 2024-09-15T20:47:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa28a704640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c0d8960 con 0x7fa27c031840 2024-09-15T20:47:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa28a704640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fa27c0d8c60 con 0x7fa27c02a540 2024-09-15T20:47:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa283fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa27c031840 0x7fa27c0d5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa283fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa27c031840 0x7fa27c0d5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.52:54716/0 (socket says 172.21.15.52:54716) 2024-09-15T20:47:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa283fff640 1 -- 172.21.15.52:0/132693650 learned_addr learned my addr 172.21.15.52:0/132693650 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa2837fe640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa27c0345f0 0x7fa27c029f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa288ca1640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa27c02a540 0x7fa27c02a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.105+0000 7fce5ffff640 1 -- start start 2024-09-15T20:47:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce600b5a60 0x7fce6014ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce6013c300 0x7fce6014f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5ffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce601428b0 0x7fce601ebf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5ffff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fce60151f10 con 0x7fce601428b0 2024-09-15T20:47:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5ffff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fce60151d90 con 0x7fce6013c300 2024-09-15T20:47:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5ffff640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fce60152090 con 0x7fce600b5a60 2024-09-15T20:47:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce601428b0 0x7fce601ebf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce601428b0 0x7fce601ebf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45444/0 (socket says 172.21.15.52:45444) 2024-09-15T20:47:16.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5f7fe640 1 -- 172.21.15.52:0/3146585167 learned_addr learned my addr 172.21.15.52:0/3146585167 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f010f7fe640 1 -- 172.21.15.52:0/2732245275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01100b1b50 msgr2=0x7f0110140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f010f7fe640 1 --2- 172.21.15.52:0/2732245275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01100b1b50 0x7f0110140710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f010f7fe640 1 -- 172.21.15.52:0/2732245275 >> v2:172.21.15.52:3300/0 conn(0x7f0110143630 msgr2=0x7f0110143ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f010f7fe640 1 --2- 172.21.15.52:0/2732245275 >> v2:172.21.15.52:3300/0 conn(0x7f0110143630 0x7f0110143ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f010f7fe640 1 -- 172.21.15.52:0/2732245275 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01100751b0 con 0x7f01100aef60 2024-09-15T20:47:16.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa283fff640 1 -- 172.21.15.52:0/132693650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa27c02a540 msgr2=0x7fa27c02a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa283fff640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa27c02a540 0x7fa27c02a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa283fff640 1 -- 172.21.15.52:0/132693650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa27c0345f0 msgr2=0x7fa27c029f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa283fff640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa27c0345f0 0x7fa27c029f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa283fff640 1 -- 172.21.15.52:0/132693650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c0a0ad0 con 0x7fa27c031840 2024-09-15T20:47:16.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f88dd424640 1 -- 172.21.15.52:0/2942324101 shutdown_connections 2024-09-15T20:47:16.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f88dd424640 1 -- 172.21.15.52:0/2942324101 wait complete. 2024-09-15T20:47:16.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5f7fe640 1 -- 172.21.15.52:0/3146585167 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce600b5a60 msgr2=0x7fce6014ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5f7fe640 1 --2- 172.21.15.52:0/3146585167 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fce600b5a60 0x7fce6014ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5f7fe640 1 -- 172.21.15.52:0/3146585167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce6013c300 msgr2=0x7fce6014f890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T20:47:16.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5f7fe640 1 --2- 172.21.15.52:0/3146585167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce6013c300 0x7fce6014f890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5f7fe640 1 -- 172.21.15.52:0/3146585167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce601eba20 con 0x7fce601428b0 2024-09-15T20:47:16.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa283fff640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa27c031840 0x7fa27c0d5b20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa27800e930 tx=0x7fa27800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa280ff9640 1 -- 172.21.15.52:0/132693650 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa278017070 con 0x7fa27c031840 2024-09-15T20:47:16.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f47c3fff640 1 --2- 172.21.15.52:0/51468569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c4071020 0x7f47c4147e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009e50 tx=0x7f47bc01ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b42a46bcb66defa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa280ff9640 1 -- 172.21.15.52:0/132693650 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27800ca00 con 0x7fa27c031840 2024-09-15T20:47:16.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5f7fe640 1 --2- 172.21.15.52:0/3146585167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce601428b0 0x7fce601ebf00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce5400c410 tx=0x7fce5400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce47fff640 1 -- 172.21.15.52:0/3146585167 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54017070 con 0x7fce601428b0 2024-09-15T20:47:16.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fd87e03a640 1 --2- 172.21.15.52:0/3577198932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd878145160 0x7fd8780afc60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8680099a0 tx=0x7fd86801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac6d3015b74163c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f88dd424640 1 Processor -- start 2024-09-15T20:47:16.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f30bbfff640 1 --2- 172.21.15.52:0/4071268338 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30bc13f410 0x7f30bc13f840 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f30bc06e2b0 tx=0x7f30b401c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8409d0f5b0c65a72 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fd87c837640 1 -- 172.21.15.52:0/3577198932 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd870001a80 con 0x7fd878145160 2024-09-15T20:47:16.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f47c37fe640 1 -- 172.21.15.52:0/51468569 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0a5760 con 0x7f47c4071020 2024-09-15T20:47:16.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fd87c837640 1 -- 172.21.15.52:0/3577198932 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8680a9400 con 0x7fd878145160 2024-09-15T20:47:16.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fd87c837640 1 -- 172.21.15.52:0/3577198932 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8680a95d0 con 0x7fd878145160 2024-09-15T20:47:16.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa28a704640 1 -- 172.21.15.52:0/132693650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27c02b9a0 con 0x7fa27c031840 2024-09-15T20:47:16.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa28a704640 1 -- 172.21.15.52:0/132693650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa27c02f0d0 con 0x7fa27c031840 2024-09-15T20:47:16.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fa280ff9640 1 -- 172.21.15.52:0/132693650 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27800cdb0 con 0x7fa27c031840 2024-09-15T20:47:16.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5ffff640 1 -- 172.21.15.52:0/3146585167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce6014cb80 con 0x7fce601428b0 2024-09-15T20:47:16.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce5ffff640 1 -- 172.21.15.52:0/3146585167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce60140240 con 0x7fce601428b0 2024-09-15T20:47:16.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7fce47fff640 1 -- 172.21.15.52:0/3146585167 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce540052d0 con 0x7fce601428b0 2024-09-15T20:47:16.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3577198932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd878145160 msgr2=0x7fd8780afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fd87fa9d640 1 --2- 172.21.15.52:0/3577198932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd878145160 0x7fd8780afc60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8680099a0 tx=0x7fd86801c4e0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3577198932 shutdown_connections 2024-09-15T20:47:16.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fd87fa9d640 1 --2- 172.21.15.52:0/3577198932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd878145160 0x7fd8780afc60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3577198932 >> 172.21.15.52:0/3577198932 conn(0x7fd8780b5290 msgr2=0x7fd8780b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f010f7fe640 1 --2- 172.21.15.52:0/2732245275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01100aef60 0x7f0110140c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0110069e40 tx=0x7f010801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f95bc5418a7b5b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3577198932 shutdown_connections 2024-09-15T20:47:16.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f47c37fe640 1 -- 172.21.15.52:0/51468569 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc0a5900 con 0x7f47c4071020 2024-09-15T20:47:16.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f47c37fe640 1 -- 172.21.15.52:0/51468569 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0a5cd0 con 0x7f47c4071020 2024-09-15T20:47:16.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 -- 172.21.15.52:0/51468569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c4071020 msgr2=0x7f47c4147e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 --2- 172.21.15.52:0/51468569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c4071020 0x7f47c4147e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009e50 tx=0x7f47bc01ca10 comp rx=0 tx=0).stop 2024-09-15T20:47:16.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3577198932 wait complete. 2024-09-15T20:47:16.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fce47fff640 1 -- 172.21.15.52:0/3146585167 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54003840 con 0x7fce601428b0 2024-09-15T20:47:16.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 -- 172.21.15.52:0/51468569 shutdown_connections 2024-09-15T20:47:16.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 --2- 172.21.15.52:0/51468569 >> v2:172.21.15.52:3300/0 conn(0x7f47c4148360 0x7f47c4152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 --2- 172.21.15.52:0/51468569 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c4071020 0x7f47c4147e20 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009e50 tx=0x7f47bc01ca10 comp rx=0 tx=0).stop 2024-09-15T20:47:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 -- 172.21.15.52:0/51468569 >> 172.21.15.52:0/51468569 conn(0x7f47c40b21c0 msgr2=0x7f47c40b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fa28a704640 1 -- 172.21.15.52:0/132693650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa27c0cc080 con 0x7fa27c031840 2024-09-15T20:47:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f30ba7fc640 1 -- 172.21.15.52:0/4071268338 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40a5710 con 0x7f30bc13f410 2024-09-15T20:47:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f30ba7fc640 1 -- 172.21.15.52:0/4071268338 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b40a58b0 con 0x7f30bc13f410 2024-09-15T20:47:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f30ba7fc640 1 -- 172.21.15.52:0/4071268338 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40a5c80 con 0x7f30bc13f410 2024-09-15T20:47:16.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f30c08db640 1 -- 172.21.15.52:0/4071268338 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30bc13f410 msgr2=0x7f30bc13f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f30c08db640 1 --2- 172.21.15.52:0/4071268338 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30bc13f410 0x7f30bc13f840 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f30bc06e2b0 tx=0x7f30b401c980 comp rx=0 tx=0).stop 2024-09-15T20:47:16.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fce5ffff640 1 -- 172.21.15.52:0/3146585167 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce40000f90 con 0x7fce601428b0 2024-09-15T20:47:16.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fce47fff640 1 -- 172.21.15.52:0/3146585167 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fce5401a070 con 0x7fce601428b0 2024-09-15T20:47:16.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fd87fa9d640 1 Processor -- start 2024-09-15T20:47:16.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f010effd640 1 -- 172.21.15.52:0/2732245275 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01080b2070 con 0x7f01100aef60 2024-09-15T20:47:16.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f010effd640 1 -- 172.21.15.52:0/2732245275 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01080a58f0 con 0x7f01100aef60 2024-09-15T20:47:16.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f010effd640 1 -- 172.21.15.52:0/2732245275 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01080a5cc0 con 0x7f01100aef60 2024-09-15T20:47:16.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f01162e9640 1 -- 172.21.15.52:0/2732245275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01100aef60 msgr2=0x7f0110140c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f01162e9640 1 --2- 172.21.15.52:0/2732245275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01100aef60 0x7f0110140c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0110069e40 tx=0x7f010801c890 comp rx=0 tx=0).stop 2024-09-15T20:47:16.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f01162e9640 1 -- 172.21.15.52:0/2732245275 shutdown_connections 2024-09-15T20:47:16.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f01162e9640 1 --2- 172.21.15.52:0/2732245275 >> v2:172.21.15.52:3300/0 conn(0x7f0110143630 0x7f0110143ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f01162e9640 1 --2- 172.21.15.52:0/2732245275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01100aef60 0x7f0110140c50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f01162e9640 1 --2- 172.21.15.52:0/2732245275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01100b1b50 0x7f0110140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f01162e9640 1 -- 172.21.15.52:0/2732245275 >> 172.21.15.52:0/2732245275 conn(0x7f01100b29e0 msgr2=0x7f01100b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f01162e9640 1 -- 172.21.15.52:0/2732245275 shutdown_connections 2024-09-15T20:47:16.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 -- 172.21.15.52:0/51468569 shutdown_connections 2024-09-15T20:47:16.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 -- 172.21.15.52:0/51468569 wait complete. 2024-09-15T20:47:16.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f88dd424640 1 -- start start 2024-09-15T20:47:16.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f88dd424640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d8072ca0 0x7f88d80ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.109+0000 7f88dd424640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88d80afec0 0x7f88d80aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d8072ca0 0x7f88d80ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d8072ca0 0x7f88d80ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.52:54730/0 (socket says 172.21.15.52:54730) 2024-09-15T20:47:16.151 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d67fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88d80afec0 0x7f88d80aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d67fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88d80afec0 0x7f88d80aaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44784/0 (socket says 172.21.15.52:44784) 2024-09-15T20:47:16.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 Processor -- start 2024-09-15T20:47:16.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fce47fff640 1 --2- 172.21.15.52:0/3146585167 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fce4c072fc0 0x7fce4c075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fce47fff640 1 -- 172.21.15.52:0/3146585167 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7fce54092d90 con 0x7fce601428b0 2024-09-15T20:47:16.152 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 -- start start 2024-09-15T20:47:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88dd424640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88d8143640 0x7f88d81e2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88dd424640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88d80b1110 con 0x7f88d8143640 2024-09-15T20:47:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88dd424640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f88d80b0f90 con 0x7f88d8072ca0 2024-09-15T20:47:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88dd424640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f88d80b1290 con 0x7f88d80afec0 2024-09-15T20:47:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88d8143640 0x7f88d81e2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88d8143640 0x7f88d81e2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45452/0 (socket says 172.21.15.52:45452) 2024-09-15T20:47:16.153 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d77fe640 1 -- 172.21.15.52:0/2204731157 learned_addr learned my addr 172.21.15.52:0/2204731157 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fce5effd640 1 --2- 172.21.15.52:0/3146585167 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fce4c072fc0 0x7fce4c075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fce47fff640 1 --2- 172.21.15.52:0/3146585167 >> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] conn(0x7fce4c079400 0x7fce4c07b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f30c08db640 1 -- 172.21.15.52:0/4071268338 shutdown_connections 2024-09-15T20:47:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f30c08db640 1 --2- 172.21.15.52:0/4071268338 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30bc13f410 0x7f30bc13f840 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f30c08db640 1 --2- 172.21.15.52:0/4071268338 >> v2:172.21.15.52:3300/0 conn(0x7f30bc13c770 0x7f30bc13cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f30c08db640 1 --2- 172.21.15.52:0/4071268338 >> v2:172.21.15.81:3300/0 conn(0x7f30bc0b0e00 0x7f30bc071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.154 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f30c08db640 1 -- 172.21.15.52:0/4071268338 >> 172.21.15.52:0/4071268338 conn(0x7f30bc0b1c90 msgr2=0x7f30bc0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fce47fff640 1 -- 172.21.15.52:0/3146585167 --> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce4c07bf10 con 0x7fce4c079400 2024-09-15T20:47:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fce47fff640 1 -- 172.21.15.52:0/3146585167 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fce54096020 con 0x7fce601428b0 2024-09-15T20:47:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f01162e9640 1 -- 172.21.15.52:0/2732245275 wait complete. 2024-09-15T20:47:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f01162e9640 1 Processor -- start 2024-09-15T20:47:16.155 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c4148360 0x7f47c4146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c414b030 0x7f47c4149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4149010 0x7f47c4132610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f47c4153200 con 0x7f47c4149010 2024-09-15T20:47:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f47c4153080 con 0x7f47c4148360 2024-09-15T20:47:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47cac25640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f47c4153380 con 0x7f47c414b030 2024-09-15T20:47:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c414b030 0x7f47c4149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47c3fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c414b030 0x7f47c4149bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44800/0 (socket says 172.21.15.52:44800) 2024-09-15T20:47:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47c3fff640 1 -- 172.21.15.52:0/227867518 learned_addr learned my addr 172.21.15.52:0/227867518 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.156 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d67fc640 1 -- 172.21.15.52:0/2204731157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d8072ca0 msgr2=0x7f88d80ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d67fc640 1 --2- 172.21.15.52:0/2204731157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d8072ca0 0x7f88d80ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d67fc640 1 -- 172.21.15.52:0/2204731157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88d8143640 msgr2=0x7f88d81e2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d67fc640 1 --2- 172.21.15.52:0/2204731157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88d8143640 0x7f88d81e2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d67fc640 1 -- 172.21.15.52:0/2204731157 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d80adc90 con 0x7f88d80afec0 2024-09-15T20:47:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88d67fc640 1 --2- 172.21.15.52:0/2204731157 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88d80afec0 0x7f88d80aaa20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0ae000 tx=0x7f88cc01b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88bf7fe640 1 -- 172.21.15.52:0/2204731157 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0bf070 con 0x7f88d80afec0 2024-09-15T20:47:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88bf7fe640 1 -- 172.21.15.52:0/2204731157 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc0ba430 con 0x7f88d80afec0 2024-09-15T20:47:16.157 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f88bf7fe640 1 -- 172.21.15.52:0/2204731157 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0b4040 con 0x7f88d80afec0 2024-09-15T20:47:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f30c08db640 1 -- 172.21.15.52:0/4071268338 shutdown_connections 2024-09-15T20:47:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f47c89c1640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c4148360 0x7f47c4146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fce5effd640 1 --2- 172.21.15.52:0/3146585167 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fce4c072fc0 0x7fce4c075480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fce500ad000 tx=0x7fce50004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.158 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fce5e7fc640 1 --2- 172.21.15.52:0/3146585167 >> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] conn(0x7fce4c079400 0x7fce4c07b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7fd87fa9d640 1 -- start start 2024-09-15T20:47:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87fa9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd878070990 0x7fd87814a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87fa9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd878070d70 0x7fd878147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87fa9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd878145160 0x7fd87813bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87fa9d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd878155c80 con 0x7fd878145160 2024-09-15T20:47:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87fa9d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd878155b00 con 0x7fd878070d70 2024-09-15T20:47:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87fa9d640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fd878155e00 con 0x7fd878070990 2024-09-15T20:47:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd878070d70 0x7fd878147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87d038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd878070d70 0x7fd878147a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.52:54754/0 (socket says 172.21.15.52:54754) 2024-09-15T20:47:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87d038640 1 -- 172.21.15.52:0/3226218149 learned_addr learned my addr 172.21.15.52:0/3226218149 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.159 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87d839640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd878070990 0x7fd87814a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87d038640 1 -- 172.21.15.52:0/3226218149 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd878070990 msgr2=0x7fd87814a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87d038640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd878070990 0x7fd87814a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87d038640 1 -- 172.21.15.52:0/3226218149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd878145160 msgr2=0x7fd87813bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87d038640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd878145160 0x7fd87813bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87d038640 1 -- 172.21.15.52:0/3226218149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd878146c60 con 0x7fd878070d70 2024-09-15T20:47:16.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87d038640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd878070d70 0x7fd878147a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd87400c430 tx=0x7fd87400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f01162e9640 1 -- start start 2024-09-15T20:47:16.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f01162e9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01100aef60 0x7f0110145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.160 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f01162e9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01100b1b50 0x7f01101e8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f01162e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0110143630 0x7f01101e8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f01162e9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f011006d7a0 con 0x7f01100b1b50 2024-09-15T20:47:16.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f01162e9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f011006d620 con 0x7f0110143630 2024-09-15T20:47:16.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f01162e9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f011006d920 con 0x7f01100aef60 2024-09-15T20:47:16.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f010ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01100aef60 0x7f0110145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f010ffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01100aef60 0x7f0110145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44806/0 (socket says 172.21.15.52:44806) 2024-09-15T20:47:16.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f010ffff640 1 -- 172.21.15.52:0/2068313724 learned_addr learned my addr 172.21.15.52:0/2068313724 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f0114886640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0110143630 0x7f01101e8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.161 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f010f7fe640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01100b1b50 0x7f01101e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47c91c2640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4149010 0x7f47c4132610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47c89c1640 1 -- 172.21.15.52:0/227867518 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c414b030 msgr2=0x7f47c4149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47c89c1640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c414b030 0x7f47c4149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47c89c1640 1 -- 172.21.15.52:0/227867518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4149010 msgr2=0x7f47c4132610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47c89c1640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c4149010 0x7f47c4132610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47c89c1640 1 -- 172.21.15.52:0/227867518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c40aae20 con 0x7f47c4148360 2024-09-15T20:47:16.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47c89c1640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c4148360 0x7f47c4146bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f47b400b440 tx=0x7f47b400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f88dd424640 1 -- 172.21.15.52:0/2204731157 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d81456b0 con 0x7f88d80afec0 2024-09-15T20:47:16.162 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f88dd424640 1 -- 172.21.15.52:0/2204731157 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d81449a0 con 0x7f88d80afec0 2024-09-15T20:47:16.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f88dd424640 1 -- 172.21.15.52:0/2204731157 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f88b8000f90 con 0x7f88d80afec0 2024-09-15T20:47:16.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47c17fa640 1 -- 172.21.15.52:0/227867518 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4015020 con 0x7f47c4148360 2024-09-15T20:47:16.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd86e7fc640 1 -- 172.21.15.52:0/3226218149 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874017070 con 0x7fd878070d70 2024-09-15T20:47:16.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3226218149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd878146f40 con 0x7fd878070d70 2024-09-15T20:47:16.163 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3226218149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd87813c160 con 0x7fd878070d70 2024-09-15T20:47:16.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd86e7fc640 1 -- 172.21.15.52:0/3226218149 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd874003600 con 0x7fd878070d70 2024-09-15T20:47:16.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd86e7fc640 1 -- 172.21.15.52:0/3226218149 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8740039f0 con 0x7fd878070d70 2024-09-15T20:47:16.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f010ffff640 1 -- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0110143630 msgr2=0x7f01101e8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f010ffff640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0110143630 0x7f01101e8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f010ffff640 1 -- 172.21.15.52:0/2068313724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01100b1b50 msgr2=0x7f01101e8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.164 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f010ffff640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01100b1b50 0x7f01101e8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f010ffff640 1 -- 172.21.15.52:0/2068313724 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0110147240 con 0x7f01100aef60 2024-09-15T20:47:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f010ffff640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01100aef60 0x7f0110145540 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f010400e930 tx=0x7f010400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47c17fa640 1 -- 172.21.15.52:0/227867518 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b4011830 con 0x7f47c4148360 2024-09-15T20:47:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47c17fa640 1 -- 172.21.15.52:0/227867518 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4011c20 con 0x7f47c4148360 2024-09-15T20:47:16.165 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47cac25640 1 -- 172.21.15.52:0/227867518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c414a6b0 con 0x7f47c4148360 2024-09-15T20:47:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3226218149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd860000f90 con 0x7fd878070d70 2024-09-15T20:47:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.113+0000 7f30c08db640 1 -- 172.21.15.52:0/4071268338 wait complete. 2024-09-15T20:47:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47cac25640 1 -- 172.21.15.52:0/227867518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c4132b50 con 0x7f47c4148360 2024-09-15T20:47:16.166 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f47cac25640 1 -- 172.21.15.52:0/227867518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f47c414a420 con 0x7f47c4148360 2024-09-15T20:47:16.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f30c08db640 1 Processor -- start 2024-09-15T20:47:16.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fce5e7fc640 1 --2- 172.21.15.52:0/3146585167 >> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] conn(0x7fce4c079400 0x7fce4c07b840 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.167 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f30c08db640 1 -- start start 2024-09-15T20:47:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7fa280ff9640 1 -- 172.21.15.52:0/132693650 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fa27801a070 con 0x7fa27c031840 2024-09-15T20:47:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fa280ff9640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa268072f90 0x7fa268075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f88bf7fe640 1 -- 172.21.15.52:0/2204731157 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f88cc0b93d0 con 0x7f88d80afec0 2024-09-15T20:47:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f88bf7fe640 1 --2- 172.21.15.52:0/2204731157 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f88c4072ec0 0x7f88c4075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.168 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.117+0000 7f88bf7fe640 1 -- 172.21.15.52:0/2204731157 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f88cc12e140 con 0x7f88d80afec0 2024-09-15T20:47:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f88bf7fe640 1 --2- 172.21.15.52:0/2204731157 >> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] conn(0x7f88c4079300 0x7f88c407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f88bf7fe640 1 -- 172.21.15.52:0/2204731157 --> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88cc0bbe50 con 0x7f88c4079300 2024-09-15T20:47:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fa280ff9640 1 -- 172.21.15.52:0/132693650 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7fa278093e00 con 0x7fa27c031840 2024-09-15T20:47:16.169 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f88bf7fe640 1 -- 172.21.15.52:0/2204731157 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f88cc135050 con 0x7f88d80afec0 2024-09-15T20:47:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fa2837fe640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa268072f90 0x7fa268075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fa280ff9640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] conn(0x7fa2680793d0 0x7fa26807b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fa280ff9640 1 -- 172.21.15.52:0/132693650 --> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa278022e50 con 0x7fa2680793d0 2024-09-15T20:47:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fa280ff9640 1 -- 172.21.15.52:0/132693650 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa2780941f0 con 0x7fa27c031840 2024-09-15T20:47:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f88d6ffd640 1 --2- 172.21.15.52:0/2204731157 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f88c4072ec0 0x7f88c4075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.170 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fa288ca1640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] conn(0x7fa2680793d0 0x7fa26807b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f88d77fe640 1 --2- 172.21.15.52:0/2204731157 >> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] conn(0x7f88c4079300 0x7f88c407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f010cff9640 1 -- 172.21.15.52:0/2068313724 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0104017070 con 0x7f01100aef60 2024-09-15T20:47:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f010cff9640 1 -- 172.21.15.52:0/2068313724 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010400ca00 con 0x7f01100aef60 2024-09-15T20:47:16.171 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f010cff9640 1 -- 172.21.15.52:0/2068313724 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010400cdb0 con 0x7f01100aef60 2024-09-15T20:47:16.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fd86e7fc640 1 -- 172.21.15.52:0/3226218149 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fd87401a070 con 0x7fd878070d70 2024-09-15T20:47:16.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fa288ca1640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] conn(0x7fa2680793d0 0x7fa26807b810 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fa2837fe640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa268072f90 0x7fa268075450 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa2700ae000 tx=0x7fa2700a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.172 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fd86e7fc640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fd85c072fc0 0x7fd85c075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f01162e9640 1 -- 172.21.15.52:0/2068313724 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0110145c30 con 0x7f01100aef60 2024-09-15T20:47:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f01162e9640 1 -- 172.21.15.52:0/2068313724 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0110146150 con 0x7f01100aef60 2024-09-15T20:47:16.173 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f01162e9640 1 -- 172.21.15.52:0/2068313724 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0110143ae0 con 0x7f01100aef60 2024-09-15T20:47:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fd86e7fc640 1 -- 172.21.15.52:0/3226218149 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7fd8740933f0 con 0x7fd878070d70 2024-09-15T20:47:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fd87d839640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fd85c072fc0 0x7fd85c075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fd86e7fc640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x7fd85c079400 0x7fd85c07b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fd86e7fc640 1 -- 172.21.15.52:0/3226218149 --> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd85c07bf10 con 0x7fd85c079400 2024-09-15T20:47:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fd86e7fc640 1 -- 172.21.15.52:0/3226218149 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fd8740937e0 con 0x7fd878070d70 2024-09-15T20:47:16.174 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fd87e03a640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x7fd85c079400 0x7fd85c07b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fa280ff9640 1 -- 172.21.15.52:0/132693650 <== osd.0 v2:172.21.15.52:6800/1039594647 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa278022e50 con 0x7fa2680793d0 2024-09-15T20:47:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fd87e03a640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x7fd85c079400 0x7fd85c07b840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fd87d839640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fd85c072fc0 0x7fd85c075480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd8700012f0 tx=0x7fd870001bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f88d6ffd640 1 --2- 172.21.15.52:0/2204731157 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f88c4072ec0 0x7f88c4075380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88c8007fd0 tx=0x7f88c8007ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f88d77fe640 1 --2- 172.21.15.52:0/2204731157 >> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] conn(0x7f88c4079300 0x7f88c407b740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30c08db640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30bc0b0e00 0x7f30bc1ec0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30c08db640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30bc13c770 0x7f30bc1ec630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30c08db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc13f410 0x7f30bc13d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30c08db640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc143110 con 0x7f30bc13c770 2024-09-15T20:47:16.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30c08db640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc06a440 con 0x7f30bc13f410 2024-09-15T20:47:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30c08db640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f30bc143290 con 0x7f30bc0b0e00 2024-09-15T20:47:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc13f410 0x7f30bc13d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc13f410 0x7f30bc13d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.52:54768/0 (socket says 172.21.15.52:54768) 2024-09-15T20:47:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30bbfff640 1 -- 172.21.15.52:0/2169197882 learned_addr learned my addr 172.21.15.52:0/2169197882 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30bb7fe640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30bc0b0e00 0x7f30bc1ec0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30baffd640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30bc13c770 0x7f30bc1ec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30bbfff640 1 -- 172.21.15.52:0/2169197882 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30bc0b0e00 msgr2=0x7f30bc1ec0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30bbfff640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f30bc0b0e00 0x7f30bc1ec0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30bbfff640 1 -- 172.21.15.52:0/2169197882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30bc13c770 msgr2=0x7f30bc1ec630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30bbfff640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f30bc13c770 0x7f30bc1ec630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30bbfff640 1 -- 172.21.15.52:0/2169197882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc13e570 con 0x7f30bc13f410 2024-09-15T20:47:16.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30bbfff640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc13f410 0x7f30bc13d3e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f30b40af040 tx=0x7f30b4019720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30a3fff640 1 -- 172.21.15.52:0/2169197882 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40bc070 con 0x7f30bc13f410 2024-09-15T20:47:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30a3fff640 1 -- 172.21.15.52:0/2169197882 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b40adb30 con 0x7f30bc13f410 2024-09-15T20:47:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30a3fff640 1 -- 172.21.15.52:0/2169197882 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40b8440 con 0x7f30bc13f410 2024-09-15T20:47:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30c08db640 1 -- 172.21.15.52:0/2169197882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30bc140fa0 con 0x7f30bc13f410 2024-09-15T20:47:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30c08db640 1 -- 172.21.15.52:0/2169197882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30bc13daf0 con 0x7f30bc13f410 2024-09-15T20:47:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f4049655640 1 Processor -- start 2024-09-15T20:47:16.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f4049655640 1 -- start start 2024-09-15T20:47:16.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fce47fff640 1 -- 172.21.15.52:0/3146585167 <== osd.2 v2:172.21.15.52:6824/4164590883 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce4c07bf10 con 0x7fce4c079400 2024-09-15T20:47:16.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7f30c08db640 1 -- 172.21.15.52:0/2169197882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f30bc1ebca0 con 0x7f30bc13f410 2024-09-15T20:47:16.179 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.121+0000 7fd86e7fc640 1 -- 172.21.15.52:0/3226218149 <== osd.3 v2:172.21.15.52:6808/4053631670 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd85c07bf10 con 0x7fd85c079400 2024-09-15T20:47:16.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f4049655640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4044070d50 0x7f4044140070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f4049655640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4044071130 0x7f40441405b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f4049655640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40440744f0 con 0x7f4044073950 2024-09-15T20:47:16.180 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f4049655640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f404413fb20 con 0x7f4044070d50 2024-09-15T20:47:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f4049655640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f4044072fc0 con 0x7f4044071130 2024-09-15T20:47:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f4042ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4044070d50 0x7f4044140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f4042ffd640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4044070d50 0x7f4044140070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45502/0 (socket says 172.21.15.52:45502) 2024-09-15T20:47:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f4042ffd640 1 -- 172.21.15.52:0/446900244 learned_addr learned my addr 172.21.15.52:0/446900244 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f4042ffd640 1 -- 172.21.15.52:0/446900244 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4044071130 msgr2=0x7f40441405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f4042ffd640 1 --2- 172.21.15.52:0/446900244 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4044071130 0x7f40441405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f4042ffd640 1 -- 172.21.15.52:0/446900244 >> v1:172.21.15.52:6789/0 conn(0x7f4044073950 legacy=0x7f4044073de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f4042ffd640 1 -- 172.21.15.52:0/446900244 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40440732a0 con 0x7f4044070d50 2024-09-15T20:47:16.181 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f47c17fa640 1 -- 172.21.15.52:0/227867518 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f47b4018020 con 0x7f47c4148360 2024-09-15T20:47:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f47c17fa640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f47b0072f90 0x7f47b0075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f47c17fa640 1 -- 172.21.15.52:0/227867518 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f47b4093e20 con 0x7f47c4148360 2024-09-15T20:47:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f47c17fa640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] conn(0x7f47b00793d0 0x7f47b007b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f47c17fa640 1 -- 172.21.15.52:0/227867518 --> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47b4012e50 con 0x7f47b00793d0 2024-09-15T20:47:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f30a3fff640 1 -- 172.21.15.52:0/2169197882 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f30b40bf070 con 0x7f30bc13f410 2024-09-15T20:47:16.182 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f30a3fff640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f30a8072ec0 0x7f30a8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f47c17fa640 1 -- 172.21.15.52:0/227867518 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f47b4094210 con 0x7f47c4148360 2024-09-15T20:47:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f30a3fff640 1 -- 172.21.15.52:0/2169197882 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f30b412f3f0 con 0x7f30bc13f410 2024-09-15T20:47:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f30a3fff640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] conn(0x7f30a8079300 0x7f30a807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f30a3fff640 1 -- 172.21.15.52:0/2169197882 --> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30a807be10 con 0x7f30a8079300 2024-09-15T20:47:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f30a3fff640 1 -- 172.21.15.52:0/2169197882 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f30b412f7e0 con 0x7f30bc13f410 2024-09-15T20:47:16.183 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f30bb7fe640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f30a8072ec0 0x7f30a8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f47c3fff640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f47b0072f90 0x7f47b0075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f30bb7fe640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f30a8072ec0 0x7f30a8075380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009980 tx=0x7f30b00090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f88bf7fe640 1 -- 172.21.15.52:0/2204731157 <== osd.7 v2:172.21.15.81:6824/579210364 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88cc0bbe50 con 0x7f88c4079300 2024-09-15T20:47:16.184 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f30baffd640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] conn(0x7f30a8079300 0x7f30a807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f47c91c2640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] conn(0x7f47b00793d0 0x7f47b007b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.125+0000 7f010cff9640 1 -- 172.21.15.52:0/2068313724 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f010401a070 con 0x7f01100aef60 2024-09-15T20:47:16.185 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f30baffd640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] conn(0x7f30a8079300 0x7f30a807b740 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f47c3fff640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f47b0072f90 0x7f47b0075450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47bc01b0c0 tx=0x7f47bc0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f010cff9640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f00fc072ec0 0x7f00fc075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f010cff9640 1 -- 172.21.15.52:0/2068313724 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f0104093e00 con 0x7f01100aef60 2024-09-15T20:47:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f010cff9640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] conn(0x7f00fc079300 0x7f00fc07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f010cff9640 1 -- 172.21.15.52:0/2068313724 --> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00fc07be10 con 0x7f00fc079300 2024-09-15T20:47:16.186 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f010cff9640 1 -- 172.21.15.52:0/2068313724 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f0104096400 con 0x7f01100aef60 2024-09-15T20:47:16.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f30a3fff640 1 -- 172.21.15.52:0/2169197882 <== osd.1 v2:172.21.15.52:6816/1590363289 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f30a807be10 con 0x7f30a8079300 2024-09-15T20:47:16.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f4042ffd640 1 --2- 172.21.15.52:0/446900244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4044070d50 0x7f4044140070 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4034006fd0 tx=0x7f403401e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e381933311f73c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.187 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f4041ffb640 1 -- 172.21.15.52:0/446900244 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40340ad070 con 0x7f4044070d50 2024-09-15T20:47:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f4041ffb640 1 -- 172.21.15.52:0/446900244 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4034004230 con 0x7f4044070d50 2024-09-15T20:47:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f4041ffb640 1 -- 172.21.15.52:0/446900244 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40340a7670 con 0x7f4044070d50 2024-09-15T20:47:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f4049655640 1 -- 172.21.15.52:0/446900244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4044070d50 msgr2=0x7f4044140070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f4049655640 1 --2- 172.21.15.52:0/446900244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4044070d50 0x7f4044140070 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4034006fd0 tx=0x7f403401e960 comp rx=0 tx=0).stop 2024-09-15T20:47:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f0114886640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] conn(0x7f00fc079300 0x7f00fc07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f0114886640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] conn(0x7f00fc079300 0x7f00fc07b740 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.188 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f010f7fe640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f00fc072ec0 0x7f00fc075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f4049655640 1 -- 172.21.15.52:0/446900244 shutdown_connections 2024-09-15T20:47:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f4049655640 1 --2- 172.21.15.52:0/446900244 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4044071130 0x7f40441405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f4049655640 1 --2- 172.21.15.52:0/446900244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4044070d50 0x7f4044140070 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4034006fd0 tx=0x7f403401e960 comp rx=0 tx=0).stop 2024-09-15T20:47:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f4049655640 1 -- 172.21.15.52:0/446900244 >> 172.21.15.52:0/446900244 conn(0x7f40440b5930 msgr2=0x7f40440b5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.189 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f4049655640 1 -- 172.21.15.52:0/446900244 shutdown_connections 2024-09-15T20:47:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f010f7fe640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f00fc072ec0 0x7f00fc075380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f01080af000 tx=0x7f01080a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.190 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f010cff9640 1 -- 172.21.15.52:0/2068313724 <== osd.4 v2:172.21.15.81:6816/1105997015 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00fc07be10 con 0x7f00fc079300 2024-09-15T20:47:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.129+0000 7f4049655640 1 -- 172.21.15.52:0/446900244 wait complete. 2024-09-15T20:47:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4049655640 1 Processor -- start 2024-09-15T20:47:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4049655640 1 -- start start 2024-09-15T20:47:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4049655640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4044071130 0x7f40440ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4049655640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4044073950 0x7f40440aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.192 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4042ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4044071130 0x7f40440ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4042ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4044071130 0x7f40440ac9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45518/0 (socket says 172.21.15.52:45518) 2024-09-15T20:47:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4042ffd640 1 -- 172.21.15.52:0/168861703 learned_addr learned my addr 172.21.15.52:0/168861703 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4049655640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4044146a30 0x7f4044146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4049655640 1 -- 172.21.15.52:0/168861703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f404414c770 con 0x7f4044071130 2024-09-15T20:47:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4049655640 1 -- 172.21.15.52:0/168861703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f404414c5f0 con 0x7f4044073950 2024-09-15T20:47:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4049655640 1 -- 172.21.15.52:0/168861703 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f404414c8f0 con 0x7f4044146a30 2024-09-15T20:47:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f40437fe640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4044146a30 0x7f4044146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f40427fc640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4044073950 0x7f40440aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4042ffd640 1 -- 172.21.15.52:0/168861703 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4044146a30 msgr2=0x7f4044146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4042ffd640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4044146a30 0x7f4044146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.193 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4042ffd640 1 -- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4044073950 msgr2=0x7f40440aa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4042ffd640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4044073950 0x7f40440aa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4042ffd640 1 -- 172.21.15.52:0/168861703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40440abfe0 con 0x7f4044071130 2024-09-15T20:47:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4042ffd640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4044071130 0x7f40440ac9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4034006fd0 tx=0x7f403401b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f402b7fe640 1 -- 172.21.15.52:0/168861703 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40340b7070 con 0x7f4044071130 2024-09-15T20:47:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f402b7fe640 1 -- 172.21.15.52:0/168861703 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4034003620 con 0x7f4044071130 2024-09-15T20:47:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f402b7fe640 1 -- 172.21.15.52:0/168861703 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40340ad050 con 0x7f4044071130 2024-09-15T20:47:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4049655640 1 -- 172.21.15.52:0/168861703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40440ac2c0 con 0x7f4044071130 2024-09-15T20:47:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.133+0000 7f4049655640 1 -- 172.21.15.52:0/168861703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40440aaa20 con 0x7f4044071130 2024-09-15T20:47:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.137+0000 7f40297fa640 1 -- 172.21.15.52:0/168861703 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f401c000f90 con 0x7f4044071130 2024-09-15T20:47:16.194 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.137+0000 7f402b7fe640 1 -- 172.21.15.52:0/168861703 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f40340c2060 con 0x7f4044071130 2024-09-15T20:47:16.195 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.137+0000 7f47c91c2640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] conn(0x7f47b00793d0 0x7f47b007b810 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.137+0000 7f402b7fe640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4030072ec0 0x7f4030075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.137+0000 7f402b7fe640 1 -- 172.21.15.52:0/168861703 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f4034132060 con 0x7f4044071130 2024-09-15T20:47:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.137+0000 7f402b7fe640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] conn(0x7f4030079300 0x7f403007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.137+0000 7f402b7fe640 1 -- 172.21.15.52:0/168861703 --> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40340a9e80 con 0x7f4030079300 2024-09-15T20:47:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.137+0000 7f402b7fe640 1 -- 172.21.15.52:0/168861703 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f403412d450 con 0x7f4044071130 2024-09-15T20:47:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.137+0000 7f40427fc640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4030072ec0 0x7f4030075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.137+0000 7f40437fe640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] conn(0x7f4030079300 0x7f403007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.141+0000 7f40427fc640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4030072ec0 0x7f4030075380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40440ab9f0 tx=0x7f4038009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.141+0000 7f40437fe640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] conn(0x7f4030079300 0x7f403007b740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.196 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.141+0000 7f402b7fe640 1 -- 172.21.15.52:0/168861703 <== osd.5 v2:172.21.15.81:6808/1585962119 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f40340a9e80 con 0x7f4030079300 2024-09-15T20:47:16.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.141+0000 7f47c17fa640 1 -- 172.21.15.52:0/227867518 <== osd.6 v2:172.21.15.81:6800/1367983121 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f47b4012e50 con 0x7f47b00793d0 2024-09-15T20:47:16.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.141+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3226218149 --> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd860002c00 con 0x7fd85c079400 2024-09-15T20:47:16.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.145+0000 7fd86e7fc640 1 -- 172.21.15.52:0/3226218149 <== osd.3 v2:172.21.15.52:6808/4053631670 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd860002c00 con 0x7fd85c079400 2024-09-15T20:47:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.145+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3226218149 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x7fd85c079400 msgr2=0x7fd85c07b840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.145+0000 7fd87fa9d640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x7fd85c079400 0x7fd85c07b840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.145+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3226218149 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fd85c072fc0 msgr2=0x7fd85c075480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.145+0000 7fd87fa9d640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fd85c072fc0 0x7fd85c075480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd8700012f0 tx=0x7fd870001bb0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.145+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3226218149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd878070d70 msgr2=0x7fd878147a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.145+0000 7fd87fa9d640 1 --2- 172.21.15.52:0/3226218149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd878070d70 0x7fd878147a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd87400c430 tx=0x7fd87400c8f0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.145+0000 7fd87e03a640 1 -- 172.21.15.52:0/3226218149 reap_dead start 2024-09-15T20:47:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.145+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3226218149 shutdown_connections 2024-09-15T20:47:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.145+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3226218149 >> 172.21.15.52:0/3226218149 conn(0x7fd8780b5290 msgr2=0x7fd8780b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.145+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3226218149 shutdown_connections 2024-09-15T20:47:16.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.145+0000 7fd87fa9d640 1 -- 172.21.15.52:0/3226218149 wait complete. 2024-09-15T20:47:16.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.149+0000 7fa28a704640 1 -- 172.21.15.52:0/132693650 --> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa27c0c90f0 con 0x7fa2680793d0 2024-09-15T20:47:16.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.149+0000 7fce5ffff640 1 -- 172.21.15.52:0/3146585167 --> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fce40002c80 con 0x7fce4c079400 2024-09-15T20:47:16.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.149+0000 7fa280ff9640 1 -- 172.21.15.52:0/132693650 <== osd.0 v2:172.21.15.52:6800/1039594647 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa27c0c90f0 con 0x7fa2680793d0 2024-09-15T20:47:16.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.149+0000 7fce47fff640 1 -- 172.21.15.52:0/3146585167 <== osd.2 v2:172.21.15.52:6824/4164590883 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fce40002c80 con 0x7fce4c079400 2024-09-15T20:47:16.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fa26e7fc640 1 -- 172.21.15.52:0/132693650 >> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] conn(0x7fa2680793d0 msgr2=0x7fa26807b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fa26e7fc640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] conn(0x7fa2680793d0 0x7fa26807b810 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fa26e7fc640 1 -- 172.21.15.52:0/132693650 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa268072f90 msgr2=0x7fa268075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fa26e7fc640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa268072f90 0x7fa268075450 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa2700ae000 tx=0x7fa2700a7000 comp rx=0 tx=0).stop 2024-09-15T20:47:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fa26e7fc640 1 -- 172.21.15.52:0/132693650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa27c031840 msgr2=0x7fa27c0d5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fa26e7fc640 1 --2- 172.21.15.52:0/132693650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa27c031840 0x7fa27c0d5b20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa27800e930 tx=0x7fa27800edf0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.202 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fa288ca1640 1 -- 172.21.15.52:0/132693650 reap_dead start 2024-09-15T20:47:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fa26e7fc640 1 -- 172.21.15.52:0/132693650 shutdown_connections 2024-09-15T20:47:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fa26e7fc640 1 -- 172.21.15.52:0/132693650 >> 172.21.15.52:0/132693650 conn(0x7fa27c005c30 msgr2=0x7fa27c0ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fce5ffff640 1 -- 172.21.15.52:0/3146585167 >> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] conn(0x7fce4c079400 msgr2=0x7fce4c07b840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fce5ffff640 1 --2- 172.21.15.52:0/3146585167 >> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] conn(0x7fce4c079400 0x7fce4c07b840 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.203 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fa26e7fc640 1 -- 172.21.15.52:0/132693650 shutdown_connections 2024-09-15T20:47:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fce5ffff640 1 -- 172.21.15.52:0/3146585167 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fce4c072fc0 msgr2=0x7fce4c075480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fce5ffff640 1 --2- 172.21.15.52:0/3146585167 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fce4c072fc0 0x7fce4c075480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fce500ad000 tx=0x7fce50004740 comp rx=0 tx=0).stop 2024-09-15T20:47:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fce5ffff640 1 -- 172.21.15.52:0/3146585167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce601428b0 msgr2=0x7fce601ebf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fce5ffff640 1 --2- 172.21.15.52:0/3146585167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fce601428b0 0x7fce601ebf00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fce5400c410 tx=0x7fce5400c8d0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fce5f7fe640 1 -- 172.21.15.52:0/3146585167 reap_dead start 2024-09-15T20:47:16.204 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fa26e7fc640 1 -- 172.21.15.52:0/132693650 wait complete. 2024-09-15T20:47:16.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fce5ffff640 1 -- 172.21.15.52:0/3146585167 shutdown_connections 2024-09-15T20:47:16.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fce5ffff640 1 -- 172.21.15.52:0/3146585167 >> 172.21.15.52:0/3146585167 conn(0x7fce600b4f40 msgr2=0x7fce600b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fce5ffff640 1 -- 172.21.15.52:0/3146585167 shutdown_connections 2024-09-15T20:47:16.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.153+0000 7fce5ffff640 1 -- 172.21.15.52:0/3146585167 wait complete. 2024-09-15T20:47:16.205 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.157+0000 7f30c08db640 1 -- 172.21.15.52:0/2169197882 --> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f30bc1436c0 con 0x7f30a8079300 2024-09-15T20:47:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.157+0000 7f30a3fff640 1 -- 172.21.15.52:0/2169197882 <== osd.1 v2:172.21.15.52:6816/1590363289 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f30bc1436c0 con 0x7f30a8079300 2024-09-15T20:47:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.157+0000 7f01162e9640 1 -- 172.21.15.52:0/2068313724 --> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0110145e00 con 0x7f00fc079300 2024-09-15T20:47:16.206 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.157+0000 7f010cff9640 1 -- 172.21.15.52:0/2068313724 <== osd.4 v2:172.21.15.81:6816/1105997015 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0110145e00 con 0x7f00fc079300 2024-09-15T20:47:16.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.157+0000 7f01162e9640 1 -- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] conn(0x7f00fc079300 msgr2=0x7f00fc07b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.157+0000 7f01162e9640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] conn(0x7f00fc079300 0x7f00fc07b740 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.157+0000 7f01162e9640 1 -- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f00fc072ec0 msgr2=0x7f00fc075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.157+0000 7f01162e9640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f00fc072ec0 0x7f00fc075380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f01080af000 tx=0x7f01080a7070 comp rx=0 tx=0).stop 2024-09-15T20:47:16.207 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.157+0000 7f88dd424640 1 -- 172.21.15.52:0/2204731157 --> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f88b8002c80 con 0x7f88c4079300 2024-09-15T20:47:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.157+0000 7f01162e9640 1 -- 172.21.15.52:0/2068313724 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01100aef60 msgr2=0x7f0110145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.157+0000 7f01162e9640 1 --2- 172.21.15.52:0/2068313724 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f01100aef60 0x7f0110145540 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f010400e930 tx=0x7f010400edf0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.157+0000 7f0114886640 1 -- 172.21.15.52:0/2068313724 reap_dead start 2024-09-15T20:47:16.208 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f01162e9640 1 -- 172.21.15.52:0/2068313724 shutdown_connections 2024-09-15T20:47:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f01162e9640 1 -- 172.21.15.52:0/2068313724 >> 172.21.15.52:0/2068313724 conn(0x7f01100b29e0 msgr2=0x7f011013b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f01162e9640 1 -- 172.21.15.52:0/2068313724 shutdown_connections 2024-09-15T20:47:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f88bf7fe640 1 -- 172.21.15.52:0/2204731157 <== osd.7 v2:172.21.15.81:6824/579210364 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f88b8002c80 con 0x7f88c4079300 2024-09-15T20:47:16.209 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f01162e9640 1 -- 172.21.15.52:0/2068313724 wait complete. 2024-09-15T20:47:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f88dd424640 1 -- 172.21.15.52:0/2204731157 >> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] conn(0x7f88c4079300 msgr2=0x7f88c407b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f88dd424640 1 --2- 172.21.15.52:0/2204731157 >> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] conn(0x7f88c4079300 0x7f88c407b740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f88dd424640 1 -- 172.21.15.52:0/2204731157 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f88c4072ec0 msgr2=0x7f88c4075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f88dd424640 1 --2- 172.21.15.52:0/2204731157 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f88c4072ec0 0x7f88c4075380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88c8007fd0 tx=0x7f88c8007ed0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f88dd424640 1 -- 172.21.15.52:0/2204731157 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88d80afec0 msgr2=0x7f88d80aaa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f88dd424640 1 --2- 172.21.15.52:0/2204731157 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f88d80afec0 0x7f88d80aaa20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0ae000 tx=0x7f88cc01b860 comp rx=0 tx=0).stop 2024-09-15T20:47:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f88d77fe640 1 -- 172.21.15.52:0/2204731157 reap_dead start 2024-09-15T20:47:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f88dd424640 1 -- 172.21.15.52:0/2204731157 shutdown_connections 2024-09-15T20:47:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f88dd424640 1 -- 172.21.15.52:0/2204731157 >> 172.21.15.52:0/2204731157 conn(0x7f88d80b5290 msgr2=0x7f88d81425d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.211 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f88dd424640 1 -- 172.21.15.52:0/2204731157 shutdown_connections 2024-09-15T20:47:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.161+0000 7f88dd424640 1 -- 172.21.15.52:0/2204731157 wait complete. 2024-09-15T20:47:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f40297fa640 1 -- 172.21.15.52:0/168861703 --> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f401c002c80 con 0x7f4030079300 2024-09-15T20:47:16.212 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f402b7fe640 1 -- 172.21.15.52:0/168861703 <== osd.5 v2:172.21.15.81:6808/1585962119 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f401c002c80 con 0x7f4030079300 2024-09-15T20:47:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f40297fa640 1 -- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] conn(0x7f4030079300 msgr2=0x7f403007b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f40297fa640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] conn(0x7f4030079300 0x7f403007b740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f40297fa640 1 -- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4030072ec0 msgr2=0x7f4030075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f40297fa640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4030072ec0 0x7f4030075380 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40440ab9f0 tx=0x7f4038009110 comp rx=0 tx=0).stop 2024-09-15T20:47:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f40297fa640 1 -- 172.21.15.52:0/168861703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4044071130 msgr2=0x7f40440ac9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f40297fa640 1 --2- 172.21.15.52:0/168861703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4044071130 0x7f40440ac9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4034006fd0 tx=0x7f403401b700 comp rx=0 tx=0).stop 2024-09-15T20:47:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f40437fe640 1 -- 172.21.15.52:0/168861703 reap_dead start 2024-09-15T20:47:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f40297fa640 1 -- 172.21.15.52:0/168861703 shutdown_connections 2024-09-15T20:47:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f40297fa640 1 -- 172.21.15.52:0/168861703 >> 172.21.15.52:0/168861703 conn(0x7f40440b5930 msgr2=0x7f40440b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f40297fa640 1 -- 172.21.15.52:0/168861703 shutdown_connections 2024-09-15T20:47:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f40297fa640 1 -- 172.21.15.52:0/168861703 wait complete. 2024-09-15T20:47:16.214 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.169+0000 7f47cac25640 1 -- 172.21.15.52:0/227867518 --> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f47c4147e20 con 0x7f47b00793d0 2024-09-15T20:47:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f30c08db640 1 -- 172.21.15.52:0/2169197882 >> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] conn(0x7f30a8079300 msgr2=0x7f30a807b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f30c08db640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] conn(0x7f30a8079300 0x7f30a807b740 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f30c08db640 1 -- 172.21.15.52:0/2169197882 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f30a8072ec0 msgr2=0x7f30a8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f30c08db640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f30a8072ec0 0x7f30a8075380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f30b0009980 tx=0x7f30b00090e0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f30c08db640 1 -- 172.21.15.52:0/2169197882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc13f410 msgr2=0x7f30bc13d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f30c08db640 1 --2- 172.21.15.52:0/2169197882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30bc13f410 0x7f30bc13d3e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f30b40af040 tx=0x7f30b4019720 comp rx=0 tx=0).stop 2024-09-15T20:47:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f30bbfff640 1 -- 172.21.15.52:0/2169197882 reap_dead start 2024-09-15T20:47:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f47c17fa640 1 -- 172.21.15.52:0/227867518 <== osd.6 v2:172.21.15.81:6800/1367983121 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f47c4147e20 con 0x7f47b00793d0 2024-09-15T20:47:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f30c08db640 1 -- 172.21.15.52:0/2169197882 shutdown_connections 2024-09-15T20:47:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f30c08db640 1 -- 172.21.15.52:0/2169197882 >> 172.21.15.52:0/2169197882 conn(0x7f30bc0b1c90 msgr2=0x7f30bc0740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f30c08db640 1 -- 172.21.15.52:0/2169197882 shutdown_connections 2024-09-15T20:47:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f30c08db640 1 -- 172.21.15.52:0/2169197882 wait complete. 2024-09-15T20:47:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f47cac25640 1 -- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] conn(0x7f47b00793d0 msgr2=0x7f47b007b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f47cac25640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] conn(0x7f47b00793d0 0x7f47b007b810 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f47cac25640 1 -- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f47b0072f90 msgr2=0x7f47b0075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f47cac25640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f47b0072f90 0x7f47b0075450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47bc01b0c0 tx=0x7f47bc0a7070 comp rx=0 tx=0).stop 2024-09-15T20:47:16.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f47cac25640 1 -- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c4148360 msgr2=0x7f47c4146bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f47cac25640 1 --2- 172.21.15.52:0/227867518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c4148360 0x7f47c4146bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f47b400b440 tx=0x7f47b400b900 comp rx=0 tx=0).stop 2024-09-15T20:47:16.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f47c91c2640 1 -- 172.21.15.52:0/227867518 reap_dead start 2024-09-15T20:47:16.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f47cac25640 1 -- 172.21.15.52:0/227867518 shutdown_connections 2024-09-15T20:47:16.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f47cac25640 1 -- 172.21.15.52:0/227867518 >> 172.21.15.52:0/227867518 conn(0x7f47c40b21c0 msgr2=0x7f47c406d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.218 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f47cac25640 1 -- 172.21.15.52:0/227867518 shutdown_connections 2024-09-15T20:47:16.219 INFO:teuthology.orchestra.run.smithi052.stdout:60129542148 2024-09-15T20:47:16.219 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T20:47:16.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.173+0000 7f47cac25640 1 -- 172.21.15.52:0/227867518 wait complete. 2024-09-15T20:47:16.220 INFO:teuthology.orchestra.run.smithi052.stdout:55834574854 2024-09-15T20:47:16.221 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T20:47:16.221 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-09-15T20:47:16.222 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T20:47:16.222 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2024-09-15T20:47:16.223 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T20:47:16.223 INFO:teuthology.orchestra.run.smithi052.stdout:64424509445 2024-09-15T20:47:16.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T20:47:16.225 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2024-09-15T20:47:16.225 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T20:47:16.226 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-09-15T20:47:16.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T20:47:16.227 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2024-09-15T20:47:16.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T20:47:16.435 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9802eb0640 1 Processor -- start 2024-09-15T20:47:16.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9802eb0640 1 -- start start 2024-09-15T20:47:16.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9802eb0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 0x7f97fc140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9802eb0640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f97fc13f4b0 0x7f97fc0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9802eb0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97fc1429f0 0x7f97fc13c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9802eb0640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc13fbd0 con 0x7f97fc13f4b0 2024-09-15T20:47:16.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9802eb0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc13f8b0 con 0x7f97fc1429f0 2024-09-15T20:47:16.436 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9802eb0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc0733e0 con 0x7f97fc0af860 2024-09-15T20:47:16.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9800c4c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 0x7f97fc140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9800c4c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 0x7f97fc140060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44834/0 (socket says 172.21.15.52:44834) 2024-09-15T20:47:16.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9800c4c640 1 -- 172.21.15.52:0/341510596 learned_addr learned my addr 172.21.15.52:0/341510596 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f980144d640 1 --2- 172.21.15.52:0/341510596 >> v2:172.21.15.81:3300/0 conn(0x7f97fc1429f0 0x7f97fc13c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.437 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9800c4c640 1 -- 172.21.15.52:0/341510596 >> v2:172.21.15.81:3300/0 conn(0x7f97fc1429f0 msgr2=0x7f97fc13c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9800c4c640 1 --2- 172.21.15.52:0/341510596 >> v2:172.21.15.81:3300/0 conn(0x7f97fc1429f0 0x7f97fc13c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9800c4c640 1 -- 172.21.15.52:0/341510596 >> v2:172.21.15.52:3300/0 conn(0x7f97fc13f4b0 msgr2=0x7f97fc0b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f97fbfff640 1 --2- 172.21.15.52:0/341510596 >> v2:172.21.15.52:3300/0 conn(0x7f97fc13f4b0 0x7f97fc0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f7ce73df640 1 Processor -- start 2024-09-15T20:47:16.438 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f7ce73df640 1 -- start start 2024-09-15T20:47:16.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9800c4c640 1 --2- 172.21.15.52:0/341510596 >> v2:172.21.15.52:3300/0 conn(0x7f97fc13f4b0 0x7f97fc0b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f9800c4c640 1 -- 172.21.15.52:0/341510596 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc0b15c0 con 0x7f97fc0af860 2024-09-15T20:47:16.439 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f3d20a2e640 1 Processor -- start 2024-09-15T20:47:16.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7f3d20a2e640 1 -- start start 2024-09-15T20:47:16.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7fefeb59e640 1 Processor -- start 2024-09-15T20:47:16.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.433+0000 7fefeb59e640 1 -- start start 2024-09-15T20:47:16.440 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce73df640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ce0074670 0x7f7ce013c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f3d20a2e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3d1c08ca70 0x7f3d1c073330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce73df640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ce013cc40 0x7f7ce014a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce73df640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce0073560 con 0x7f7ce00b0750 2024-09-15T20:47:16.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce73df640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7ce00b0b30 con 0x7f7ce0074670 2024-09-15T20:47:16.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce73df640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f7ce00741e0 con 0x7f7ce013cc40 2024-09-15T20:47:16.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce517b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7ce00b0750 0x7f7ce013f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47390/0 (socket says 172.21.15.52:47390) 2024-09-15T20:47:16.441 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce517b640 1 -- 172.21.15.52:0/897842861 learned_addr learned my addr 172.21.15.52:0/897842861 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:16.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f3d19d9b640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3d1c070960 0x7f3d1c153f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47404/0 (socket says 172.21.15.52:47404) 2024-09-15T20:47:16.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f3d1a59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3d1c08ca70 0x7f3d1c073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.442 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f3d1a59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3d1c08ca70 0x7f3d1c073330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45534/0 (socket says 172.21.15.52:45534) 2024-09-15T20:47:16.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefeb59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fefec0afcf0 0x7fefec1436c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefeb59e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fefec071c50 0x7fefec0745f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefeb59e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefec074110 con 0x7fefec13d2c0 2024-09-15T20:47:16.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefeb59e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fefec0b00d0 con 0x7fefec0afcf0 2024-09-15T20:47:16.443 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefeb59e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fefec0b1430 con 0x7fefec071c50 2024-09-15T20:47:16.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce497a640 1 --2- 172.21.15.52:0/897842861 >> v2:172.21.15.81:3300/0 conn(0x7f7ce0074670 0x7f7ce013c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7cdffff640 1 -- 172.21.15.52:0/897842861 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3541796702 0 0) 0x7f7ce0073560 con 0x7f7ce00b0750 2024-09-15T20:47:16.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7cdffff640 1 -- 172.21.15.52:0/897842861 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc8003530 con 0x7f7ce00b0750 2024-09-15T20:47:16.444 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce597c640 1 --2- 172.21.15.52:0/897842861 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ce013cc40 0x7f7ce014a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefead9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fefec13d2c0 0x7fefec13d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47406/0 (socket says 172.21.15.52:47406) 2024-09-15T20:47:16.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefead9d640 1 -- 172.21.15.52:0/154433844 learned_addr learned my addr 172.21.15.52:0/154433844 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:16.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefea59c640 1 --2- 172.21.15.52:0/154433844 >> v2:172.21.15.81:3300/0 conn(0x7fefec0afcf0 0x7fefec1436c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefe9d9b640 1 --2- 172.21.15.52:0/154433844 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fefec071c50 0x7fefec0745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce497a640 1 -- 172.21.15.52:0/897842861 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ce013cc40 msgr2=0x7f7ce014a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.445 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce497a640 1 --2- 172.21.15.52:0/897842861 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ce013cc40 0x7f7ce014a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce497a640 1 -- 172.21.15.52:0/897842861 >> v1:172.21.15.52:6789/0 conn(0x7f7ce00b0750 legacy=0x7f7ce013f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce497a640 1 -- 172.21.15.52:0/897842861 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce00737d0 con 0x7f7ce0074670 2024-09-15T20:47:16.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f836eb55640 1 Processor -- start 2024-09-15T20:47:16.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec3c17640 1 Processor -- start 2024-09-15T20:47:16.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f836eb55640 1 -- start start 2024-09-15T20:47:16.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefe9d9b640 1 -- 172.21.15.52:0/154433844 >> v2:172.21.15.81:3300/0 conn(0x7fefec0afcf0 msgr2=0x7fefec1436c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefe9d9b640 1 --2- 172.21.15.52:0/154433844 >> v2:172.21.15.81:3300/0 conn(0x7fefec0afcf0 0x7fefec1436c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefe9d9b640 1 -- 172.21.15.52:0/154433844 >> v1:172.21.15.52:6789/0 conn(0x7fefec13d2c0 legacy=0x7fefec13d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7fefe9d9b640 1 -- 172.21.15.52:0/154433844 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefec073a10 con 0x7fefec071c50 2024-09-15T20:47:16.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f3d19d9b640 1 -- 172.21.15.52:0/1647796928 learned_addr learned my addr 172.21.15.52:0/1647796928 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:16.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f46cffff640 1 Processor -- start 2024-09-15T20:47:16.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f46cffff640 1 -- start start 2024-09-15T20:47:16.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f46cffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d013d2f0 0x7f46d0074840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f46cffff640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d0073720 con 0x7f46d00af9a0 2024-09-15T20:47:16.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f46cffff640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d0073a00 con 0x7f46d0073e20 2024-09-15T20:47:16.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f46cffff640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f46d00afd80 con 0x7f46d013d2f0 2024-09-15T20:47:16.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f46ceffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f46d00af9a0 0x7f46d00718d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47416/0 (socket says 172.21.15.52:47416) 2024-09-15T20:47:16.448 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f46ceffd640 1 -- 172.21.15.52:0/312619106 learned_addr learned my addr 172.21.15.52:0/312619106 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:16.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f46cf7fe640 1 --2- 172.21.15.52:0/312619106 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d013d2f0 0x7f46d0074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f97fbfff640 1 --2- 172.21.15.52:0/341510596 >> v2:172.21.15.52:3300/0 conn(0x7f97fc13f4b0 0x7f97fc0b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:47:16.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f9800c4c640 1 --2- 172.21.15.52:0/341510596 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 0x7f97fc140060 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0b1300 tx=0x7f97ec01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bc3cac7175dc6d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.449 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f836eb55640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8368074e00 0x7f8368071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f836eb55640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f836813ca50 0x7f836813cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f836eb55640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8368073690 con 0x7f83680afab0 2024-09-15T20:47:16.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f836eb55640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f8368142cf0 con 0x7f836813ca50 2024-09-15T20:47:16.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f836eb55640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8368142e70 con 0x7f8368074e00 2024-09-15T20:47:16.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f8367fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f83680afab0 0x7f8368071a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.52:52466/0 (socket says 172.21.15.52:52466) 2024-09-15T20:47:16.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f8367fff640 1 -- 172.21.15.52:0/2483500019 learned_addr learned my addr 172.21.15.52:0/2483500019 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f836c8f1640 1 --2- 172.21.15.52:0/2483500019 >> v2:172.21.15.81:3300/0 conn(0x7f8368074e00 0x7f8368071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f83677fe640 1 -- 172.21.15.52:0/2483500019 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1611370026 0 0) 0x7f8368073690 con 0x7f83680afab0 2024-09-15T20:47:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f83677fe640 1 -- 172.21.15.52:0/2483500019 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8358003530 con 0x7f83680afab0 2024-09-15T20:47:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f836c8f1640 1 -- 172.21.15.52:0/2483500019 >> v2:172.21.15.52:3300/0 conn(0x7f836813ca50 msgr2=0x7f836813cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f836d0f2640 1 --2- 172.21.15.52:0/2483500019 >> v2:172.21.15.52:3300/0 conn(0x7f836813ca50 0x7f836813cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f836c8f1640 1 --2- 172.21.15.52:0/2483500019 >> v2:172.21.15.52:3300/0 conn(0x7f836813ca50 0x7f836813cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f836c8f1640 1 -- 172.21.15.52:0/2483500019 >> v1:172.21.15.81:6789/0 conn(0x7f83680afab0 legacy=0x7f8368071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f836c8f1640 1 -- 172.21.15.52:0/2483500019 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8368143020 con 0x7f8368074e00 2024-09-15T20:47:16.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f836d0f2640 1 --2- 172.21.15.52:0/2483500019 >> v2:172.21.15.52:3300/0 conn(0x7f836813ca50 0x7f836813cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:47:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f7ce597c640 1 --2- 172.21.15.52:0/897842861 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ce013cc40 0x7f7ce014a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7ce497a640 1 --2- 172.21.15.52:0/897842861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ce0074670 0x7f7ce013c700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009d90 tx=0x7f7cd001c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f58a6504cbc9cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7cdffff640 1 -- 172.21.15.52:0/897842861 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd00b2070 con 0x7f7ce0074670 2024-09-15T20:47:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7cdffff640 1 -- 172.21.15.52:0/897842861 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd00a57c0 con 0x7f7ce0074670 2024-09-15T20:47:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7cdffff640 1 -- 172.21.15.52:0/897842861 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd00a5b70 con 0x7f7ce0074670 2024-09-15T20:47:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7ce73df640 1 -- 172.21.15.52:0/897842861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ce0074670 msgr2=0x7f7ce013c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7ce73df640 1 --2- 172.21.15.52:0/897842861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ce0074670 0x7f7ce013c700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009d90 tx=0x7f7cd001c8d0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7ce73df640 1 -- 172.21.15.52:0/897842861 shutdown_connections 2024-09-15T20:47:16.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7ce73df640 1 --2- 172.21.15.52:0/897842861 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ce013cc40 0x7f7ce014a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7ce73df640 1 --2- 172.21.15.52:0/897842861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ce0074670 0x7f7ce013c700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7ce73df640 1 -- 172.21.15.52:0/897842861 >> 172.21.15.52:0/897842861 conn(0x7f7ce00b5290 msgr2=0x7f7ce00b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7ce73df640 1 -- 172.21.15.52:0/897842861 shutdown_connections 2024-09-15T20:47:16.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7ce73df640 1 -- 172.21.15.52:0/897842861 wait complete. 2024-09-15T20:47:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f3d20a2e640 1 -- 172.21.15.52:0/1647796928 --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d1c0751e0 con 0x7f3d1c070960 2024-09-15T20:47:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f3d20a2e640 1 -- 172.21.15.52:0/1647796928 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d1c072950 con 0x7f3d1c070dd0 2024-09-15T20:47:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f3d20a2e640 1 -- 172.21.15.52:0/1647796928 --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3d1c072c30 con 0x7f3d1c08ca70 2024-09-15T20:47:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f3d1a59c640 1 -- 172.21.15.52:0/1647796928 >> v1:172.21.15.81:6789/0 conn(0x7f3d1c070dd0 legacy=0x7f3d1c0b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f3d1a59c640 1 -- 172.21.15.52:0/1647796928 >> v1:172.21.15.52:6789/0 conn(0x7f3d1c070960 legacy=0x7f3d1c153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f3d1a59c640 1 -- 172.21.15.52:0/1647796928 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1c072f10 con 0x7f3d1c08ca70 2024-09-15T20:47:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec3c17640 1 -- start start 2024-09-15T20:47:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec3c17640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0ebc071c80 0x7f0ebc071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec3c17640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ebc142cf0 0x7f0ebc143180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec3c17640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ebc072320 con 0x7f0ebc074e00 2024-09-15T20:47:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec3c17640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0ebc072060 con 0x7f0ebc071c80 2024-09-15T20:47:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec3c17640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f0ebc073690 con 0x7f0ebc142cf0 2024-09-15T20:47:16.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec11b2640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0ebc074e00 0x7f0ebc13ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47410/0 (socket says 172.21.15.52:47410) 2024-09-15T20:47:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec11b2640 1 -- 172.21.15.52:0/586330012 learned_addr learned my addr 172.21.15.52:0/586330012 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec21b4640 1 --2- 172.21.15.52:0/586330012 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ebc142cf0 0x7f0ebc143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec09b1640 1 -- 172.21.15.52:0/586330012 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671130953 0 0) 0x7f0ebc072320 con 0x7f0ebc074e00 2024-09-15T20:47:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec09b1640 1 -- 172.21.15.52:0/586330012 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ea8003530 con 0x7f0ebc074e00 2024-09-15T20:47:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec19b3640 1 --2- 172.21.15.52:0/586330012 >> v2:172.21.15.81:3300/0 conn(0x7f0ebc071c80 0x7f0ebc071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec21b4640 1 -- 172.21.15.52:0/586330012 >> v2:172.21.15.81:3300/0 conn(0x7f0ebc071c80 msgr2=0x7f0ebc071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec21b4640 1 --2- 172.21.15.52:0/586330012 >> v2:172.21.15.81:3300/0 conn(0x7f0ebc071c80 0x7f0ebc071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec21b4640 1 -- 172.21.15.52:0/586330012 >> v1:172.21.15.52:6789/0 conn(0x7f0ebc074e00 legacy=0x7f0ebc13ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f0ec21b4640 1 -- 172.21.15.52:0/586330012 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ebc13d160 con 0x7f0ebc142cf0 2024-09-15T20:47:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f805cadf640 1 Processor -- start 2024-09-15T20:47:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f805cadf640 1 -- start start 2024-09-15T20:47:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f805cadf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f805806ff00 0x7f8058144af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.460 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f805cadf640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80580b5ab0 con 0x7f80580b4e70 2024-09-15T20:47:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f805cadf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8058070320 con 0x7f8058145030 2024-09-15T20:47:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f805cadf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f80580b5250 con 0x7f805806ff00 2024-09-15T20:47:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f46cf7fe640 1 -- 172.21.15.52:0/312619106 >> v1:172.21.15.81:6789/0 conn(0x7f46d0073e20 legacy=0x7f46d013cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f46cf7fe640 1 -- 172.21.15.52:0/312619106 >> v1:172.21.15.52:6789/0 conn(0x7f46d00af9a0 legacy=0x7f46d00718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.437+0000 7f46cf7fe640 1 -- 172.21.15.52:0/312619106 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d0071fe0 con 0x7f46d013d2f0 2024-09-15T20:47:16.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7fefe9d9b640 1 --2- 172.21.15.52:0/154433844 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fefec071c50 0x7fefec0745f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fefdc0097c0 tx=0x7fefdc01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=916fec01d0219f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7fefe959a640 1 -- 172.21.15.52:0/154433844 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefdc0b0070 con 0x7fefec071c50 2024-09-15T20:47:16.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7fefe959a640 1 -- 172.21.15.52:0/154433844 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefdc0ab600 con 0x7fefec071c50 2024-09-15T20:47:16.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7fefe959a640 1 -- 172.21.15.52:0/154433844 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefdc0ab9d0 con 0x7fefec071c50 2024-09-15T20:47:16.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f3d1a59c640 1 --2- 172.21.15.52:0/1647796928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d1c08ca70 0x7f3d1c073330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0097c0 tx=0x7f3d0c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36022f5b3ade3da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f97fb7fe640 1 -- 172.21.15.52:0/341510596 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0b0070 con 0x7f97fc0af860 2024-09-15T20:47:16.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f97fb7fe640 1 -- 172.21.15.52:0/341510596 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ec0ab600 con 0x7f97fc0af860 2024-09-15T20:47:16.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f97fb7fe640 1 -- 172.21.15.52:0/341510596 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0aba10 con 0x7f97fc0af860 2024-09-15T20:47:16.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7fefeb59e640 1 -- 172.21.15.52:0/154433844 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fefec071c50 msgr2=0x7fefec0745f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7fefeb59e640 1 --2- 172.21.15.52:0/154433844 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fefec071c50 0x7fefec0745f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fefdc0097c0 tx=0x7fefdc01c410 comp rx=0 tx=0).stop 2024-09-15T20:47:16.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f46cf7fe640 1 --2- 172.21.15.52:0/312619106 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d013d2f0 0x7f46d0074840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f46c8009dc0 tx=0x7f46c801c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cea3138f2e2938c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7fefeb59e640 1 -- 172.21.15.52:0/154433844 shutdown_connections 2024-09-15T20:47:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7fefeb59e640 1 --2- 172.21.15.52:0/154433844 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fefec071c50 0x7fefec0745f0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fefdc0097c0 tx=0x7fefdc01c410 comp rx=0 tx=0).stop 2024-09-15T20:47:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7fefeb59e640 1 --2- 172.21.15.52:0/154433844 >> v2:172.21.15.81:3300/0 conn(0x7fefec0afcf0 0x7fefec1436c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7fefeb59e640 1 -- 172.21.15.52:0/154433844 >> 172.21.15.52:0/154433844 conn(0x7fefec0b5260 msgr2=0x7fefec0b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7fefeb59e640 1 -- 172.21.15.52:0/154433844 shutdown_connections 2024-09-15T20:47:16.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f80577fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f80580b4e70 0x7f8058148230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47432/0 (socket says 172.21.15.52:47432) 2024-09-15T20:47:16.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f80577fe640 1 -- 172.21.15.52:0/3582880937 learned_addr learned my addr 172.21.15.52:0/3582880937 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f8057fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8058145030 0x7f8058152200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.52:52470/0 (socket says 172.21.15.52:52470) 2024-09-15T20:47:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f804effd640 1 --2- 172.21.15.52:0/3582880937 >> v2:172.21.15.81:3300/0 conn(0x7f805806ff00 0x7f8058144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f8056ffd640 1 -- 172.21.15.52:0/3582880937 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1267874031 0 0) 0x7f80580b5ab0 con 0x7f80580b4e70 2024-09-15T20:47:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f8056ffd640 1 -- 172.21.15.52:0/3582880937 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8044003530 con 0x7f80580b4e70 2024-09-15T20:47:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f8056ffd640 1 -- 172.21.15.52:0/3582880937 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810193647 0 0) 0x7f8058070320 con 0x7f8058145030 2024-09-15T20:47:16.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f8056ffd640 1 -- 172.21.15.52:0/3582880937 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80580b5ab0 con 0x7f8058145030 2024-09-15T20:47:16.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7ce73df640 1 Processor -- start 2024-09-15T20:47:16.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f46cdffb640 1 -- 172.21.15.52:0/312619106 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c80b2070 con 0x7f46d013d2f0 2024-09-15T20:47:16.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f46cdffb640 1 -- 172.21.15.52:0/312619106 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c80a57e0 con 0x7f46d013d2f0 2024-09-15T20:47:16.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f46cdffb640 1 -- 172.21.15.52:0/312619106 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c80a5bb0 con 0x7f46d013d2f0 2024-09-15T20:47:16.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f0ec21b4640 1 --2- 172.21.15.52:0/586330012 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ebc142cf0 0x7f0ebc143180 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009d90 tx=0x7f0eb401f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abadef98a1e508df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f804effd640 1 -- 172.21.15.52:0/3582880937 >> v1:172.21.15.81:6789/0 conn(0x7f8058145030 legacy=0x7f8058152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f804effd640 1 -- 172.21.15.52:0/3582880937 >> v1:172.21.15.52:6789/0 conn(0x7f80580b4e70 legacy=0x7f8058148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f804effd640 1 -- 172.21.15.52:0/3582880937 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8058072610 con 0x7f805806ff00 2024-09-15T20:47:16.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f3d1959a640 1 -- 172.21.15.52:0/1647796928 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0b0070 con 0x7f3d1c08ca70 2024-09-15T20:47:16.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f3d1959a640 1 -- 172.21.15.52:0/1647796928 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0c0ab600 con 0x7f3d1c08ca70 2024-09-15T20:47:16.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f3d1959a640 1 -- 172.21.15.52:0/1647796928 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0ab9d0 con 0x7f3d1c08ca70 2024-09-15T20:47:16.471 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f0ec09b1640 1 -- 172.21.15.52:0/586330012 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40b4070 con 0x7f0ebc142cf0 2024-09-15T20:47:16.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7fefeb59e640 1 -- 172.21.15.52:0/154433844 wait complete. 2024-09-15T20:47:16.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 -- 172.21.15.52:0/1647796928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d1c08ca70 msgr2=0x7f3d1c073330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 --2- 172.21.15.52:0/1647796928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d1c08ca70 0x7f3d1c073330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0097c0 tx=0x7f3d0c01c3f0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefeb59e640 1 Processor -- start 2024-09-15T20:47:16.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f0ec09b1640 1 -- 172.21.15.52:0/586330012 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb40af600 con 0x7f0ebc142cf0 2024-09-15T20:47:16.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f9802eb0640 1 -- 172.21.15.52:0/341510596 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 msgr2=0x7f97fc140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f9802eb0640 1 --2- 172.21.15.52:0/341510596 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 0x7f97fc140060 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0b1300 tx=0x7f97ec01c400 comp rx=0 tx=0).stop 2024-09-15T20:47:16.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 -- 172.21.15.52:0/341510596 shutdown_connections 2024-09-15T20:47:16.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 --2- 172.21.15.52:0/341510596 >> v2:172.21.15.81:3300/0 conn(0x7f97fc1429f0 0x7f97fc13c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 --2- 172.21.15.52:0/341510596 >> v2:172.21.15.52:3300/0 conn(0x7f97fc13f4b0 0x7f97fc0b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 --2- 172.21.15.52:0/341510596 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 0x7f97fc140060 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 -- 172.21.15.52:0/341510596 >> 172.21.15.52:0/341510596 conn(0x7f97fc0b5260 msgr2=0x7f97fc0b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.441+0000 7f7ce73df640 1 -- start start 2024-09-15T20:47:16.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce73df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ce0074670 0x7f7ce00715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce73df640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ce00b0750 0x7f7ce013f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce73df640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce013cc40 0x7f7ce01de7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce73df640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce00723c0 con 0x7f7ce013cc40 2024-09-15T20:47:16.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce73df640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce013d0d0 con 0x7f7ce0074670 2024-09-15T20:47:16.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce73df640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f7ce014e990 con 0x7f7ce00b0750 2024-09-15T20:47:16.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 -- 172.21.15.52:0/1647796928 shutdown_connections 2024-09-15T20:47:16.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 --2- 172.21.15.52:0/1647796928 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d1c08ca70 0x7f3d1c073330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 -- 172.21.15.52:0/1647796928 >> 172.21.15.52:0/1647796928 conn(0x7f3d1c0b5260 msgr2=0x7f3d1c0b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f46cffff640 1 -- 172.21.15.52:0/312619106 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d013d2f0 msgr2=0x7f46d0074840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f46cffff640 1 --2- 172.21.15.52:0/312619106 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d013d2f0 0x7f46d0074840 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f46c8009dc0 tx=0x7f46c801c800 comp rx=0 tx=0).stop 2024-09-15T20:47:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 -- 172.21.15.52:0/1647796928 shutdown_connections 2024-09-15T20:47:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce517b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ce0074670 0x7f7ce00715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce517b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ce0074670 0x7f7ce00715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.52:54844/0 (socket says 172.21.15.52:54844) 2024-09-15T20:47:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce517b640 1 -- 172.21.15.52:0/3769273594 learned_addr learned my addr 172.21.15.52:0/3769273594 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce597c640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce013cc40 0x7f7ce01de7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 -- 172.21.15.52:0/341510596 shutdown_connections 2024-09-15T20:47:16.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f0ec09b1640 1 -- 172.21.15.52:0/586330012 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40af9d0 con 0x7f0ebc142cf0 2024-09-15T20:47:16.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 -- 172.21.15.52:0/341510596 wait complete. 2024-09-15T20:47:16.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce517b640 1 -- 172.21.15.52:0/3769273594 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ce00b0750 msgr2=0x7f7ce013f490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T20:47:16.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce517b640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ce00b0750 0x7f7ce013f490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce517b640 1 -- 172.21.15.52:0/3769273594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce013cc40 msgr2=0x7f7ce01de7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce517b640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce013cc40 0x7f7ce01de7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce517b640 1 -- 172.21.15.52:0/3769273594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce0142240 con 0x7f7ce0074670 2024-09-15T20:47:16.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce517b640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ce0074670 0x7f7ce00715d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800c500 tx=0x7f7cd800c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefeb59e640 1 -- start start 2024-09-15T20:47:16.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefeb59e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fefec0afcf0 0x7fefec13c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefeb59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefec13d2c0 0x7fefec14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefeb59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefec13a730 0x7fefec13ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefeb59e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fefec14d600 con 0x7fefec13d2c0 2024-09-15T20:47:16.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefeb59e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fefec14d480 con 0x7fefec13a730 2024-09-15T20:47:16.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefeb59e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fefec14d780 con 0x7fefec0afcf0 2024-09-15T20:47:16.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7cddffb640 1 -- 172.21.15.52:0/3769273594 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8017070 con 0x7f7ce0074670 2024-09-15T20:47:16.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7cddffb640 1 -- 172.21.15.52:0/3769273594 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd8005cf0 con 0x7f7ce0074670 2024-09-15T20:47:16.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7cddffb640 1 -- 172.21.15.52:0/3769273594 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80072d0 con 0x7f7ce0074670 2024-09-15T20:47:16.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefead9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefec13a730 0x7fefec13ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefead9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefec13a730 0x7fefec13ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.52:54854/0 (socket says 172.21.15.52:54854) 2024-09-15T20:47:16.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefead9d640 1 -- 172.21.15.52:0/1354135141 learned_addr learned my addr 172.21.15.52:0/1354135141 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce73df640 1 -- 172.21.15.52:0/3769273594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce0142520 con 0x7f7ce0074670 2024-09-15T20:47:16.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce73df640 1 -- 172.21.15.52:0/3769273594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce01ded00 con 0x7f7ce0074670 2024-09-15T20:47:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 -- 172.21.15.52:0/1647796928 wait complete. 2024-09-15T20:47:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 Processor -- start 2024-09-15T20:47:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 Processor -- start 2024-09-15T20:47:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 -- start start 2024-09-15T20:47:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f0ec3c17640 1 -- 172.21.15.52:0/586330012 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ebc142cf0 msgr2=0x7f0ebc143180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f0ec3c17640 1 --2- 172.21.15.52:0/586330012 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ebc142cf0 0x7f0ebc143180 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009d90 tx=0x7f0eb401f130 comp rx=0 tx=0).stop 2024-09-15T20:47:16.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f0ec3c17640 1 -- 172.21.15.52:0/586330012 shutdown_connections 2024-09-15T20:47:16.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f0ec3c17640 1 --2- 172.21.15.52:0/586330012 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ebc142cf0 0x7f0ebc143180 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f0ec3c17640 1 --2- 172.21.15.52:0/586330012 >> v2:172.21.15.81:3300/0 conn(0x7f0ebc071c80 0x7f0ebc071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f0ec3c17640 1 -- 172.21.15.52:0/586330012 >> 172.21.15.52:0/586330012 conn(0x7f0ebc0b5280 msgr2=0x7f0ebc0b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f46cffff640 1 -- 172.21.15.52:0/312619106 shutdown_connections 2024-09-15T20:47:16.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f46cffff640 1 --2- 172.21.15.52:0/312619106 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d013d2f0 0x7f46d0074840 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f46cffff640 1 -- 172.21.15.52:0/312619106 >> 172.21.15.52:0/312619106 conn(0x7f46d00b5a90 msgr2=0x7f46d00b5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f46cffff640 1 -- 172.21.15.52:0/312619106 shutdown_connections 2024-09-15T20:47:16.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefe9d9b640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefec13d2c0 0x7fefec14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefead9d640 1 -- 172.21.15.52:0/1354135141 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fefec0afcf0 msgr2=0x7fefec13c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefead9d640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fefec0afcf0 0x7fefec13c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefead9d640 1 -- 172.21.15.52:0/1354135141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefec13d2c0 msgr2=0x7fefec14f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefead9d640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefec13d2c0 0x7fefec14f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefead9d640 1 -- 172.21.15.52:0/1354135141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefec140ae0 con 0x7fefec13a730 2024-09-15T20:47:16.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefe9d9b640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefec13d2c0 0x7fefec14f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T20:47:16.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefead9d640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefec13a730 0x7fefec13ab90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fefe400caa0 tx=0x7fefe400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f46cffff640 1 -- 172.21.15.52:0/312619106 wait complete. 2024-09-15T20:47:16.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 -- start start 2024-09-15T20:47:16.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c070960 0x7f3d1c1474c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3d1c08ca70 0x7f3d1c1f1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d1c1f1cc0 0x7f3d1c14ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c157530 con 0x7f3d1c1f1cc0 2024-09-15T20:47:16.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1c1573b0 con 0x7f3d1c070960 2024-09-15T20:47:16.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d20a2e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f3d1c1576b0 con 0x7f3d1c08ca70 2024-09-15T20:47:16.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefe2ffd640 1 -- 172.21.15.52:0/1354135141 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe4017070 con 0x7fefec13a730 2024-09-15T20:47:16.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefe2ffd640 1 -- 172.21.15.52:0/1354135141 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe400ac20 con 0x7fefec13a730 2024-09-15T20:47:16.484 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefe2ffd640 1 -- 172.21.15.52:0/1354135141 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe4012640 con 0x7fefec13a730 2024-09-15T20:47:16.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f804effd640 1 --2- 172.21.15.52:0/3582880937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f805806ff00 0x7f8058144af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80400097c0 tx=0x7f804001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1083a817a512efe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefeb59e640 1 -- 172.21.15.52:0/1354135141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefec139f50 con 0x7fefec13a730 2024-09-15T20:47:16.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 0x7f97fc0b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97fc13f4b0 0x7f97fc140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc1429f0 0x7f97fc1411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc070c90 con 0x7f97fc13f4b0 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc070b10 con 0x7f97fc1429f0 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9802eb0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc070e10 con 0x7f97fc0af860 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f97fbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97fc13f4b0 0x7f97fc140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9800c4c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 0x7f97fc0b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9800c4c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 0x7f97fc0b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44904/0 (socket says 172.21.15.52:44904) 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f97fbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97fc13f4b0 0x7f97fc140c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45566/0 (socket says 172.21.15.52:45566) 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f9800c4c640 1 -- 172.21.15.52:0/2508244804 learned_addr learned my addr 172.21.15.52:0/2508244804 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f9800c4c640 1 -- 172.21.15.52:0/2508244804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc1429f0 msgr2=0x7f97fc1411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f9800c4c640 1 --2- 172.21.15.52:0/2508244804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc1429f0 0x7f97fc1411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f9800c4c640 1 -- 172.21.15.52:0/2508244804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97fc13f4b0 msgr2=0x7f97fc140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f9800c4c640 1 --2- 172.21.15.52:0/2508244804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97fc13f4b0 0x7f97fc140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f9800c4c640 1 -- 172.21.15.52:0/2508244804 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc0b4380 con 0x7f97fc0af860 2024-09-15T20:47:16.486 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f9800c4c640 1 --2- 172.21.15.52:0/2508244804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 0x7f97fc0b3e40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0ae040 tx=0x7f97ec0191a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d19d9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3d1c08ca70 0x7f3d1c1f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d19d9b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3d1c08ca70 0x7f3d1c1f1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44918/0 (socket says 172.21.15.52:44918) 2024-09-15T20:47:16.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f3d19d9b640 1 -- 172.21.15.52:0/2442489376 learned_addr learned my addr 172.21.15.52:0/2442489376 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f8056ffd640 1 -- 172.21.15.52:0/3582880937 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80400ab5f0 con 0x7f805806ff00 2024-09-15T20:47:16.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f8056ffd640 1 -- 172.21.15.52:0/3582880937 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80400b0070 con 0x7f805806ff00 2024-09-15T20:47:16.487 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f8056ffd640 1 -- 172.21.15.52:0/3582880937 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80400ab990 con 0x7f805806ff00 2024-09-15T20:47:16.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46cffff640 1 Processor -- start 2024-09-15T20:47:16.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7fefeb59e640 1 -- 172.21.15.52:0/1354135141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefec13b0d0 con 0x7fefec13a730 2024-09-15T20:47:16.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7fefeb59e640 1 -- 172.21.15.52:0/1354135141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefec140cb0 con 0x7fefec13a730 2024-09-15T20:47:16.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.445+0000 7f7ce73df640 1 -- 172.21.15.52:0/3769273594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce013c700 con 0x7f7ce0074670 2024-09-15T20:47:16.488 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f7cddffb640 1 -- 172.21.15.52:0/3769273594 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f7cd801a070 con 0x7f7ce0074670 2024-09-15T20:47:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f805cadf640 1 -- 172.21.15.52:0/3582880937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f805806ff00 msgr2=0x7f8058144af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f805cadf640 1 --2- 172.21.15.52:0/3582880937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f805806ff00 0x7f8058144af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80400097c0 tx=0x7f804001c3f0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f805cadf640 1 -- 172.21.15.52:0/3582880937 shutdown_connections 2024-09-15T20:47:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f3d1ad9d640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d1c1f1cc0 0x7f3d1c14ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.489 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f7cddffb640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f7ccc072ef0 0x7f7ccc0753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f97f97fa640 1 -- 172.21.15.52:0/2508244804 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0cc070 con 0x7f97fc0af860 2024-09-15T20:47:16.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f97f97fa640 1 -- 172.21.15.52:0/2508244804 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ec0c1040 con 0x7f97fc0af860 2024-09-15T20:47:16.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f97f97fa640 1 -- 172.21.15.52:0/2508244804 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0aa7f0 con 0x7f97fc0af860 2024-09-15T20:47:16.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f7cddffb640 1 -- 172.21.15.52:0/3769273594 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f7cd8093410 con 0x7f7ce0074670 2024-09-15T20:47:16.490 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f805cadf640 1 --2- 172.21.15.52:0/3582880937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f805806ff00 0x7f8058144af0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46cffff640 1 -- start start 2024-09-15T20:47:16.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d0073e20 0x7f46d013ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46cffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d00af9a0 0x7f46d013e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46cffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46d013d2f0 0x7f46d0140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46cffff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46d0068b50 con 0x7f46d013d2f0 2024-09-15T20:47:16.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46cffff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46d00689d0 con 0x7f46d0073e20 2024-09-15T20:47:16.491 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46cffff640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f46d0068cd0 con 0x7f46d00af9a0 2024-09-15T20:47:16.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f7ce497a640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f7ccc072ef0 0x7f7ccc0753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f805cadf640 1 -- 172.21.15.52:0/3582880937 >> 172.21.15.52:0/3582880937 conn(0x7f80580b5d00 msgr2=0x7f80580b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.492 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46ce7fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d00af9a0 0x7f46d013e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46ce7fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d00af9a0 0x7f46d013e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44922/0 (socket says 172.21.15.52:44922) 2024-09-15T20:47:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46ce7fc640 1 -- 172.21.15.52:0/3870286529 learned_addr learned my addr 172.21.15.52:0/3870286529 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46ceffd640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d0073e20 0x7f46d013ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46cf7fe640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46d013d2f0 0x7f46d0140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46ce7fc640 1 -- 172.21.15.52:0/3870286529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d0073e20 msgr2=0x7f46d013ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46ce7fc640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d0073e20 0x7f46d013ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46ce7fc640 1 -- 172.21.15.52:0/3870286529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46d013d2f0 msgr2=0x7f46d0140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46ce7fc640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46d013d2f0 0x7f46d0140bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.493 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46ce7fc640 1 -- 172.21.15.52:0/3870286529 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d013fd40 con 0x7f46d00af9a0 2024-09-15T20:47:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f805cadf640 1 -- 172.21.15.52:0/3582880937 shutdown_connections 2024-09-15T20:47:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f9802eb0640 1 -- 172.21.15.52:0/2508244804 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc144370 con 0x7f97fc0af860 2024-09-15T20:47:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f9802eb0640 1 -- 172.21.15.52:0/2508244804 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc0b38e0 con 0x7f97fc0af860 2024-09-15T20:47:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f9802eb0640 1 -- 172.21.15.52:0/2508244804 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc0b0280 con 0x7f97fc0af860 2024-09-15T20:47:16.494 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f7ce497a640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f7ccc072ef0 0x7f7ccc0753b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00af000 tx=0x7f7cd00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f3d1a59c640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c070960 0x7f3d1c1474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec3c17640 1 -- 172.21.15.52:0/586330012 shutdown_connections 2024-09-15T20:47:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec3c17640 1 -- 172.21.15.52:0/586330012 wait complete. 2024-09-15T20:47:16.495 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec3c17640 1 Processor -- start 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec3c17640 1 -- start start 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec3c17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ebc071c80 0x7f0ebc0abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec3c17640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ebc142cf0 0x7f0ebc0adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec3c17640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ebc0ab310 0x7f0ebc126730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec3c17640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc1436c0 con 0x7f0ebc142cf0 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec3c17640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc0afcc0 con 0x7f0ebc071c80 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec3c17640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f0ebc143840 con 0x7f0ebc0ab310 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec21b4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ebc0ab310 0x7f0ebc126730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec21b4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ebc0ab310 0x7f0ebc126730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44930/0 (socket says 172.21.15.52:44930) 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec21b4640 1 -- 172.21.15.52:0/1954594295 learned_addr learned my addr 172.21.15.52:0/1954594295 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec19b3640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ebc071c80 0x7f0ebc0abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec11b2640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ebc142cf0 0x7f0ebc0adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.496 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec19b3640 1 -- 172.21.15.52:0/1954594295 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ebc0ab310 msgr2=0x7f0ebc126730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec19b3640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ebc0ab310 0x7f0ebc126730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec19b3640 1 -- 172.21.15.52:0/1954594295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ebc142cf0 msgr2=0x7f0ebc0adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec19b3640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ebc142cf0 0x7f0ebc0adbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec19b3640 1 -- 172.21.15.52:0/1954594295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ebc0ad450 con 0x7f0ebc071c80 2024-09-15T20:47:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7fefe2ffd640 1 -- 172.21.15.52:0/1354135141 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fefe401a070 con 0x7fefec13a730 2024-09-15T20:47:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f0ec19b3640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ebc071c80 0x7f0ebc0abe70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800d5f0 tx=0x7f0eb800dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.497 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f46ce7fc640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d00af9a0 0x7f46d013e490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c450 tx=0x7f46c400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.449+0000 7f836c8f1640 1 --2- 172.21.15.52:0/2483500019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8368074e00 0x7f8368071420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f835c0097c0 tx=0x7f835c01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29c4d1954a248236 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f3d19d9b640 1 -- 172.21.15.52:0/2442489376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c070960 msgr2=0x7f3d1c1474c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f3d19d9b640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c070960 0x7f3d1c1474c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f3d19d9b640 1 -- 172.21.15.52:0/2442489376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d1c1f1cc0 msgr2=0x7f3d1c14ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f3d19d9b640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d1c1f1cc0 0x7f3d1c14ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.498 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f3d19d9b640 1 -- 172.21.15.52:0/2442489376 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1c1490f0 con 0x7f3d1c08ca70 2024-09-15T20:47:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f46b77fe640 1 -- 172.21.15.52:0/3870286529 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4012830 con 0x7f46d00af9a0 2024-09-15T20:47:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7fefe2ffd640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fefcc072ec0 0x7fefcc075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f46cffff640 1 -- 172.21.15.52:0/3870286529 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d013ffb0 con 0x7f46d00af9a0 2024-09-15T20:47:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f46cffff640 1 -- 172.21.15.52:0/3870286529 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d012c9b0 con 0x7f46d00af9a0 2024-09-15T20:47:16.499 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7fefe2ffd640 1 -- 172.21.15.52:0/1354135141 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7fefe4093a70 con 0x7fefec13a730 2024-09-15T20:47:16.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f3d19d9b640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3d1c08ca70 0x7f3d1c1f1780 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000c4b0 tx=0x7f3d1000c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f805cadf640 1 -- 172.21.15.52:0/3582880937 wait complete. 2024-09-15T20:47:16.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f97f97fa640 1 -- 172.21.15.52:0/2508244804 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f97ec0cf070 con 0x7f97fc0af860 2024-09-15T20:47:16.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f97f97fa640 1 --2- 172.21.15.52:0/2508244804 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f97e8072f40 0x7f97e8075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f46cffff640 1 -- 172.21.15.52:0/3870286529 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d0074820 con 0x7f46d00af9a0 2024-09-15T20:47:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f97f97fa640 1 -- 172.21.15.52:0/2508244804 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f97ec13eb50 con 0x7f97fc0af860 2024-09-15T20:47:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7fefea59c640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fefcc072ec0 0x7fefcc075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f97fbfff640 1 --2- 172.21.15.52:0/2508244804 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f97e8072f40 0x7f97e8075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f805cadf640 1 Processor -- start 2024-09-15T20:47:16.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7fefea59c640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fefcc072ec0 0x7fefcc075380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fefd4006aa0 tx=0x7fefd4006a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.502 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.453+0000 7f97fbfff640 1 --2- 172.21.15.52:0/2508244804 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f97e8072f40 0x7f97e8075400 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f97f0006fd0 tx=0x7f97f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f805cadf640 1 -- start start 2024-09-15T20:47:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f805cadf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f805806ff00 0x7f8058143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f805cadf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80580b4e70 0x7f8058140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f80577fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f805806ff00 0x7f8058143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f80577fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f805806ff00 0x7f8058143300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45598/0 (socket says 172.21.15.52:45598) 2024-09-15T20:47:16.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f80577fe640 1 -- 172.21.15.52:0/975489541 learned_addr learned my addr 172.21.15.52:0/975489541 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f805cadf640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8058145030 0x7f80581411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f80581455c0 con 0x7f805806ff00 2024-09-15T20:47:16.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8058145440 con 0x7f80580b4e70 2024-09-15T20:47:16.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f8058156550 con 0x7f8058145030 2024-09-15T20:47:16.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f8057fff640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8058145030 0x7f80581411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f804effd640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80580b4e70 0x7f8058140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f97f97fa640 1 -- 172.21.15.52:0/2508244804 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f97fc144370 con 0x7f97fc0af860 2024-09-15T20:47:16.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f80577fe640 1 -- 172.21.15.52:0/975489541 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8058145030 msgr2=0x7f80581411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f80577fe640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8058145030 0x7f80581411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f80577fe640 1 -- 172.21.15.52:0/975489541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80580b4e70 msgr2=0x7f8058140c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f80577fe640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80580b4e70 0x7f8058140c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f80577fe640 1 -- 172.21.15.52:0/975489541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80581425c0 con 0x7f805806ff00 2024-09-15T20:47:16.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f804effd640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80580b4e70 0x7f8058140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T20:47:16.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f80577fe640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f805806ff00 0x7f8058143300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f804800c4d0 tx=0x7f804800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f46b77fe640 1 -- 172.21.15.52:0/3870286529 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c4017070 con 0x7f46d00af9a0 2024-09-15T20:47:16.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f46b77fe640 1 -- 172.21.15.52:0/3870286529 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4012bd0 con 0x7f46d00af9a0 2024-09-15T20:47:16.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f8054ff9640 1 -- 172.21.15.52:0/975489541 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8048017070 con 0x7f805806ff00 2024-09-15T20:47:16.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f8054ff9640 1 -- 172.21.15.52:0/975489541 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8048005cf0 con 0x7f805806ff00 2024-09-15T20:47:16.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f8054ff9640 1 -- 172.21.15.52:0/975489541 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8048007290 con 0x7f805806ff00 2024-09-15T20:47:16.506 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8058142b80 con 0x7f805806ff00 2024-09-15T20:47:16.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f3d0affd640 1 -- 172.21.15.52:0/2442489376 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10017070 con 0x7f3d1c08ca70 2024-09-15T20:47:16.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f3d20a2e640 1 -- 172.21.15.52:0/2442489376 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1c151320 con 0x7f3d1c08ca70 2024-09-15T20:47:16.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f3d20a2e640 1 -- 172.21.15.52:0/2442489376 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d1c148200 con 0x7f3d1c08ca70 2024-09-15T20:47:16.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f3d0affd640 1 -- 172.21.15.52:0/2442489376 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d10005cf0 con 0x7f3d1c08ca70 2024-09-15T20:47:16.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.457+0000 7f3d0affd640 1 -- 172.21.15.52:0/2442489376 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10007270 con 0x7f3d1c08ca70 2024-09-15T20:47:16.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f3d20a2e640 1 -- 172.21.15.52:0/2442489376 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d00005090 con 0x7f3d1c08ca70 2024-09-15T20:47:16.507 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f8054ff9640 1 -- 172.21.15.52:0/975489541 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f804801a070 con 0x7f805806ff00 2024-09-15T20:47:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f8054ff9640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f8038072f10 0x7f80380753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f46b77fe640 1 -- 172.21.15.52:0/3870286529 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f46c401c460 con 0x7f46d00af9a0 2024-09-15T20:47:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f46b77fe640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f46bc072ec0 0x7f46bc075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f46b77fe640 1 -- 172.21.15.52:0/3870286529 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f46c4093f20 con 0x7f46d00af9a0 2024-09-15T20:47:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80581409d0 con 0x7f805806ff00 2024-09-15T20:47:16.508 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f46ceffd640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f46bc072ec0 0x7f46bc075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f3d0affd640 1 -- 172.21.15.52:0/2442489376 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f3d1001a070 con 0x7f3d1c08ca70 2024-09-15T20:47:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f3d0affd640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3cfc072ec0 0x7f3cfc075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f804effd640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f8038072f10 0x7f80380753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f8054ff9640 1 -- 172.21.15.52:0/975489541 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f8048059b10 con 0x7f805806ff00 2024-09-15T20:47:16.509 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f3d1a59c640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3cfc072ec0 0x7f3cfc075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f805806a230 con 0x7f805806ff00 2024-09-15T20:47:16.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f46ceffd640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f46bc072ec0 0x7f46bc075380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f46c0004880 tx=0x7f46c000aed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.510 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.461+0000 7f804effd640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f8038072f10 0x7f80380753d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f80400af000 tx=0x7f80400a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.465+0000 7f3d1a59c640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3cfc072ec0 0x7f3cfc075380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0ad000 tx=0x7f3d0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.511 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.465+0000 7f7cddffb640 1 -- 172.21.15.52:0/3769273594 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f7ce0142240 con 0x7f7ce0074670 2024-09-15T20:47:16.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.465+0000 7f8054ff9640 1 -- 172.21.15.52:0/975489541 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f804805d8a0 con 0x7f805806ff00 2024-09-15T20:47:16.512 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.469+0000 7f46b77fe640 1 -- 172.21.15.52:0/3870286529 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f46c405f2f0 con 0x7f46d00af9a0 2024-09-15T20:47:16.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.469+0000 7f3d0affd640 1 -- 172.21.15.52:0/2442489376 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f3d10091850 con 0x7f3d1c08ca70 2024-09-15T20:47:16.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f83677fe640 1 -- 172.21.15.52:0/2483500019 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c0b0070 con 0x7f8368074e00 2024-09-15T20:47:16.513 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f0eb27fc640 1 -- 172.21.15.52:0/1954594295 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb80125f0 con 0x7f0ebc071c80 2024-09-15T20:47:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f0eb27fc640 1 -- 172.21.15.52:0/1954594295 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb8019070 con 0x7f0ebc071c80 2024-09-15T20:47:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f0eb27fc640 1 -- 172.21.15.52:0/1954594295 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb80129b0 con 0x7f0ebc071c80 2024-09-15T20:47:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f0ec3c17640 1 -- 172.21.15.52:0/1954594295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ebc0ad730 con 0x7f0ebc071c80 2024-09-15T20:47:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7fefe2ffd640 1 -- 172.21.15.52:0/1354135141 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fefe4021020 con 0x7fefec13a730 2024-09-15T20:47:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f83677fe640 1 -- 172.21.15.52:0/2483500019 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f835c004230 con 0x7f8368074e00 2024-09-15T20:47:16.514 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f83677fe640 1 -- 172.21.15.52:0/2483500019 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835c003620 con 0x7f8368074e00 2024-09-15T20:47:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f0ec3c17640 1 -- 172.21.15.52:0/1954594295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ebc0ab7a0 con 0x7f0ebc071c80 2024-09-15T20:47:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f836eb55640 1 -- 172.21.15.52:0/2483500019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8368074e00 msgr2=0x7f8368071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f836eb55640 1 --2- 172.21.15.52:0/2483500019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8368074e00 0x7f8368071420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f835c0097c0 tx=0x7f835c01c440 comp rx=0 tx=0).stop 2024-09-15T20:47:16.515 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f0ec3c17640 1 -- 172.21.15.52:0/1954594295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ebc071420 con 0x7f0ebc071c80 2024-09-15T20:47:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f836eb55640 1 -- 172.21.15.52:0/2483500019 shutdown_connections 2024-09-15T20:47:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f836eb55640 1 --2- 172.21.15.52:0/2483500019 >> v2:172.21.15.52:3300/0 conn(0x7f836813ca50 0x7f836813cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f836eb55640 1 --2- 172.21.15.52:0/2483500019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8368074e00 0x7f8368071420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f836eb55640 1 -- 172.21.15.52:0/2483500019 >> 172.21.15.52:0/2483500019 conn(0x7f83680b5280 msgr2=0x7f83680b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f836eb55640 1 -- 172.21.15.52:0/2483500019 shutdown_connections 2024-09-15T20:47:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f836eb55640 1 -- 172.21.15.52:0/2483500019 wait complete. 2024-09-15T20:47:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f836eb55640 1 Processor -- start 2024-09-15T20:47:16.516 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f836eb55640 1 -- start start 2024-09-15T20:47:16.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f0eb27fc640 1 -- 172.21.15.52:0/1954594295 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f0eb8012b50 con 0x7f0ebc071c80 2024-09-15T20:47:16.517 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.477+0000 7f3d0affd640 1 -- 172.21.15.52:0/2442489376 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f3d10022020 con 0x7f3d1c08ca70 2024-09-15T20:47:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f0eb27fc640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0ea0072ec0 0x7f0ea0075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f0eb27fc640 1 -- 172.21.15.52:0/1954594295 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f0eb8094830 con 0x7f0ebc071c80 2024-09-15T20:47:16.519 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f0ec11b2640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0ea0072ec0 0x7f0ea0075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836eb55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83680afab0 0x7f83681d7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836eb55640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f836813ca50 0x7f83681d78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836eb55640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83681d4890 0x7f83681d4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836eb55640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f836814edd0 con 0x7f83681d4890 2024-09-15T20:47:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836eb55640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f836814ec50 con 0x7f83680afab0 2024-09-15T20:47:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836eb55640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f836814ef50 con 0x7f836813ca50 2024-09-15T20:47:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836c8f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83680afab0 0x7f83681d7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836d0f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83681d4890 0x7f83681d4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836d0f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83681d4890 0x7f83681d4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45600/0 (socket says 172.21.15.52:45600) 2024-09-15T20:47:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836d0f2640 1 -- 172.21.15.52:0/1013210540 learned_addr learned my addr 172.21.15.52:0/1013210540 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836d0f2640 1 -- 172.21.15.52:0/1013210540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f836813ca50 msgr2=0x7f83681d78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.520 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836d0f2640 1 --2- 172.21.15.52:0/1013210540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f836813ca50 0x7f83681d78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836d0f2640 1 -- 172.21.15.52:0/1013210540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83680afab0 msgr2=0x7f83681d7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836d0f2640 1 --2- 172.21.15.52:0/1013210540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83680afab0 0x7f83681d7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836d0f2640 1 -- 172.21.15.52:0/1013210540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8368138de0 con 0x7f83681d4890 2024-09-15T20:47:16.521 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f0ec11b2640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0ea0072ec0 0x7f0ea0075380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0eac007fd0 tx=0x7f0eac006ab0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836d0f2640 1 --2- 172.21.15.52:0/1013210540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83681d4890 0x7f83681d4ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f836000cf20 tx=0x7f836000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f83657fa640 1 -- 172.21.15.52:0/1013210540 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836001a070 con 0x7f83681d4890 2024-09-15T20:47:16.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f83657fa640 1 -- 172.21.15.52:0/1013210540 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836000d840 con 0x7f83681d4890 2024-09-15T20:47:16.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f83657fa640 1 -- 172.21.15.52:0/1013210540 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836000dc30 con 0x7f83681d4890 2024-09-15T20:47:16.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836eb55640 1 -- 172.21.15.52:0/1013210540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83681d3fe0 con 0x7f83681d4890 2024-09-15T20:47:16.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836eb55640 1 -- 172.21.15.52:0/1013210540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83681d53f0 con 0x7f83681d4890 2024-09-15T20:47:16.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.481+0000 7f836eb55640 1 -- 172.21.15.52:0/1013210540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8348005090 con 0x7f83681d4890 2024-09-15T20:47:16.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.485+0000 7f83657fa640 1 -- 172.21.15.52:0/1013210540 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f836001d070 con 0x7f83681d4890 2024-09-15T20:47:16.522 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.485+0000 7f83657fa640 1 --2- 172.21.15.52:0/1013210540 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f834c072f10 0x7f834c0753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:16.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.485+0000 7f83657fa640 1 -- 172.21.15.52:0/1013210540 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f836000ddd0 con 0x7f83681d4890 2024-09-15T20:47:16.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.489+0000 7f836c8f1640 1 --2- 172.21.15.52:0/1013210540 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f834c072f10 0x7f834c0753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:16.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.489+0000 7f836c8f1640 1 --2- 172.21.15.52:0/1013210540 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f834c072f10 0x7f834c0753d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f835c0ad000 tx=0x7f835c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:16.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.489+0000 7f0eb27fc640 1 -- 172.21.15.52:0/1954594295 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f0eb805f5c0 con 0x7f0ebc071c80 2024-09-15T20:47:16.523 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.497+0000 7f83657fa640 1 -- 172.21.15.52:0/1013210540 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f8360024020 con 0x7f83681d4890 2024-09-15T20:47:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.805+0000 7f7ce73df640 1 -- 172.21.15.52:0/3769273594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7ce0069490 con 0x7f7ce0074670 2024-09-15T20:47:16.807 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.805+0000 7f7cddffb640 1 -- 172.21.15.52:0/3769273594 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7cd805e330 con 0x7f7ce0074670 2024-09-15T20:47:16.811 INFO:teuthology.orchestra.run.smithi052.stdout:64424509444 2024-09-15T20:47:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.809+0000 7f9802eb0640 1 -- 172.21.15.52:0/2508244804 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f97fc071f40 con 0x7f97fc0af860 2024-09-15T20:47:16.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.809+0000 7f97f97fa640 1 -- 172.21.15.52:0/2508244804 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f97fc0b4380 con 0x7f97fc0af860 2024-09-15T20:47:16.813 INFO:teuthology.orchestra.run.smithi052.stdout:60129542147 2024-09-15T20:47:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f7cc77fe640 1 -- 172.21.15.52:0/3769273594 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f7ccc072ef0 msgr2=0x7f7ccc0753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f7cc77fe640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f7ccc072ef0 0x7f7ccc0753b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00af000 tx=0x7f7cd00a7070 comp rx=0 tx=0).stop 2024-09-15T20:47:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f7cc77fe640 1 -- 172.21.15.52:0/3769273594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ce0074670 msgr2=0x7f7ce00715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f7cc77fe640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ce0074670 0x7f7ce00715d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800c500 tx=0x7f7cd800c900 comp rx=0 tx=0).stop 2024-09-15T20:47:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f7cc77fe640 1 -- 172.21.15.52:0/3769273594 shutdown_connections 2024-09-15T20:47:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f7cc77fe640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f7ccc072ef0 0x7f7ccc0753b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f7cc77fe640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7ce013cc40 0x7f7ce01de7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f7cc77fe640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f7ce00b0750 0x7f7ce013f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f7cc77fe640 1 --2- 172.21.15.52:0/3769273594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ce0074670 0x7f7ce00715d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f7cc77fe640 1 -- 172.21.15.52:0/3769273594 >> 172.21.15.52:0/3769273594 conn(0x7f7ce00b5290 msgr2=0x7f7ce00b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f7cc77fe640 1 -- 172.21.15.52:0/3769273594 shutdown_connections 2024-09-15T20:47:16.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f7cc77fe640 1 -- 172.21.15.52:0/3769273594 wait complete. 2024-09-15T20:47:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f9802eb0640 1 -- 172.21.15.52:0/2508244804 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f97e8072f40 msgr2=0x7f97e8075400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f9802eb0640 1 --2- 172.21.15.52:0/2508244804 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f97e8072f40 0x7f97e8075400 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f97f0006fd0 tx=0x7f97f0008040 comp rx=0 tx=0).stop 2024-09-15T20:47:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f9802eb0640 1 -- 172.21.15.52:0/2508244804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 msgr2=0x7f97fc0b3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f9802eb0640 1 --2- 172.21.15.52:0/2508244804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 0x7f97fc0b3e40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0ae040 tx=0x7f97ec0191a0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.817 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f9802eb0640 1 -- 172.21.15.52:0/2508244804 shutdown_connections 2024-09-15T20:47:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f9802eb0640 1 --2- 172.21.15.52:0/2508244804 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f97e8072f40 0x7f97e8075400 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f9802eb0640 1 --2- 172.21.15.52:0/2508244804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97fc1429f0 0x7f97fc1411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f9802eb0640 1 --2- 172.21.15.52:0/2508244804 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97fc13f4b0 0x7f97fc140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f9802eb0640 1 --2- 172.21.15.52:0/2508244804 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f97fc0af860 0x7f97fc0b3e40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.813+0000 7f9802eb0640 1 -- 172.21.15.52:0/2508244804 >> 172.21.15.52:0/2508244804 conn(0x7f97fc0b5260 msgr2=0x7f97fc12f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.817+0000 7f9802eb0640 1 -- 172.21.15.52:0/2508244804 shutdown_connections 2024-09-15T20:47:16.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.817+0000 7f9802eb0640 1 -- 172.21.15.52:0/2508244804 wait complete. 2024-09-15T20:47:16.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.821+0000 7f3d20a2e640 1 -- 172.21.15.52:0/2442489376 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3d00005650 con 0x7f3d1c08ca70 2024-09-15T20:47:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.821+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f80580b7bd0 con 0x7f805806ff00 2024-09-15T20:47:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.821+0000 7f46cffff640 1 -- 172.21.15.52:0/3870286529 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f46d013ad30 con 0x7f46d00af9a0 2024-09-15T20:47:16.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.825+0000 7f8054ff9640 1 -- 172.21.15.52:0/975489541 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f80480622d0 con 0x7f805806ff00 2024-09-15T20:47:16.827 INFO:teuthology.orchestra.run.smithi052.stdout:60129542148 2024-09-15T20:47:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.825+0000 7f46b77fe640 1 -- 172.21.15.52:0/3870286529 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f46c405ebf0 con 0x7f46d00af9a0 2024-09-15T20:47:16.827 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.825+0000 7f3d0affd640 1 -- 172.21.15.52:0/2442489376 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d1005df20 con 0x7f3d1c08ca70 2024-09-15T20:47:16.828 INFO:teuthology.orchestra.run.smithi052.stdout:60129542148 2024-09-15T20:47:16.829 INFO:teuthology.orchestra.run.smithi052.stdout:64424509444 2024-09-15T20:47:16.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7fefeb59e640 1 -- 172.21.15.52:0/1354135141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fefec0745f0 con 0x7fefec13a730 2024-09-15T20:47:16.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f8038072f10 msgr2=0x7f80380753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f805cadf640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f8038072f10 0x7f80380753d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f80400af000 tx=0x7f80400a7000 comp rx=0 tx=0).stop 2024-09-15T20:47:16.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f805806ff00 msgr2=0x7f8058143300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f805cadf640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f805806ff00 0x7f8058143300 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f804800c4d0 tx=0x7f804800c990 comp rx=0 tx=0).stop 2024-09-15T20:47:16.831 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f3d20a2e640 1 -- 172.21.15.52:0/2442489376 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3cfc072ec0 msgr2=0x7f3cfc075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f3d20a2e640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3cfc072ec0 0x7f3cfc075380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0ad000 tx=0x7f3d0c008040 comp rx=0 tx=0).stop 2024-09-15T20:47:16.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f3d20a2e640 1 -- 172.21.15.52:0/2442489376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3d1c08ca70 msgr2=0x7f3d1c1f1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f3d20a2e640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3d1c08ca70 0x7f3d1c1f1780 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000c4b0 tx=0x7f3d1000c970 comp rx=0 tx=0).stop 2024-09-15T20:47:16.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 shutdown_connections 2024-09-15T20:47:16.832 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f805cadf640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f8038072f10 0x7f80380753d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f805cadf640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f8058145030 0x7f80581411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f805cadf640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80580b4e70 0x7f8058140c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f805cadf640 1 --2- 172.21.15.52:0/975489541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f805806ff00 0x7f8058143300 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 >> 172.21.15.52:0/975489541 conn(0x7f80580b5d00 msgr2=0x7f8058070520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 shutdown_connections 2024-09-15T20:47:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f805cadf640 1 -- 172.21.15.52:0/975489541 wait complete. 2024-09-15T20:47:16.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7fefe2ffd640 1 -- 172.21.15.52:0/1354135141 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fefe405efe0 con 0x7fefec13a730 2024-09-15T20:47:16.834 INFO:teuthology.orchestra.run.smithi052.stdout:60129542148 2024-09-15T20:47:16.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f3d20a2e640 1 -- 172.21.15.52:0/2442489376 shutdown_connections 2024-09-15T20:47:16.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f3d20a2e640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3cfc072ec0 0x7f3cfc075380 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.835 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f3d20a2e640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d1c1f1cc0 0x7f3d1c14ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f3d20a2e640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3d1c08ca70 0x7f3d1c1f1780 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f3d20a2e640 1 --2- 172.21.15.52:0/2442489376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d1c070960 0x7f3d1c1474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f3d20a2e640 1 -- 172.21.15.52:0/2442489376 >> 172.21.15.52:0/2442489376 conn(0x7f3d1c0b5260 msgr2=0x7f3d1c0b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f3d20a2e640 1 -- 172.21.15.52:0/2442489376 shutdown_connections 2024-09-15T20:47:16.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.829+0000 7f3d20a2e640 1 -- 172.21.15.52:0/2442489376 wait complete. 2024-09-15T20:47:16.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7f46cffff640 1 -- 172.21.15.52:0/3870286529 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f46bc072ec0 msgr2=0x7f46bc075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7f46cffff640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f46bc072ec0 0x7f46bc075380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f46c0004880 tx=0x7f46c000aed0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7f46cffff640 1 -- 172.21.15.52:0/3870286529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d00af9a0 msgr2=0x7f46d013e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.837 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7f46cffff640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d00af9a0 0x7f46d013e490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c450 tx=0x7f46c400c910 comp rx=0 tx=0).stop 2024-09-15T20:47:16.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7f46cffff640 1 -- 172.21.15.52:0/3870286529 shutdown_connections 2024-09-15T20:47:16.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7f46cffff640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f46bc072ec0 0x7f46bc075380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7f46cffff640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46d013d2f0 0x7f46d0140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7f46cffff640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f46d00af9a0 0x7f46d013e490 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7f46cffff640 1 --2- 172.21.15.52:0/3870286529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46d0073e20 0x7f46d013ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7f46cffff640 1 -- 172.21.15.52:0/3870286529 >> 172.21.15.52:0/3870286529 conn(0x7f46d00b5a90 msgr2=0x7f46d013b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7f46cffff640 1 -- 172.21.15.52:0/3870286529 shutdown_connections 2024-09-15T20:47:16.838 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7f46cffff640 1 -- 172.21.15.52:0/3870286529 wait complete. 2024-09-15T20:47:16.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7fefeb59e640 1 -- 172.21.15.52:0/1354135141 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fefcc072ec0 msgr2=0x7fefcc075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7fefeb59e640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fefcc072ec0 0x7fefcc075380 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fefd4006aa0 tx=0x7fefd4006a30 comp rx=0 tx=0).stop 2024-09-15T20:47:16.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7fefeb59e640 1 -- 172.21.15.52:0/1354135141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefec13a730 msgr2=0x7fefec13ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7fefeb59e640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefec13a730 0x7fefec13ab90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fefe400caa0 tx=0x7fefe400cf60 comp rx=0 tx=0).stop 2024-09-15T20:47:16.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7fefeb59e640 1 -- 172.21.15.52:0/1354135141 shutdown_connections 2024-09-15T20:47:16.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7fefeb59e640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fefcc072ec0 0x7fefcc075380 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7fefeb59e640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefec13a730 0x7fefec13ab90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7fefeb59e640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefec13d2c0 0x7fefec14f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7fefeb59e640 1 --2- 172.21.15.52:0/1354135141 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fefec0afcf0 0x7fefec13c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7fefeb59e640 1 -- 172.21.15.52:0/1354135141 >> 172.21.15.52:0/1354135141 conn(0x7fefec0b5260 msgr2=0x7fefec0b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7fefeb59e640 1 -- 172.21.15.52:0/1354135141 shutdown_connections 2024-09-15T20:47:16.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.833+0000 7fefeb59e640 1 -- 172.21.15.52:0/1354135141 wait complete. 2024-09-15T20:47:16.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.0 2024-09-15T20:47:16.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.841+0000 7f836eb55640 1 -- 172.21.15.52:0/1013210540 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8348005650 con 0x7f83681d4890 2024-09-15T20:47:16.843 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.841+0000 7f83657fa640 1 -- 172.21.15.52:0/1013210540 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f836005fbd0 con 0x7f83681d4890 2024-09-15T20:47:16.844 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2024-09-15T20:47:16.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.841+0000 7f0ec3c17640 1 -- 172.21.15.52:0/1954594295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0ebc0b09d0 con 0x7f0ebc071c80 2024-09-15T20:47:16.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.841+0000 7f0eb27fc640 1 -- 172.21.15.52:0/1954594295 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0eb8063ff0 con 0x7f0ebc071c80 2024-09-15T20:47:16.846 INFO:teuthology.orchestra.run.smithi052.stdout:64424509443 2024-09-15T20:47:16.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f836eb55640 1 -- 172.21.15.52:0/1013210540 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f834c072f10 msgr2=0x7f834c0753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f836eb55640 1 --2- 172.21.15.52:0/1013210540 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f834c072f10 0x7f834c0753d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f835c0ad000 tx=0x7f835c008040 comp rx=0 tx=0).stop 2024-09-15T20:47:16.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f836eb55640 1 -- 172.21.15.52:0/1013210540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83681d4890 msgr2=0x7f83681d4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f836eb55640 1 --2- 172.21.15.52:0/1013210540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83681d4890 0x7f83681d4ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f836000cf20 tx=0x7f836000a7d0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f836eb55640 1 -- 172.21.15.52:0/1013210540 shutdown_connections 2024-09-15T20:47:16.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f836eb55640 1 --2- 172.21.15.52:0/1013210540 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f834c072f10 0x7f834c0753d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f836eb55640 1 --2- 172.21.15.52:0/1013210540 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f83681d4890 0x7f83681d4ce0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f836eb55640 1 --2- 172.21.15.52:0/1013210540 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f836813ca50 0x7f83681d78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f836eb55640 1 --2- 172.21.15.52:0/1013210540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83680afab0 0x7f83681d7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f836eb55640 1 -- 172.21.15.52:0/1013210540 >> 172.21.15.52:0/1013210540 conn(0x7f83680b5280 msgr2=0x7f8368140a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f836eb55640 1 -- 172.21.15.52:0/1013210540 shutdown_connections 2024-09-15T20:47:16.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f836eb55640 1 -- 172.21.15.52:0/1013210540 wait complete. 2024-09-15T20:47:16.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f0ec3c17640 1 -- 172.21.15.52:0/1954594295 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0ea0072ec0 msgr2=0x7f0ea0075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f0ec3c17640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0ea0072ec0 0x7f0ea0075380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0eac007fd0 tx=0x7f0eac006ab0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f0ec3c17640 1 -- 172.21.15.52:0/1954594295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ebc071c80 msgr2=0x7f0ebc0abe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:16.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f0ec3c17640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ebc071c80 0x7f0ebc0abe70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800d5f0 tx=0x7f0eb800dab0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f0ec3c17640 1 -- 172.21.15.52:0/1954594295 shutdown_connections 2024-09-15T20:47:16.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f0ec3c17640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0ea0072ec0 0x7f0ea0075380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f0ec3c17640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0ebc0ab310 0x7f0ebc126730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f0ec3c17640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0ebc142cf0 0x7f0ebc0adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f0ec3c17640 1 --2- 172.21.15.52:0/1954594295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ebc071c80 0x7f0ebc0abe70 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800d5f0 tx=0x7f0eb800dab0 comp rx=0 tx=0).stop 2024-09-15T20:47:16.850 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f0ec3c17640 1 -- 172.21.15.52:0/1954594295 >> 172.21.15.52:0/1954594295 conn(0x7f0ebc0b5280 msgr2=0x7f0ebc0b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:16.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f0ec3c17640 1 -- 172.21.15.52:0/1954594295 shutdown_connections 2024-09-15T20:47:16.851 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:16.845+0000 7f0ec3c17640 1 -- 172.21.15.52:0/1954594295 wait complete. 2024-09-15T20:47:16.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.3 2024-09-15T20:47:16.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.1 2024-09-15T20:47:16.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-09-15T20:47:16.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.6 2024-09-15T20:47:16.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.2 2024-09-15T20:47:16.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-09-15T20:47:16.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.7 2024-09-15T20:47:17.842 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T20:47:17.855 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T20:47:17.864 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T20:47:17.867 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T20:47:17.869 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T20:47:17.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T20:47:17.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T20:47:17.881 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T20:47:18.029 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.025+0000 7ff4a81ee640 1 Processor -- start 2024-09-15T20:47:18.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.025+0000 7ff4a81ee640 1 -- start start 2024-09-15T20:47:18.031 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a81ee640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4a00b0310 0x7ff4a0140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a81ee640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4a013f4b0 0x7ff4a01429f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a81ee640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a013f8b0 con 0x7ff4a0142f30 2024-09-15T20:47:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a81ee640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a00b06f0 con 0x7ff4a013f4b0 2024-09-15T20:47:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a81ee640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a013fbd0 con 0x7ff4a00b0310 2024-09-15T20:47:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a5789640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4a013f4b0 0x7ff4a01429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a5789640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4a013f4b0 0x7ff4a01429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45606/0 (socket says 172.21.15.52:45606) 2024-09-15T20:47:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a5789640 1 -- 172.21.15.52:0/2944219852 learned_addr learned my addr 172.21.15.52:0/2944219852 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a5f8a640 1 --2- 172.21.15.52:0/2944219852 >> v2:172.21.15.81:3300/0 conn(0x7ff4a00b0310 0x7ff4a0140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a5789640 1 -- 172.21.15.52:0/2944219852 >> v2:172.21.15.81:3300/0 conn(0x7ff4a00b0310 msgr2=0x7ff4a0140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a5789640 1 --2- 172.21.15.52:0/2944219852 >> v2:172.21.15.81:3300/0 conn(0x7ff4a00b0310 0x7ff4a0140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a5789640 1 -- 172.21.15.52:0/2944219852 >> v1:172.21.15.81:6789/0 conn(0x7ff4a0142f30 legacy=0x7ff4a013c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.032 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a5789640 1 -- 172.21.15.52:0/2944219852 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a00733e0 con 0x7ff4a013f4b0 2024-09-15T20:47:18.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.029+0000 7ff4a5f8a640 1 --2- 172.21.15.52:0/2944219852 >> v2:172.21.15.81:3300/0 conn(0x7ff4a00b0310 0x7ff4a0140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:47:18.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.033+0000 7ff4a5789640 1 --2- 172.21.15.52:0/2944219852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4a013f4b0 0x7ff4a01429f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff4a006dbe0 tx=0x7ff4980214f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3669169c00f31834 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.037 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.033+0000 7ff4a4f88640 1 -- 172.21.15.52:0/2944219852 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4980b5620 con 0x7ff4a013f4b0 2024-09-15T20:47:18.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.033+0000 7ff4a4f88640 1 -- 172.21.15.52:0/2944219852 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4980b57c0 con 0x7ff4a013f4b0 2024-09-15T20:47:18.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.033+0000 7ff4a4f88640 1 -- 172.21.15.52:0/2944219852 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4980b5bb0 con 0x7ff4a013f4b0 2024-09-15T20:47:18.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.033+0000 7ff4a81ee640 1 -- 172.21.15.52:0/2944219852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4a013f4b0 msgr2=0x7ff4a01429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.038 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.033+0000 7ff4a81ee640 1 --2- 172.21.15.52:0/2944219852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4a013f4b0 0x7ff4a01429f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff4a006dbe0 tx=0x7ff4980214f0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 -- 172.21.15.52:0/2944219852 shutdown_connections 2024-09-15T20:47:18.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 --2- 172.21.15.52:0/2944219852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4a013f4b0 0x7ff4a01429f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.046 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 --2- 172.21.15.52:0/2944219852 >> v2:172.21.15.81:3300/0 conn(0x7ff4a00b0310 0x7ff4a0140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 -- 172.21.15.52:0/2944219852 >> 172.21.15.52:0/2944219852 conn(0x7ff4a00b5260 msgr2=0x7ff4a00b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 -- 172.21.15.52:0/2944219852 shutdown_connections 2024-09-15T20:47:18.047 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 -- 172.21.15.52:0/2944219852 wait complete. 2024-09-15T20:47:18.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 Processor -- start 2024-09-15T20:47:18.048 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 -- start start 2024-09-15T20:47:18.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4a00b0310 0x7ff4a0071500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a013f4b0 0x7ff4a0141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4a0142f30 0x7ff4a01d4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.049 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a013cd70 con 0x7ff4a00b0310 2024-09-15T20:47:18.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a00afa70 con 0x7ff4a013f4b0 2024-09-15T20:47:18.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a81ee640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a013cef0 con 0x7ff4a0142f30 2024-09-15T20:47:18.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a5f8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4a00b0310 0x7ff4a0071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a678b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4a0142f30 0x7ff4a01d4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a5f8a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4a00b0310 0x7ff4a0071500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45618/0 (socket says 172.21.15.52:45618) 2024-09-15T20:47:18.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a678b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4a0142f30 0x7ff4a01d4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:44970/0 (socket says 172.21.15.52:44970) 2024-09-15T20:47:18.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a5f8a640 1 -- 172.21.15.52:0/332291025 learned_addr learned my addr 172.21.15.52:0/332291025 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.050 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.045+0000 7ff4a5789640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a013f4b0 0x7ff4a0141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.049+0000 7ff4a678b640 1 -- 172.21.15.52:0/332291025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a013f4b0 msgr2=0x7ff4a0141aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.049+0000 7ff4a678b640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a013f4b0 0x7ff4a0141aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.049+0000 7ff4a678b640 1 -- 172.21.15.52:0/332291025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4a00b0310 msgr2=0x7ff4a0071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.049+0000 7ff4a678b640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4a00b0310 0x7ff4a0071500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.049+0000 7ff4a678b640 1 -- 172.21.15.52:0/332291025 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a00ab690 con 0x7ff4a0142f30 2024-09-15T20:47:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.049+0000 7ff4a678b640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4a0142f30 0x7ff4a01d4100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00c390 tx=0x7ff49c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.049+0000 7ff4967fc640 1 -- 172.21.15.52:0/332291025 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c017070 con 0x7ff4a0142f30 2024-09-15T20:47:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.049+0000 7ff4967fc640 1 -- 172.21.15.52:0/332291025 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49c0052d0 con 0x7ff4a0142f30 2024-09-15T20:47:18.051 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.049+0000 7ff4a81ee640 1 -- 172.21.15.52:0/332291025 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a0071200 con 0x7ff4a0142f30 2024-09-15T20:47:18.052 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.049+0000 7ff4a81ee640 1 -- 172.21.15.52:0/332291025 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a00721a0 con 0x7ff4a0142f30 2024-09-15T20:47:18.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.053+0000 7ff4967fc640 1 -- 172.21.15.52:0/332291025 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c003840 con 0x7ff4a0142f30 2024-09-15T20:47:18.054 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.053+0000 7ff4a81ee640 1 -- 172.21.15.52:0/332291025 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff488005090 con 0x7ff4a0142f30 2024-09-15T20:47:18.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.057+0000 7ff4967fc640 1 -- 172.21.15.52:0/332291025 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7ff49c01a070 con 0x7ff4a0142f30 2024-09-15T20:47:18.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.057+0000 7ff4967fc640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff484072fc0 0x7ff484075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.057+0000 7ff4967fc640 1 -- 172.21.15.52:0/332291025 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7ff49c092c00 con 0x7ff4a0142f30 2024-09-15T20:47:18.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.057+0000 7ff4a5f8a640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff484072fc0 0x7ff484075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.060 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.057+0000 7ff4a5f8a640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff484072fc0 0x7ff484075480 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff490006fd0 tx=0x7ff490008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.063 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.061+0000 7ff4967fc640 1 -- 172.21.15.52:0/332291025 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7ff49c005480 con 0x7ff4a0142f30 2024-09-15T20:47:18.074 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47bffff640 1 Processor -- start 2024-09-15T20:47:18.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47bffff640 1 -- start start 2024-09-15T20:47:18.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47bffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47c00afe40 0x7f47c013c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47bffff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f47c013c840 0x7f47c0149c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47bffff640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c013ccd0 con 0x7f47c0142b10 2024-09-15T20:47:18.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47bffff640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f47c00b02b0 con 0x7f47c013c840 2024-09-15T20:47:18.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47bffff640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f47c0142ef0 con 0x7f47c00afe40 2024-09-15T20:47:18.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47beffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f47c0142b10 0x7f47c0143110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47434/0 (socket says 172.21.15.52:47434) 2024-09-15T20:47:18.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47beffd640 1 -- 172.21.15.52:0/4170706434 learned_addr learned my addr 172.21.15.52:0/4170706434 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:18.077 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47be7fc640 1 --2- 172.21.15.52:0/4170706434 >> v2:172.21.15.81:3300/0 conn(0x7f47c00afe40 0x7f47c013c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47bdffb640 1 -- 172.21.15.52:0/4170706434 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4238860552 0 0) 0x7f47c013ccd0 con 0x7f47c0142b10 2024-09-15T20:47:18.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47bdffb640 1 -- 172.21.15.52:0/4170706434 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47a8003530 con 0x7f47c0142b10 2024-09-15T20:47:18.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47bf7fe640 1 --2- 172.21.15.52:0/4170706434 >> v2:172.21.15.52:3300/0 conn(0x7f47c013c840 0x7f47c0149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47be7fc640 1 -- 172.21.15.52:0/4170706434 >> v2:172.21.15.52:3300/0 conn(0x7f47c013c840 msgr2=0x7f47c0149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47be7fc640 1 --2- 172.21.15.52:0/4170706434 >> v2:172.21.15.52:3300/0 conn(0x7f47c013c840 0x7f47c0149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47be7fc640 1 -- 172.21.15.52:0/4170706434 >> v1:172.21.15.52:6789/0 conn(0x7f47c0142b10 legacy=0x7f47c0143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47be7fc640 1 -- 172.21.15.52:0/4170706434 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c0072d90 con 0x7f47c00afe40 2024-09-15T20:47:18.078 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.073+0000 7f47bf7fe640 1 --2- 172.21.15.52:0/4170706434 >> v2:172.21.15.52:3300/0 conn(0x7f47c013c840 0x7f47c0149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:47:18.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89b59e640 1 Processor -- start 2024-09-15T20:47:18.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f576152f640 1 Processor -- start 2024-09-15T20:47:18.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f576152f640 1 -- start start 2024-09-15T20:47:18.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89b59e640 1 -- start start 2024-09-15T20:47:18.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89b59e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff89c0b1c30 0x7ff89c0744e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89b59e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89c14ae40 0x7ff89c071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89b59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff89c0b23b0 0x7ff89c071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89b59e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ff89c0b2940 con 0x7ff89c0b1c30 2024-09-15T20:47:18.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89b59e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff89c0b2010 con 0x7ff89c0b23b0 2024-09-15T20:47:18.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89b59e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ff89c072ef0 con 0x7ff89c14ae40 2024-09-15T20:47:18.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89a59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff89c0b1c30 0x7ff89c0744e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89a59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff89c0b1c30 0x7ff89c0744e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45644/0 (socket says 172.21.15.52:45644) 2024-09-15T20:47:18.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89a59c640 1 -- 172.21.15.52:0/4100865778 learned_addr learned my addr 172.21.15.52:0/4100865778 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f576152f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57540c5280 0x7f57540c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f576152f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5754035040 con 0x7f57540c5c10 2024-09-15T20:47:18.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f576152f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5754031bb0 con 0x7f57540369c0 2024-09-15T20:47:18.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f576152f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5754036da0 con 0x7f57540c5280 2024-09-15T20:47:18.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e290d4640 1 Processor -- start 2024-09-15T20:47:18.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff899d9b640 1 --2- 172.21.15.52:0/4100865778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89c14ae40 0x7ff89c071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e290d4640 1 -- start start 2024-09-15T20:47:18.082 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5760d2e640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f57540c5c10 0x7f57540cfa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47442/0 (socket says 172.21.15.52:47442) 2024-09-15T20:47:18.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5760d2e640 1 -- 172.21.15.52:0/4038149450 learned_addr learned my addr 172.21.15.52:0/4038149450 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:18.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f47be7fc640 1 --2- 172.21.15.52:0/4170706434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c00afe40 0x7f47c013c300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47c00af530 tx=0x7f47b001c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c77d54ab4c91578b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89ad9d640 1 --2- 172.21.15.52:0/4100865778 >> v2:172.21.15.81:3300/0 conn(0x7ff89c0b23b0 0x7ff89c071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154507111 0 0) 0x7f5754035040 con 0x7f57540c5c10 2024-09-15T20:47:18.083 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5744003530 con 0x7f57540c5c10 2024-09-15T20:47:18.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff899d9b640 1 -- 172.21.15.52:0/4100865778 >> v2:172.21.15.81:3300/0 conn(0x7ff89c0b23b0 msgr2=0x7ff89c071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff899d9b640 1 --2- 172.21.15.52:0/4100865778 >> v2:172.21.15.81:3300/0 conn(0x7ff89c0b23b0 0x7ff89c071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff899d9b640 1 -- 172.21.15.52:0/4100865778 >> v2:172.21.15.52:3300/0 conn(0x7ff89c0b1c30 msgr2=0x7ff89c0744e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.084 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f47bdffb640 1 -- 172.21.15.52:0/4170706434 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b00ab5f0 con 0x7f47c00afe40 2024-09-15T20:47:18.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575b7fe640 1 --2- 172.21.15.52:0/4038149450 >> v2:172.21.15.81:3300/0 conn(0x7f57540c5280 0x7f57540c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f47bdffb640 1 -- 172.21.15.52:0/4170706434 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b00b0070 con 0x7f47c00afe40 2024-09-15T20:47:18.085 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f47bdffb640 1 -- 172.21.15.52:0/4170706434 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b00ab9b0 con 0x7f47c00afe40 2024-09-15T20:47:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288349650 0 0) 0x7f5754031bb0 con 0x7f57540369c0 2024-09-15T20:47:18.088 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5754035040 con 0x7f57540369c0 2024-09-15T20:47:18.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e290d4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e24070860 0x7f5e24142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e290d4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5e240b5950 0x7f5e240afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e290d4640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e24072ab0 con 0x7f5e2413cbb0 2024-09-15T20:47:18.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e290d4640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5e24071b30 con 0x7f5e240b5950 2024-09-15T20:47:18.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e290d4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5e24072d90 con 0x7f5e24070860 2024-09-15T20:47:18.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7febce25e640 1 Processor -- start 2024-09-15T20:47:18.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 <== mon.1 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2526539339 0 0) 0x7f5754035040 con 0x7f57540369c0 2024-09-15T20:47:18.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 >> v2:172.21.15.81:3300/0 conn(0x7f57540c5280 msgr2=0x7f57540c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 --2- 172.21.15.52:0/4038149450 >> v2:172.21.15.81:3300/0 conn(0x7f57540c5280 0x7f57540c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 >> v1:172.21.15.52:6789/0 conn(0x7f57540c5c10 legacy=0x7f57540cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5754033ca0 con 0x7f57540369c0 2024-09-15T20:47:18.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 <== mon.1 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 282972984 0 0) 0x7f574c001700 con 0x7f57540369c0 2024-09-15T20:47:18.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e23fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5e2413cbb0 0x7f5e24143240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47448/0 (socket says 172.21.15.52:47448) 2024-09-15T20:47:18.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e23fff640 1 -- 172.21.15.52:0/3392228050 learned_addr learned my addr 172.21.15.52:0/3392228050 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:18.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e288d3640 1 --2- 172.21.15.52:0/3392228050 >> v2:172.21.15.52:3300/0 conn(0x7f5e240b5950 0x7f5e240afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 >> v1:172.21.15.81:6789/0 conn(0x7f57540369c0 legacy=0x7f5754030fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 --2- 172.21.15.52:0/4038149450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5744003b80 0x7f5744003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 --2- 172.21.15.52:0/4038149450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744004810 0x7f5744004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 --2- 172.21.15.52:0/4038149450 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 0x7f574400fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57440104a0 con 0x7f5744003b80 2024-09-15T20:47:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5744010650 con 0x7f5744004810 2024-09-15T20:47:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f5744010850 con 0x7f5744005220 2024-09-15T20:47:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f47bffff640 1 -- 172.21.15.52:0/4170706434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c00afe40 msgr2=0x7f47c013c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f47bffff640 1 --2- 172.21.15.52:0/4170706434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c00afe40 0x7f47c013c300 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47c00af530 tx=0x7f47b001c4e0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f575bfff640 1 --2- 172.21.15.52:0/4038149450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5744003b80 0x7f5744003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e288d3640 1 -- 172.21.15.52:0/3392228050 >> v2:172.21.15.81:3300/0 conn(0x7f5e24070860 msgr2=0x7f5e24142bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T20:47:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e288d3640 1 --2- 172.21.15.52:0/3392228050 >> v2:172.21.15.81:3300/0 conn(0x7f5e24070860 0x7f5e24142bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e288d3640 1 -- 172.21.15.52:0/3392228050 >> v1:172.21.15.52:6789/0 conn(0x7f5e2413cbb0 legacy=0x7f5e24143240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5e288d3640 1 -- 172.21.15.52:0/3392228050 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e24073070 con 0x7f5e240b5950 2024-09-15T20:47:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7f5760d2e640 1 --2- 172.21.15.52:0/4038149450 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 0x7f574400fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff899d9b640 1 --2- 172.21.15.52:0/4100865778 >> v2:172.21.15.52:3300/0 conn(0x7ff89c0b1c30 0x7ff89c0744e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff899d9b640 1 -- 172.21.15.52:0/4100865778 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89c144c10 con 0x7ff89c14ae40 2024-09-15T20:47:18.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89ad9d640 1 --2- 172.21.15.52:0/4100865778 >> v2:172.21.15.81:3300/0 conn(0x7ff89c0b23b0 0x7ff89c071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:47:18.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.077+0000 7ff89a59c640 1 --2- 172.21.15.52:0/4100865778 >> v2:172.21.15.52:3300/0 conn(0x7ff89c0b1c30 0x7ff89c0744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:18.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 -- 172.21.15.52:0/4170706434 shutdown_connections 2024-09-15T20:47:18.094 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 --2- 172.21.15.52:0/4170706434 >> v2:172.21.15.52:3300/0 conn(0x7f47c013c840 0x7f47c0149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 --2- 172.21.15.52:0/4170706434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c00afe40 0x7f47c013c300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 -- 172.21.15.52:0/4170706434 >> 172.21.15.52:0/4170706434 conn(0x7f47c00b4f40 msgr2=0x7f47c00b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5760d2e640 1 -- 172.21.15.52:0/4038149450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744004810 msgr2=0x7f5744004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T20:47:18.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5760d2e640 1 --2- 172.21.15.52:0/4038149450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5744004810 0x7f5744004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5760d2e640 1 -- 172.21.15.52:0/4038149450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5744003b80 msgr2=0x7f5744003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5760d2e640 1 --2- 172.21.15.52:0/4038149450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5744003b80 0x7f5744003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5760d2e640 1 -- 172.21.15.52:0/4038149450 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5754035040 con 0x7f5744005220 2024-09-15T20:47:18.095 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5692b11640 1 Processor -- start 2024-09-15T20:47:18.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5692b11640 1 -- start start 2024-09-15T20:47:18.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 -- 172.21.15.52:0/4170706434 shutdown_connections 2024-09-15T20:47:18.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febce25e640 1 -- start start 2024-09-15T20:47:18.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5692b11640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5684032230 0x7f5684032650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.096 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5692b11640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5684032b90 0x7f56840ce990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5692b11640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5684033e70 con 0x7f5684036f00 2024-09-15T20:47:18.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5692b11640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f56840372e0 con 0x7f5684032230 2024-09-15T20:47:18.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5692b11640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f568402d2f0 con 0x7f5684032b90 2024-09-15T20:47:18.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febce25e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7febc0006f00 0x7febc0030370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febce25e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc0034ac0 0x7febc0035940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febce25e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febc0036ff0 con 0x7febc00ca8b0 2024-09-15T20:47:18.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febce25e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7febc00353d0 con 0x7febc0006f00 2024-09-15T20:47:18.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febce25e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7febc0033810 con 0x7febc0034ac0 2024-09-15T20:47:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7ff899d9b640 1 --2- 172.21.15.52:0/4100865778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89c14ae40 0x7ff89c071530 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0b3950 tx=0x7ff89401c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d2833dec02be416 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5691b0f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5684036f00 0x7f568402fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.52:52488/0 (socket says 172.21.15.52:52488) 2024-09-15T20:47:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5691b0f640 1 -- 172.21.15.52:0/2382469842 learned_addr learned my addr 172.21.15.52:0/2382469842 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f569130e640 1 --2- 172.21.15.52:0/2382469842 >> v2:172.21.15.52:3300/0 conn(0x7f5684032230 0x7f5684032650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc7fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7febc00ca8b0 0x7febc0033100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.52:52492/0 (socket says 172.21.15.52:52492) 2024-09-15T20:47:18.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc7fff640 1 -- 172.21.15.52:0/3704465652 learned_addr learned my addr 172.21.15.52:0/3704465652 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:18.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 -- 172.21.15.52:0/4170706434 wait complete. 2024-09-15T20:47:18.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 Processor -- start 2024-09-15T20:47:18.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3357935160 0 0) 0x7febc0036ff0 con 0x7febc00ca8b0 2024-09-15T20:47:18.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febb8003530 con 0x7febc00ca8b0 2024-09-15T20:47:18.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5690b0d640 1 -- 172.21.15.52:0/2382469842 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2859463878 0 0) 0x7f5684033e70 con 0x7f5684036f00 2024-09-15T20:47:18.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5690b0d640 1 -- 172.21.15.52:0/2382469842 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5678003530 con 0x7f5684036f00 2024-09-15T20:47:18.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5760d2e640 1 -- 172.21.15.52:0/4038149450 reap_dead start 2024-09-15T20:47:18.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f569130e640 1 -- 172.21.15.52:0/2382469842 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5684032b90 msgr2=0x7f56840ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f569130e640 1 --2- 172.21.15.52:0/2382469842 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5684032b90 0x7f56840ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f569130e640 1 -- 172.21.15.52:0/2382469842 >> v1:172.21.15.81:6789/0 conn(0x7f5684036f00 legacy=0x7f568402fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.101 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc77fe640 1 --2- 172.21.15.52:0/3704465652 >> v2:172.21.15.52:3300/0 conn(0x7febc0006f00 0x7febc0030370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f569130e640 1 -- 172.21.15.52:0/2382469842 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56840305b0 con 0x7f5684032230 2024-09-15T20:47:18.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5e288d3640 1 --2- 172.21.15.52:0/3392228050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e240b5950 0x7f5e240afd70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5e24071e80 tx=0x7f5e1801d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a8eea98cf9210b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 <== mon.1 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1534560008 0 0) 0x7febb8003530 con 0x7febc00ca8b0 2024-09-15T20:47:18.102 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc0034ac0 msgr2=0x7febc0035940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc0034ac0 0x7febc0035940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 >> v2:172.21.15.52:3300/0 conn(0x7febc0006f00 msgr2=0x7febc0030370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 --2- 172.21.15.52:0/3704465652 >> v2:172.21.15.52:3300/0 conn(0x7febc0006f00 0x7febc0030370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc00339e0 con 0x7febc00ca8b0 2024-09-15T20:47:18.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 <== mon.1 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 282972984 0 0) 0x7febbc001700 con 0x7febc00ca8b0 2024-09-15T20:47:18.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 >> v1:172.21.15.81:6789/0 conn(0x7febc00ca8b0 legacy=0x7febc0033100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb8003a10 0x7febb8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb8004810 0x7febb8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc0034ac0 0x7febb8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7febc00353d0 con 0x7febb8004810 2024-09-15T20:47:18.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7febc0033810 con 0x7febb8003a10 2024-09-15T20:47:18.103 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7febb800bbe0 con 0x7febc0034ac0 2024-09-15T20:47:18.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7ff89959a640 1 -- 172.21.15.52:0/4100865778 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8940b0070 con 0x7ff89c14ae40 2024-09-15T20:47:18.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7ff89959a640 1 -- 172.21.15.52:0/4100865778 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8940ab600 con 0x7ff89c14ae40 2024-09-15T20:47:18.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7ff89959a640 1 -- 172.21.15.52:0/4100865778 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8940ab9d0 con 0x7ff89c14ae40 2024-09-15T20:47:18.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7ff89b59e640 1 -- 172.21.15.52:0/4100865778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89c14ae40 msgr2=0x7ff89c071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7ff89b59e640 1 --2- 172.21.15.52:0/4100865778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89c14ae40 0x7ff89c071530 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0b3950 tx=0x7ff89401c3b0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.104 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5760d2e640 1 --2- 172.21.15.52:0/4038149450 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 0x7f574400fd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f575c000b70 tx=0x7f575c098e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f6a1162bb8fc607 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc6ffd640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb8004810 0x7febb8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc7fff640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc0034ac0 0x7febb8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc77fe640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb8003a10 0x7febb8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 -- start start 2024-09-15T20:47:18.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c00afe40 0x7f47c0143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c013c840 0x7f47c00acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c0142b10 0x7f47c00ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.105 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f47c014cb20 con 0x7f47c013c840 2024-09-15T20:47:18.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc6ffd640 1 -- 172.21.15.52:0/3704465652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc0034ac0 msgr2=0x7febb8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc6ffd640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc0034ac0 0x7febb8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc6ffd640 1 -- 172.21.15.52:0/3704465652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb8003a10 msgr2=0x7febb8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc6ffd640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb8003a10 0x7febb8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc6ffd640 1 -- 172.21.15.52:0/3704465652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc00339e0 con 0x7febb8004810 2024-09-15T20:47:18.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc77fe640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb8003a10 0x7febb8003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:47:18.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7febc7fff640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc0034ac0 0x7febb8005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T20:47:18.106 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f47c014c9a0 con 0x7f47c0142b10 2024-09-15T20:47:18.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f47bffff640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f47c014cca0 con 0x7f47c00afe40 2024-09-15T20:47:18.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47beffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c00afe40 0x7f47c0143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c051e80 con 0x7f5744005220 2024-09-15T20:47:18.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47beffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c00afe40 0x7f47c0143ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:45016/0 (socket says 172.21.15.52:45016) 2024-09-15T20:47:18.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47beffd640 1 -- 172.21.15.52:0/1715035229 learned_addr learned my addr 172.21.15.52:0/1715035229 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.107 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f575c125070 con 0x7f5744005220 2024-09-15T20:47:18.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f575affd640 1 -- 172.21.15.52:0/4038149450 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c121c00 con 0x7f5744005220 2024-09-15T20:47:18.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47bf7fe640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c0142b10 0x7f47c00ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47be7fc640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c013c840 0x7f47c00acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7ff89b59e640 1 -- 172.21.15.52:0/4100865778 shutdown_connections 2024-09-15T20:47:18.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7ff89b59e640 1 --2- 172.21.15.52:0/4100865778 >> v2:172.21.15.81:3300/0 conn(0x7ff89c0b23b0 0x7ff89c071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.108 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7ff89b59e640 1 --2- 172.21.15.52:0/4100865778 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89c14ae40 0x7ff89c071530 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0b3950 tx=0x7ff89401c3b0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7ff89b59e640 1 --2- 172.21.15.52:0/4100865778 >> v2:172.21.15.52:3300/0 conn(0x7ff89c0b1c30 0x7ff89c0744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7ff89b59e640 1 -- 172.21.15.52:0/4100865778 >> 172.21.15.52:0/4100865778 conn(0x7ff89c0b2ac0 msgr2=0x7ff89c0b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5e22ffd640 1 -- 172.21.15.52:0/3392228050 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180b2070 con 0x7f5e240b5950 2024-09-15T20:47:18.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5e22ffd640 1 -- 172.21.15.52:0/3392228050 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e180ad5f0 con 0x7f5e240b5950 2024-09-15T20:47:18.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.081+0000 7f5e22ffd640 1 -- 172.21.15.52:0/3392228050 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180ad9c0 con 0x7f5e240b5950 2024-09-15T20:47:18.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 -- 172.21.15.52:0/3392228050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e240b5950 msgr2=0x7f5e240afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 --2- 172.21.15.52:0/3392228050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e240b5950 0x7f5e240afd70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5e24071e80 tx=0x7f5e1801d4f0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47beffd640 1 -- 172.21.15.52:0/1715035229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c0142b10 msgr2=0x7f47c00ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47beffd640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c0142b10 0x7f47c00ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47beffd640 1 -- 172.21.15.52:0/1715035229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c013c840 msgr2=0x7f47c00acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47beffd640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c013c840 0x7f47c00acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47beffd640 1 -- 172.21.15.52:0/1715035229 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c00af280 con 0x7f47c00afe40 2024-09-15T20:47:18.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 -- 172.21.15.52:0/3392228050 shutdown_connections 2024-09-15T20:47:18.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 --2- 172.21.15.52:0/3392228050 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e240b5950 0x7f5e240afd70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 --2- 172.21.15.52:0/3392228050 >> v2:172.21.15.81:3300/0 conn(0x7f5e24070860 0x7f5e24142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 -- 172.21.15.52:0/3392228050 >> 172.21.15.52:0/3392228050 conn(0x7f5e240b4e60 msgr2=0x7f5e240b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe892257640 1 Processor -- start 2024-09-15T20:47:18.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe892257640 1 -- start start 2024-09-15T20:47:18.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 -- 172.21.15.52:0/3392228050 shutdown_connections 2024-09-15T20:47:18.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47beffd640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c00afe40 0x7f47c0143ee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47b8001a70 tx=0x7f47b8001f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f576152f640 1 -- 172.21.15.52:0/4038149450 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 msgr2=0x7f574400fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f576152f640 1 --2- 172.21.15.52:0/4038149450 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 0x7f574400fd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f575c000b70 tx=0x7f575c098e60 comp rx=0 tx=0).stop 2024-09-15T20:47:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 -- 172.21.15.52:0/3392228050 wait complete. 2024-09-15T20:47:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47a77fe640 1 -- 172.21.15.52:0/1715035229 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b8018070 con 0x7f47c00afe40 2024-09-15T20:47:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47a77fe640 1 -- 172.21.15.52:0/1715035229 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b800d6c0 con 0x7f47c00afe40 2024-09-15T20:47:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f576152f640 1 -- 172.21.15.52:0/4038149450 shutdown_connections 2024-09-15T20:47:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f576152f640 1 --2- 172.21.15.52:0/4038149450 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 0x7f574400fd50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f576152f640 1 -- 172.21.15.52:0/4038149450 >> 172.21.15.52:0/4038149450 conn(0x7f5754005dd0 msgr2=0x7f57540061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47a77fe640 1 -- 172.21.15.52:0/1715035229 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b800dab0 con 0x7f47c00afe40 2024-09-15T20:47:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47bffff640 1 -- 172.21.15.52:0/1715035229 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c00ad6d0 con 0x7f47c00afe40 2024-09-15T20:47:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47bffff640 1 -- 172.21.15.52:0/1715035229 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c0145710 con 0x7f47c00afe40 2024-09-15T20:47:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f576152f640 1 -- 172.21.15.52:0/4038149450 shutdown_connections 2024-09-15T20:47:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f576152f640 1 -- 172.21.15.52:0/4038149450 wait complete. 2024-09-15T20:47:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe892257640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8840316d0 0x7fe884030a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe892257640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe88402ecf0 0x7fe88402f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe892257640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe884032b30 con 0x7fe8840071d0 2024-09-15T20:47:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe892257640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fe8840075b0 con 0x7fe88402ecf0 2024-09-15T20:47:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe892257640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe884031240 con 0x7fe8840316d0 2024-09-15T20:47:18.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7ff89b59e640 1 -- 172.21.15.52:0/4100865778 shutdown_connections 2024-09-15T20:47:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe891a56640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe88402ecf0 0x7fe88402f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe891a56640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe88402ecf0 0x7fe88402f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45700/0 (socket says 172.21.15.52:45700) 2024-09-15T20:47:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe891a56640 1 -- 172.21.15.52:0/2120098531 learned_addr learned my addr 172.21.15.52:0/2120098531 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7ff89b59e640 1 -- 172.21.15.52:0/4100865778 wait complete. 2024-09-15T20:47:18.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 Processor -- start 2024-09-15T20:47:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7febc6ffd640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb8004810 0x7febb8004c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7febc8052940 tx=0x7febc8098b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402597bbc7841718 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f576152f640 1 Processor -- start 2024-09-15T20:47:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f47bffff640 1 -- 172.21.15.52:0/1715035229 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c013c300 con 0x7f47c00afe40 2024-09-15T20:47:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f47a77fe640 1 -- 172.21.15.52:0/1715035229 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f47b801b070 con 0x7f47c00afe40 2024-09-15T20:47:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f47a77fe640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f47ac072ec0 0x7f47ac075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f47a77fe640 1 -- 172.21.15.52:0/1715035229 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f47b8093560 con 0x7f47c00afe40 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f576152f640 1 -- start start 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f576152f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 0x7f5754030050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f576152f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575402c740 0x7f575402ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f576152f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f575402daf0 0x7f57540c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f576152f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57540c5690 con 0x7f575402daf0 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f576152f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5754037660 con 0x7f575402c740 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f576152f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f57540c5810 con 0x7f5744005220 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f575bfff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 0x7f5754030050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f575bfff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 0x7f5754030050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:45032/0 (socket says 172.21.15.52:45032) 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f575bfff640 1 -- 172.21.15.52:0/1013252935 learned_addr learned my addr 172.21.15.52:0/1013252935 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f575b7fe640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575402c740 0x7f575402ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f575bfff640 1 -- 172.21.15.52:0/1013252935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575402c740 msgr2=0x7f575402ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f575bfff640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575402c740 0x7f575402ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f575bfff640 1 -- 172.21.15.52:0/1013252935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f575402daf0 msgr2=0x7f57540c8b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T20:47:18.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f575bfff640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f575402daf0 0x7f57540c8b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f575bfff640 1 -- 172.21.15.52:0/1013252935 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57540c70b0 con 0x7f5744005220 2024-09-15T20:47:18.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f575bfff640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 0x7f5754030050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f574c00f7f0 tx=0x7f574c00fcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 -- start start 2024-09-15T20:47:18.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24070860 0x7f5e2413e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e240b5950 0x7f5e2413ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e2413f120 0x7f5e241e3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2414c8b0 con 0x7f5e240b5950 2024-09-15T20:47:18.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2414c730 con 0x7f5e24070860 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7f5e290d4640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2414ca30 con 0x7f5e2413f120 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24070860 0x7f5e2413e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24070860 0x7f5e2413e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.52:55012/0 (socket says 172.21.15.52:55012) 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e23fff640 1 -- 172.21.15.52:0/789459536 learned_addr learned my addr 172.21.15.52:0/789459536 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e237fe640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e240b5950 0x7f5e2413ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e237fe640 1 -- 172.21.15.52:0/789459536 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e2413f120 msgr2=0x7f5e241e3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e237fe640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e2413f120 0x7f5e241e3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e237fe640 1 -- 172.21.15.52:0/789459536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24070860 msgr2=0x7f5e2413e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e237fe640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24070860 0x7f5e2413e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e237fe640 1 -- 172.21.15.52:0/789459536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e240aaef0 con 0x7f5e240b5950 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e237fe640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e240b5950 0x7f5e2413ebe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400b3f0 tx=0x7f5e1400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e20ff9640 1 -- 172.21.15.52:0/789459536 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14015020 con 0x7f5e240b5950 2024-09-15T20:47:18.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e20ff9640 1 -- 172.21.15.52:0/789459536 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e14011830 con 0x7f5e240b5950 2024-09-15T20:47:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e20ff9640 1 -- 172.21.15.52:0/789459536 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14011c20 con 0x7f5e240b5950 2024-09-15T20:47:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8064650 con 0x7febb8004810 2024-09-15T20:47:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc81219c0 con 0x7febb8004810 2024-09-15T20:47:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7febc67fc640 1 -- 172.21.15.52:0/3704465652 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8121db0 con 0x7febb8004810 2024-09-15T20:47:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7febce25e640 1 -- 172.21.15.52:0/3704465652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb8004810 msgr2=0x7febb8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7febce25e640 1 --2- 172.21.15.52:0/3704465652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febb8004810 0x7febb8004c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7febc8052940 tx=0x7febc8098b90 comp rx=0 tx=0).stop 2024-09-15T20:47:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7febc7fff640 1 -- 172.21.15.52:0/3704465652 reap_dead start 2024-09-15T20:47:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febce25e640 1 -- 172.21.15.52:0/3704465652 shutdown_connections 2024-09-15T20:47:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febce25e640 1 -- 172.21.15.52:0/3704465652 >> 172.21.15.52:0/3704465652 conn(0x7febc0005da0 msgr2=0x7febc00061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febce25e640 1 -- 172.21.15.52:0/3704465652 shutdown_connections 2024-09-15T20:47:18.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febce25e640 1 -- 172.21.15.52:0/3704465652 wait complete. 2024-09-15T20:47:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febce25e640 1 Processor -- start 2024-09-15T20:47:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe891a56640 1 -- 172.21.15.52:0/2120098531 >> v2:172.21.15.81:3300/0 conn(0x7fe8840316d0 msgr2=0x7fe884030a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T20:47:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe891a56640 1 --2- 172.21.15.52:0/2120098531 >> v2:172.21.15.81:3300/0 conn(0x7fe8840316d0 0x7fe884030a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.122 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe891a56640 1 -- 172.21.15.52:0/2120098531 >> v1:172.21.15.52:6789/0 conn(0x7fe8840071d0 legacy=0x7fe8840c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7fe891a56640 1 -- 172.21.15.52:0/2120098531 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe884032da0 con 0x7fe88402ecf0 2024-09-15T20:47:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7ff89b59e640 1 Processor -- start 2024-09-15T20:47:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.085+0000 7ff89b59e640 1 -- start start 2024-09-15T20:47:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89b59e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89c0b1c30 0x7ff89c150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff89c0b23b0 0x7ff89c1478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89b59e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff89c150cb0 0x7ff89c14de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89b59e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c06d880 con 0x7ff89c150cb0 2024-09-15T20:47:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89b59e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff89c06d700 con 0x7ff89c0b23b0 2024-09-15T20:47:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89b59e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ff89c06da00 con 0x7ff89c0b1c30 2024-09-15T20:47:18.123 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff89c150cb0 0x7ff89c14de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89ad9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff89c150cb0 0x7ff89c14de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45710/0 (socket says 172.21.15.52:45710) 2024-09-15T20:47:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89ad9d640 1 -- 172.21.15.52:0/327742652 learned_addr learned my addr 172.21.15.52:0/327742652 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7fe891a56640 1 --2- 172.21.15.52:0/2120098531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe88402ecf0 0x7fe88402f120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe88402c8c0 tx=0x7fe88801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24152c12c3acdd28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff899d9b640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff89c0b23b0 0x7ff89c1478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89ad9d640 1 -- 172.21.15.52:0/327742652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89c0b1c30 msgr2=0x7ff89c150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89ad9d640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89c0b1c30 0x7ff89c150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.124 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89ad9d640 1 -- 172.21.15.52:0/327742652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff89c0b23b0 msgr2=0x7ff89c1478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89ad9d640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff89c0b23b0 0x7ff89c1478d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89ad9d640 1 -- 172.21.15.52:0/327742652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89c14fa70 con 0x7ff89c150cb0 2024-09-15T20:47:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7ff89ad9d640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff89c150cb0 0x7ff89c14de60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00cd50 tx=0x7ff88c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e290d4640 1 -- 172.21.15.52:0/789459536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e240ab1d0 con 0x7f5e240b5950 2024-09-15T20:47:18.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f5e290d4640 1 -- 172.21.15.52:0/789459536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e241367b0 con 0x7f5e240b5950 2024-09-15T20:47:18.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febce25e640 1 -- start start 2024-09-15T20:47:18.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febce25e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc0154210 0x7febc00c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febce25e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febc002ed20 0x7febc00c1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febce25e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc002f180 0x7febc00c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febce25e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7febc0035cd0 con 0x7febc002ed20 2024-09-15T20:47:18.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febce25e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7febc0035b50 con 0x7febc0154210 2024-09-15T20:47:18.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febce25e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7febc0035e50 con 0x7febc002f180 2024-09-15T20:47:18.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7f47be7fc640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f47ac072ec0 0x7f47ac075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febc77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc0154210 0x7febc00c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febc7fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc002f180 0x7febc00c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febc7fff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc002f180 0x7febc00c1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:45068/0 (socket says 172.21.15.52:45068) 2024-09-15T20:47:18.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febc7fff640 1 -- 172.21.15.52:0/490131568 learned_addr learned my addr 172.21.15.52:0/490131568 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febc7fff640 1 -- 172.21.15.52:0/490131568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc0154210 msgr2=0x7febc00c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febc7fff640 1 --2- 172.21.15.52:0/490131568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc0154210 0x7febc00c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febc7fff640 1 -- 172.21.15.52:0/490131568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febc002ed20 msgr2=0x7febc00c1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febc7fff640 1 --2- 172.21.15.52:0/490131568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febc002ed20 0x7febc00c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.089+0000 7febc7fff640 1 -- 172.21.15.52:0/490131568 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc002fc90 con 0x7febc002f180 2024-09-15T20:47:18.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7f5e290d4640 1 -- 172.21.15.52:0/789459536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e24142bd0 con 0x7f5e240b5950 2024-09-15T20:47:18.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe883fff640 1 -- 172.21.15.52:0/2120098531 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8880aa5f0 con 0x7fe88402ecf0 2024-09-15T20:47:18.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7ff892ffd640 1 -- 172.21.15.52:0/327742652 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00f680 con 0x7ff89c150cb0 2024-09-15T20:47:18.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7ff892ffd640 1 -- 172.21.15.52:0/327742652 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88c00f840 con 0x7ff89c150cb0 2024-09-15T20:47:18.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7f47be7fc640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f47ac072ec0 0x7f47ac075380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f47c00af530 tx=0x7f47b00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe883fff640 1 -- 172.21.15.52:0/2120098531 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8880af070 con 0x7fe88402ecf0 2024-09-15T20:47:18.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe883fff640 1 -- 172.21.15.52:0/2120098531 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8880aa9b0 con 0x7fe88402ecf0 2024-09-15T20:47:18.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7ff89b59e640 1 -- 172.21.15.52:0/327742652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89c14fd50 con 0x7ff89c150cb0 2024-09-15T20:47:18.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7ff89b59e640 1 -- 172.21.15.52:0/327742652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89c14e3a0 con 0x7ff89c150cb0 2024-09-15T20:47:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7ff892ffd640 1 -- 172.21.15.52:0/327742652 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00fc30 con 0x7ff89c150cb0 2024-09-15T20:47:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7febc7fff640 1 --2- 172.21.15.52:0/490131568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc002f180 0x7febc00c1580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7febc00347e0 tx=0x7febbc011c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7f569130e640 1 --2- 172.21.15.52:0/2382469842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5684032230 0x7f5684032650 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f56840307e0 tx=0x7f567c01c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01c942a68180a28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 -- 172.21.15.52:0/2120098531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe88402ecf0 msgr2=0x7fe88402f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 --2- 172.21.15.52:0/2120098531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe88402ecf0 0x7fe88402f120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe88402c8c0 tx=0x7fe88801c470 comp rx=0 tx=0).stop 2024-09-15T20:47:18.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7f5e20ff9640 1 -- 172.21.15.52:0/789459536 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f5e14018020 con 0x7f5e240b5950 2024-09-15T20:47:18.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 -- 172.21.15.52:0/2120098531 shutdown_connections 2024-09-15T20:47:18.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 --2- 172.21.15.52:0/2120098531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe88402ecf0 0x7fe88402f120 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 --2- 172.21.15.52:0/2120098531 >> v2:172.21.15.81:3300/0 conn(0x7fe8840316d0 0x7fe884030a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 -- 172.21.15.52:0/2120098531 >> 172.21.15.52:0/2120098531 conn(0x7fe884006080 msgr2=0x7fe884006490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 -- 172.21.15.52:0/2120098531 shutdown_connections 2024-09-15T20:47:18.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7f5e20ff9640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5e10072f10 0x7f5e100753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7ff89b59e640 1 -- 172.21.15.52:0/327742652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff880005090 con 0x7ff89c150cb0 2024-09-15T20:47:18.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7f5e23fff640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5e10072f10 0x7f5e100753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7f5e20ff9640 1 -- 172.21.15.52:0/789459536 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f5e14009150 con 0x7f5e240b5950 2024-09-15T20:47:18.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7f5e23fff640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5e10072f10 0x7f5e100753d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0012f0 tx=0x7f5e1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 -- 172.21.15.52:0/2120098531 wait complete. 2024-09-15T20:47:18.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 Processor -- start 2024-09-15T20:47:18.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 -- start start 2024-09-15T20:47:18.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7f5690b0d640 1 -- 172.21.15.52:0/2382469842 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c0a9640 con 0x7f5684032230 2024-09-15T20:47:18.134 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8840071d0 0x7fe8840c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe88402ecf0 0x7fe8840be120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840316d0 0x7fe88402a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe8840d2860 con 0x7fe8840071d0 2024-09-15T20:47:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8840d26e0 con 0x7fe8840316d0 2024-09-15T20:47:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe892257640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fe8840d29e0 con 0x7fe88402ecf0 2024-09-15T20:47:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe891255640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8840071d0 0x7fe8840c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe890a54640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe88402ecf0 0x7fe8840be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe891255640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8840071d0 0x7fe8840c20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45728/0 (socket says 172.21.15.52:45728) 2024-09-15T20:47:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe890a54640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe88402ecf0 0x7fe8840be120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:45074/0 (socket says 172.21.15.52:45074) 2024-09-15T20:47:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.093+0000 7fe891255640 1 -- 172.21.15.52:0/2245018968 learned_addr learned my addr 172.21.15.52:0/2245018968 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.097+0000 7fe891a56640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840316d0 0x7fe88402a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.097+0000 7fe891255640 1 -- 172.21.15.52:0/2245018968 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe88402ecf0 msgr2=0x7fe8840be120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.097+0000 7fe891255640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe88402ecf0 0x7fe8840be120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.097+0000 7fe891255640 1 -- 172.21.15.52:0/2245018968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840316d0 msgr2=0x7fe88402a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.097+0000 7fe891255640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840316d0 0x7fe88402a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.097+0000 7fe891255640 1 -- 172.21.15.52:0/2245018968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8840cbec0 con 0x7fe8840071d0 2024-09-15T20:47:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.097+0000 7fe891255640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8840071d0 0x7fe8840c20e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00c420 tx=0x7fe87c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.097+0000 7f47a77fe640 1 -- 172.21.15.52:0/1715035229 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f47b8022020 con 0x7f47c00afe40 2024-09-15T20:47:18.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.097+0000 7f5758ff9640 1 -- 172.21.15.52:0/1013252935 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c0052e0 con 0x7f5744005220 2024-09-15T20:47:18.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.097+0000 7f576152f640 1 -- 172.21.15.52:0/1013252935 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57540c7390 con 0x7f5744005220 2024-09-15T20:47:18.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.097+0000 7f576152f640 1 -- 172.21.15.52:0/1013252935 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f575402d5d0 con 0x7f5744005220 2024-09-15T20:47:18.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.097+0000 7f576152f640 1 -- 172.21.15.52:0/1013252935 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575402d7d0 con 0x7f5744005220 2024-09-15T20:47:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.101+0000 7febb3fff640 1 -- 172.21.15.52:0/490131568 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc010040 con 0x7febc002f180 2024-09-15T20:47:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.101+0000 7febce25e640 1 -- 172.21.15.52:0/490131568 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc002ff70 con 0x7febc002f180 2024-09-15T20:47:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.101+0000 7febce25e640 1 -- 172.21.15.52:0/490131568 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7febc002de60 con 0x7febc002f180 2024-09-15T20:47:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.101+0000 7febce25e640 1 -- 172.21.15.52:0/490131568 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc0030370 con 0x7febc002f180 2024-09-15T20:47:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.101+0000 7febb3fff640 1 -- 172.21.15.52:0/490131568 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febbc01a070 con 0x7febc002f180 2024-09-15T20:47:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.101+0000 7febb3fff640 1 -- 172.21.15.52:0/490131568 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc00fb00 con 0x7febc002f180 2024-09-15T20:47:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.101+0000 7f5758ff9640 1 -- 172.21.15.52:0/1013252935 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574c018070 con 0x7f5744005220 2024-09-15T20:47:18.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.101+0000 7f5758ff9640 1 -- 172.21.15.52:0/1013252935 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c00d930 con 0x7f5744005220 2024-09-15T20:47:18.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.101+0000 7f5e20ff9640 1 -- 172.21.15.52:0/789459536 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f5e1405ded0 con 0x7f5e240b5950 2024-09-15T20:47:18.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.101+0000 7f5690b0d640 1 -- 172.21.15.52:0/2382469842 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c0a97e0 con 0x7f5684032230 2024-09-15T20:47:18.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7f5692b11640 1 -- 172.21.15.52:0/2382469842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5684032230 msgr2=0x7f5684032650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.101+0000 7f5758ff9640 1 -- 172.21.15.52:0/1013252935 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f574c00db90 con 0x7f5744005220 2024-09-15T20:47:18.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7f5758ff9640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5748072ec0 0x7f5748075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7f5758ff9640 1 -- 172.21.15.52:0/1013252935 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f574c094530 con 0x7f5744005220 2024-09-15T20:47:18.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7f575b7fe640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5748072ec0 0x7f5748075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7f5690b0d640 1 -- 172.21.15.52:0/2382469842 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c0a9640 con 0x7f5684032230 2024-09-15T20:47:18.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7fe881ffb640 1 -- 172.21.15.52:0/2245018968 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c017070 con 0x7fe8840071d0 2024-09-15T20:47:18.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7fe881ffb640 1 -- 172.21.15.52:0/2245018968 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87c0052d0 con 0x7fe8840071d0 2024-09-15T20:47:18.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7fe881ffb640 1 -- 172.21.15.52:0/2245018968 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0054c0 con 0x7fe8840071d0 2024-09-15T20:47:18.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7fe892257640 1 -- 172.21.15.52:0/2245018968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8840c1bc0 con 0x7fe8840071d0 2024-09-15T20:47:18.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7fe892257640 1 -- 172.21.15.52:0/2245018968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8840cba40 con 0x7fe8840071d0 2024-09-15T20:47:18.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7f5692b11640 1 --2- 172.21.15.52:0/2382469842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5684032230 0x7f5684032650 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f56840307e0 tx=0x7f567c01c670 comp rx=0 tx=0).stop 2024-09-15T20:47:18.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7fe892257640 1 -- 172.21.15.52:0/2245018968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe88402f120 con 0x7fe8840071d0 2024-09-15T20:47:18.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7f5692b11640 1 -- 172.21.15.52:0/2382469842 shutdown_connections 2024-09-15T20:47:18.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7f5692b11640 1 --2- 172.21.15.52:0/2382469842 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5684032b90 0x7f56840ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7f5692b11640 1 --2- 172.21.15.52:0/2382469842 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5684032230 0x7f5684032650 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7f5692b11640 1 -- 172.21.15.52:0/2382469842 >> 172.21.15.52:0/2382469842 conn(0x7f568403a110 msgr2=0x7f5684036590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7ff892ffd640 1 -- 172.21.15.52:0/327742652 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7ff88c0213f0 con 0x7ff89c150cb0 2024-09-15T20:47:18.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7f575b7fe640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5748072ec0 0x7f5748075380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5754030590 tx=0x7f5750008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7f5758ff9640 1 -- 172.21.15.52:0/1013252935 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f575402d7d0 con 0x7f5744005220 2024-09-15T20:47:18.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7ff892ffd640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff888073100 0x7ff8880755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.105+0000 7ff892ffd640 1 -- 172.21.15.52:0/327742652 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7ff88c094c60 con 0x7ff89c150cb0 2024-09-15T20:47:18.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5692b11640 1 -- 172.21.15.52:0/2382469842 shutdown_connections 2024-09-15T20:47:18.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5692b11640 1 -- 172.21.15.52:0/2382469842 wait complete. 2024-09-15T20:47:18.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5692b11640 1 Processor -- start 2024-09-15T20:47:18.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7ff89a59c640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff888073100 0x7ff8880755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5692b11640 1 -- start start 2024-09-15T20:47:18.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5692b11640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5684032230 0x7f5684006950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5692b11640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5684032b90 0x7f5684166db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5692b11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5684036f00 0x7f56840b8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5692b11640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56840d1870 con 0x7f5684032230 2024-09-15T20:47:18.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5692b11640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56840d16f0 con 0x7f5684036f00 2024-09-15T20:47:18.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5692b11640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f56840d19f0 con 0x7f5684032b90 2024-09-15T20:47:18.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5691b0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5684032230 0x7f5684006950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5691b0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5684032230 0x7f5684006950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45734/0 (socket says 172.21.15.52:45734) 2024-09-15T20:47:18.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5691b0f640 1 -- 172.21.15.52:0/60788147 learned_addr learned my addr 172.21.15.52:0/60788147 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7f5692310640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5684036f00 0x7f56840b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7f5692310640 1 -- 172.21.15.52:0/60788147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5684032b90 msgr2=0x7f5684166db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T20:47:18.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7f5692310640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5684032b90 0x7f5684166db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7f5692310640 1 -- 172.21.15.52:0/60788147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5684032230 msgr2=0x7f5684006950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7f5692310640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5684032230 0x7f5684006950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7f5692310640 1 -- 172.21.15.52:0/60788147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56840bbef0 con 0x7f5684036f00 2024-09-15T20:47:18.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7febb3fff640 1 -- 172.21.15.52:0/490131568 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7febbc00fca0 con 0x7febc002f180 2024-09-15T20:47:18.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7febb3fff640 1 --2- 172.21.15.52:0/490131568 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7febac072ec0 0x7febac075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7febb3fff640 1 -- 172.21.15.52:0/490131568 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7febbc0971a0 con 0x7febc002f180 2024-09-15T20:47:18.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7febc77fe640 1 --2- 172.21.15.52:0/490131568 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7febac072ec0 0x7febac075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.109+0000 7febc77fe640 1 --2- 172.21.15.52:0/490131568 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7febac072ec0 0x7febac075380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7febb4009990 tx=0x7febb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7ff89a59c640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff888073100 0x7ff8880755c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff884009a70 tx=0x7ff884009470 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7f5692310640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5684036f00 0x7f56840b8630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f568c075cb0 tx=0x7f568c069db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7ff892ffd640 1 -- 172.21.15.52:0/327742652 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7ff88c014030 con 0x7ff89c150cb0 2024-09-15T20:47:18.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7fe881ffb640 1 -- 172.21.15.52:0/2245018968 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fe87c01a070 con 0x7fe8840071d0 2024-09-15T20:47:18.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7febb3fff640 1 -- 172.21.15.52:0/490131568 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7febbc062720 con 0x7febc002f180 2024-09-15T20:47:18.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7fe881ffb640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fe870072f10 0x7fe8700753d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7fe881ffb640 1 -- 172.21.15.52:0/2245018968 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7fe87c093120 con 0x7fe8840071d0 2024-09-15T20:47:18.147 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.113+0000 7fe890a54640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fe870072f10 0x7fe8700753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.117+0000 7f56827fc640 1 -- 172.21.15.52:0/60788147 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c073630 con 0x7f5684036f00 2024-09-15T20:47:18.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.117+0000 7f5692b11640 1 -- 172.21.15.52:0/60788147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56840bd450 con 0x7f5684036f00 2024-09-15T20:47:18.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.117+0000 7f5692b11640 1 -- 172.21.15.52:0/60788147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56840bb340 con 0x7f5684036f00 2024-09-15T20:47:18.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.117+0000 7fe890a54640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fe870072f10 0x7fe8700753d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe88c075c10 tx=0x7fe88c070040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.117+0000 7f56827fc640 1 -- 172.21.15.52:0/60788147 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f568c0737d0 con 0x7f5684036f00 2024-09-15T20:47:18.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.117+0000 7f56827fc640 1 -- 172.21.15.52:0/60788147 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c073bc0 con 0x7f5684036f00 2024-09-15T20:47:18.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.117+0000 7f5692b11640 1 -- 172.21.15.52:0/60788147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5684032650 con 0x7f5684036f00 2024-09-15T20:47:18.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.117+0000 7f56827fc640 1 -- 172.21.15.52:0/60788147 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f568c095480 con 0x7f5684036f00 2024-09-15T20:47:18.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.117+0000 7f56827fc640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5670072f90 0x7f5670075450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.121+0000 7f56827fc640 1 -- 172.21.15.52:0/60788147 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f568c10fde0 con 0x7f5684036f00 2024-09-15T20:47:18.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.121+0000 7f5691b0f640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5670072f90 0x7f5670075450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.121+0000 7fe881ffb640 1 -- 172.21.15.52:0/2245018968 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fe87c021020 con 0x7fe8840071d0 2024-09-15T20:47:18.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.121+0000 7f5691b0f640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5670072f90 0x7f5670075450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5688007fd0 tx=0x7f5688009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.150 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.129+0000 7f56827fc640 1 -- 172.21.15.52:0/60788147 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f568c0a4080 con 0x7f5684036f00 2024-09-15T20:47:18.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.397+0000 7ff4a81ee640 1 -- 172.21.15.52:0/332291025 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff488005380 con 0x7ff4a0142f30 2024-09-15T20:47:18.401 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.397+0000 7ff4967fc640 1 -- 172.21.15.52:0/332291025 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff49c05da20 con 0x7ff4a0142f30 2024-09-15T20:47:18.404 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-09-15T20:47:18.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.401+0000 7ff4a81ee640 1 -- 172.21.15.52:0/332291025 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff484072fc0 msgr2=0x7ff484075480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.401+0000 7ff4a81ee640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff484072fc0 0x7ff484075480 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff490006fd0 tx=0x7ff490008040 comp rx=0 tx=0).stop 2024-09-15T20:47:18.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.401+0000 7ff4a81ee640 1 -- 172.21.15.52:0/332291025 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4a0142f30 msgr2=0x7ff4a01d4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.401+0000 7ff4a81ee640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4a0142f30 0x7ff4a01d4100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00c390 tx=0x7ff49c00c850 comp rx=0 tx=0).stop 2024-09-15T20:47:18.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.401+0000 7ff4a81ee640 1 -- 172.21.15.52:0/332291025 shutdown_connections 2024-09-15T20:47:18.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.401+0000 7ff4a81ee640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff484072fc0 0x7ff484075480 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.401+0000 7ff4a81ee640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff4a0142f30 0x7ff4a01d4100 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.405+0000 7ff4a81ee640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a013f4b0 0x7ff4a0141aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.405+0000 7ff4a81ee640 1 --2- 172.21.15.52:0/332291025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4a00b0310 0x7ff4a0071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.406 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.405+0000 7ff4a81ee640 1 -- 172.21.15.52:0/332291025 >> 172.21.15.52:0/332291025 conn(0x7ff4a00b5260 msgr2=0x7ff4a0138650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.405+0000 7ff4a81ee640 1 -- 172.21.15.52:0/332291025 shutdown_connections 2024-09-15T20:47:18.407 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.405+0000 7ff4a81ee640 1 -- 172.21.15.52:0/332291025 wait complete. 2024-09-15T20:47:18.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-09-15T20:47:18.428 DEBUG:teuthology.parallel:result is None 2024-09-15T20:47:18.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 -- 172.21.15.52:0/2245018968 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe884037b90 con 0x7fe8840071d0 2024-09-15T20:47:18.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe881ffb640 1 -- 172.21.15.52:0/2245018968 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe87c05df40 con 0x7fe8840071d0 2024-09-15T20:47:18.451 INFO:teuthology.orchestra.run.smithi052.stdout:55834574854 2024-09-15T20:47:18.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7f47bffff640 1 -- 172.21.15.52:0/1715035229 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f47c00aefa0 con 0x7f47c00afe40 2024-09-15T20:47:18.452 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7f47a77fe640 1 -- 172.21.15.52:0/1715035229 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f47c00aefa0 con 0x7f47c00afe40 2024-09-15T20:47:18.452 INFO:teuthology.orchestra.run.smithi052.stdout:64424509446 2024-09-15T20:47:18.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 -- 172.21.15.52:0/2245018968 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fe870072f10 msgr2=0x7fe8700753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.453 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fe870072f10 0x7fe8700753d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe88c075c10 tx=0x7fe88c070040 comp rx=0 tx=0).stop 2024-09-15T20:47:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 -- 172.21.15.52:0/2245018968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8840071d0 msgr2=0x7fe8840c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8840071d0 0x7fe8840c20e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00c420 tx=0x7fe87c00c8e0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 -- 172.21.15.52:0/2245018968 shutdown_connections 2024-09-15T20:47:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fe870072f10 0x7fe8700753d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8840316d0 0x7fe88402a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe88402ecf0 0x7fe8840be120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 --2- 172.21.15.52:0/2245018968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe8840071d0 0x7fe8840c20e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 -- 172.21.15.52:0/2245018968 >> 172.21.15.52:0/2245018968 conn(0x7fe884006080 msgr2=0x7fe884030440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 -- 172.21.15.52:0/2245018968 shutdown_connections 2024-09-15T20:47:18.454 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7fe892257640 1 -- 172.21.15.52:0/2245018968 wait complete. 2024-09-15T20:47:18.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.449+0000 7f5e290d4640 1 -- 172.21.15.52:0/789459536 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5e24149ae0 con 0x7f5e240b5950 2024-09-15T20:47:18.455 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f5e20ff9640 1 -- 172.21.15.52:0/789459536 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5e1405d7d0 con 0x7f5e240b5950 2024-09-15T20:47:18.455 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2024-09-15T20:47:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f47bffff640 1 -- 172.21.15.52:0/1715035229 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f47ac072ec0 msgr2=0x7f47ac075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f47bffff640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f47ac072ec0 0x7f47ac075380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f47c00af530 tx=0x7f47b00a7000 comp rx=0 tx=0).stop 2024-09-15T20:47:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f47bffff640 1 -- 172.21.15.52:0/1715035229 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c00afe40 msgr2=0x7f47c0143ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f47bffff640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c00afe40 0x7f47c0143ee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47b8001a70 tx=0x7f47b8001f30 comp rx=0 tx=0).stop 2024-09-15T20:47:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f47bffff640 1 -- 172.21.15.52:0/1715035229 shutdown_connections 2024-09-15T20:47:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f47bffff640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f47ac072ec0 0x7f47ac075380 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f47bffff640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47c0142b10 0x7f47c00ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f47bffff640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f47c013c840 0x7f47c00acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f47bffff640 1 --2- 172.21.15.52:0/1715035229 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f47c00afe40 0x7f47c0143ee0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f47bffff640 1 -- 172.21.15.52:0/1715035229 >> 172.21.15.52:0/1715035229 conn(0x7f47c00b4f40 msgr2=0x7f47c0073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.456 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f47bffff640 1 -- 172.21.15.52:0/1715035229 shutdown_connections 2024-09-15T20:47:18.457 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.453+0000 7f47bffff640 1 -- 172.21.15.52:0/1715035229 wait complete. 2024-09-15T20:47:18.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7f5e290d4640 1 -- 172.21.15.52:0/789459536 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5e10072f10 msgr2=0x7f5e100753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.458 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7f5e290d4640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5e10072f10 0x7f5e100753d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0012f0 tx=0x7f5e1c009040 comp rx=0 tx=0).stop 2024-09-15T20:47:18.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7f5e290d4640 1 -- 172.21.15.52:0/789459536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e240b5950 msgr2=0x7f5e2413ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7f5e290d4640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e240b5950 0x7f5e2413ebe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400b3f0 tx=0x7f5e1400b8b0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7f5e290d4640 1 -- 172.21.15.52:0/789459536 shutdown_connections 2024-09-15T20:47:18.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7f5e290d4640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5e10072f10 0x7f5e100753d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7f5e290d4640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5e2413f120 0x7f5e241e3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7f5e290d4640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e240b5950 0x7f5e2413ebe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7f5e290d4640 1 --2- 172.21.15.52:0/789459536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e24070860 0x7f5e2413e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7f5e290d4640 1 -- 172.21.15.52:0/789459536 >> 172.21.15.52:0/789459536 conn(0x7f5e240b4e60 msgr2=0x7f5e240b5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7f5e290d4640 1 -- 172.21.15.52:0/789459536 shutdown_connections 2024-09-15T20:47:18.459 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7f5e290d4640 1 -- 172.21.15.52:0/789459536 wait complete. 2024-09-15T20:47:18.461 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.457+0000 7ff89b59e640 1 -- 172.21.15.52:0/327742652 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff880005650 con 0x7ff89c150cb0 2024-09-15T20:47:18.462 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.461+0000 7ff892ffd640 1 -- 172.21.15.52:0/327742652 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff88c0600d0 con 0x7ff89c150cb0 2024-09-15T20:47:18.462 INFO:teuthology.orchestra.run.smithi052.stdout:64424509445 2024-09-15T20:47:18.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.461+0000 7ff89b59e640 1 -- 172.21.15.52:0/327742652 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff888073100 msgr2=0x7ff8880755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.461+0000 7ff89b59e640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff888073100 0x7ff8880755c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff884009a70 tx=0x7ff884009470 comp rx=0 tx=0).stop 2024-09-15T20:47:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.465+0000 7ff89b59e640 1 -- 172.21.15.52:0/327742652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff89c150cb0 msgr2=0x7ff89c14de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.465+0000 7ff89b59e640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff89c150cb0 0x7ff89c14de60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00cd50 tx=0x7ff88c00a650 comp rx=0 tx=0).stop 2024-09-15T20:47:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.465+0000 7ff89b59e640 1 -- 172.21.15.52:0/327742652 shutdown_connections 2024-09-15T20:47:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.465+0000 7ff89b59e640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff888073100 0x7ff8880755c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.465+0000 7ff89b59e640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff89c150cb0 0x7ff89c14de60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.465+0000 7ff89b59e640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff89c0b23b0 0x7ff89c1478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.465+0000 7ff89b59e640 1 --2- 172.21.15.52:0/327742652 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff89c0b1c30 0x7ff89c150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.465+0000 7ff89b59e640 1 -- 172.21.15.52:0/327742652 >> 172.21.15.52:0/327742652 conn(0x7ff89c0b2ac0 msgr2=0x7ff89c0b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.465+0000 7ff89b59e640 1 -- 172.21.15.52:0/327742652 shutdown_connections 2024-09-15T20:47:18.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.465+0000 7ff89b59e640 1 -- 172.21.15.52:0/327742652 wait complete. 2024-09-15T20:47:18.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.465+0000 7f576152f640 1 -- 172.21.15.52:0/1013252935 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5754030fa0 con 0x7f5744005220 2024-09-15T20:47:18.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.469+0000 7f5758ff9640 1 -- 172.21.15.52:0/1013252935 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f574c005480 con 0x7f5744005220 2024-09-15T20:47:18.472 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2024-09-15T20:47:18.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7f576152f640 1 -- 172.21.15.52:0/1013252935 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5748072ec0 msgr2=0x7f5748075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7f576152f640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5748072ec0 0x7f5748075380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5754030590 tx=0x7f5750008040 comp rx=0 tx=0).stop 2024-09-15T20:47:18.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7f576152f640 1 -- 172.21.15.52:0/1013252935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 msgr2=0x7f5754030050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.476 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7f576152f640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 0x7f5754030050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f574c00f7f0 tx=0x7f574c00fcb0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7febce25e640 1 -- 172.21.15.52:0/490131568 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7febc00c1ac0 con 0x7febc002f180 2024-09-15T20:47:18.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7f576152f640 1 -- 172.21.15.52:0/1013252935 shutdown_connections 2024-09-15T20:47:18.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7febb3fff640 1 -- 172.21.15.52:0/490131568 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7febbc062020 con 0x7febc002f180 2024-09-15T20:47:18.477 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7f576152f640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5748072ec0 0x7f5748075380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7f576152f640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f575402daf0 0x7f57540c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7f576152f640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575402c740 0x7f575402ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.478 INFO:teuthology.orchestra.run.smithi052.stdout:60129542149 2024-09-15T20:47:18.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7f576152f640 1 --2- 172.21.15.52:0/1013252935 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5744005220 0x7f5754030050 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7f576152f640 1 -- 172.21.15.52:0/1013252935 >> 172.21.15.52:0/1013252935 conn(0x7f5754005dd0 msgr2=0x7f57540c48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7f576152f640 1 -- 172.21.15.52:0/1013252935 shutdown_connections 2024-09-15T20:47:18.479 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.473+0000 7f576152f640 1 -- 172.21.15.52:0/1013252935 wait complete. 2024-09-15T20:47:18.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-15T20:47:18.480 DEBUG:teuthology.parallel:result is None 2024-09-15T20:47:18.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7febce25e640 1 -- 172.21.15.52:0/490131568 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7febac072ec0 msgr2=0x7febac075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7febce25e640 1 --2- 172.21.15.52:0/490131568 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7febac072ec0 0x7febac075380 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7febb4009990 tx=0x7febb4008040 comp rx=0 tx=0).stop 2024-09-15T20:47:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7febce25e640 1 -- 172.21.15.52:0/490131568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc002f180 msgr2=0x7febc00c1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7febce25e640 1 --2- 172.21.15.52:0/490131568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc002f180 0x7febc00c1580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7febc00347e0 tx=0x7febbc011c20 comp rx=0 tx=0).stop 2024-09-15T20:47:18.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7f5692b11640 1 -- 172.21.15.52:0/60788147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5684009610 con 0x7f5684036f00 2024-09-15T20:47:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7febce25e640 1 -- 172.21.15.52:0/490131568 shutdown_connections 2024-09-15T20:47:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7febce25e640 1 --2- 172.21.15.52:0/490131568 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7febac072ec0 0x7febac075380 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7febce25e640 1 --2- 172.21.15.52:0/490131568 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7febc002f180 0x7febc00c1580 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7febce25e640 1 --2- 172.21.15.52:0/490131568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7febc002ed20 0x7febc00c1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7febce25e640 1 --2- 172.21.15.52:0/490131568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febc0154210 0x7febc00c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7febce25e640 1 -- 172.21.15.52:0/490131568 >> 172.21.15.52:0/490131568 conn(0x7febc0005da0 msgr2=0x7febc00c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7febce25e640 1 -- 172.21.15.52:0/490131568 shutdown_connections 2024-09-15T20:47:18.482 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7febce25e640 1 -- 172.21.15.52:0/490131568 wait complete. 2024-09-15T20:47:18.483 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.477+0000 7f56827fc640 1 -- 172.21.15.52:0/60788147 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f568c0db250 con 0x7f5684036f00 2024-09-15T20:47:18.483 INFO:teuthology.orchestra.run.smithi052.stdout:60129542148 2024-09-15T20:47:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.481+0000 7f5692b11640 1 -- 172.21.15.52:0/60788147 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5670072f90 msgr2=0x7f5670075450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.481+0000 7f5692b11640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5670072f90 0x7f5670075450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5688007fd0 tx=0x7f5688009040 comp rx=0 tx=0).stop 2024-09-15T20:47:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.481+0000 7f5692b11640 1 -- 172.21.15.52:0/60788147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5684036f00 msgr2=0x7f56840b8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.481+0000 7f5692b11640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5684036f00 0x7f56840b8630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f568c075cb0 tx=0x7f568c069db0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.481+0000 7f5692b11640 1 -- 172.21.15.52:0/60788147 shutdown_connections 2024-09-15T20:47:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.481+0000 7f5692b11640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5670072f90 0x7f5670075450 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.481+0000 7f5692b11640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5684036f00 0x7f56840b8630 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.481+0000 7f5692b11640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5684032b90 0x7f5684166db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.481+0000 7f5692b11640 1 --2- 172.21.15.52:0/60788147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5684032230 0x7f5684006950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.481+0000 7f5692b11640 1 -- 172.21.15.52:0/60788147 >> 172.21.15.52:0/60788147 conn(0x7f568403a110 msgr2=0x7f56840055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.481+0000 7f5692b11640 1 -- 172.21.15.52:0/60788147 shutdown_connections 2024-09-15T20:47:18.485 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.481+0000 7f5692b11640 1 -- 172.21.15.52:0/60788147 wait complete. 2024-09-15T20:47:18.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-15T20:47:18.488 DEBUG:teuthology.parallel:result is None 2024-09-15T20:47:18.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-09-15T20:47:18.490 DEBUG:teuthology.parallel:result is None 2024-09-15T20:47:18.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.7 2024-09-15T20:47:18.497 DEBUG:teuthology.parallel:result is None 2024-09-15T20:47:18.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.3 2024-09-15T20:47:18.506 DEBUG:teuthology.parallel:result is None 2024-09-15T20:47:18.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-15T20:47:18.509 DEBUG:teuthology.parallel:result is None 2024-09-15T20:47:18.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-09-15T20:47:18.511 DEBUG:teuthology.parallel:result is None 2024-09-15T20:47:18.511 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T20:47:18.511 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T20:47:18.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.657+0000 7fbea1509640 1 Processor -- start 2024-09-15T20:47:18.661 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.657+0000 7fbea1509640 1 -- start start 2024-09-15T20:47:18.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbea1509640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe9c070900 0x7fbe9c070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbea1509640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe9c071750 con 0x7fbe9c0b2630 2024-09-15T20:47:18.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbea1509640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe9c071a30 con 0x7fbe9c150170 2024-09-15T20:47:18.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbea1509640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fbe9c0b2a10 con 0x7fbe9c070900 2024-09-15T20:47:18.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbe9a7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe9c070900 0x7fbe9c070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbe9affd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbe9c0b2630 0x7fbe9c146e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47466/0 (socket says 172.21.15.52:47466) 2024-09-15T20:47:18.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbe9a7fc640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbe9c070900 0x7fbe9c070d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45744/0 (socket says 172.21.15.52:45744) 2024-09-15T20:47:18.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbe9affd640 1 -- 172.21.15.52:0/1769146814 learned_addr learned my addr 172.21.15.52:0/1769146814 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:18.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbe9a7fc640 1 -- 172.21.15.52:0/1769146814 >> v1:172.21.15.81:6789/0 conn(0x7fbe9c150170 legacy=0x7fbe9c152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbe9a7fc640 1 -- 172.21.15.52:0/1769146814 >> v1:172.21.15.52:6789/0 conn(0x7fbe9c0b2630 legacy=0x7fbe9c146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbe9a7fc640 1 -- 172.21.15.52:0/1769146814 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c0703a0 con 0x7fbe9c070900 2024-09-15T20:47:18.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbe9a7fc640 1 --2- 172.21.15.52:0/1769146814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9c070900 0x7fbe9c070d60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009d90 tx=0x7fbe8401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb820ae79f41549 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbe99ffb640 1 -- 172.21.15.52:0/1769146814 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe840b2070 con 0x7fbe9c070900 2024-09-15T20:47:18.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbe99ffb640 1 -- 172.21.15.52:0/1769146814 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe840a5890 con 0x7fbe9c070900 2024-09-15T20:47:18.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbe99ffb640 1 -- 172.21.15.52:0/1769146814 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe840a5c60 con 0x7fbe9c070900 2024-09-15T20:47:18.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbea1509640 1 -- 172.21.15.52:0/1769146814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9c070900 msgr2=0x7fbe9c070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbea1509640 1 --2- 172.21.15.52:0/1769146814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9c070900 0x7fbe9c070d60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009d90 tx=0x7fbe8401c8c0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbea1509640 1 -- 172.21.15.52:0/1769146814 shutdown_connections 2024-09-15T20:47:18.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbea1509640 1 --2- 172.21.15.52:0/1769146814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9c070900 0x7fbe9c070d60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbea1509640 1 -- 172.21.15.52:0/1769146814 >> 172.21.15.52:0/1769146814 conn(0x7fbe9c0b57c0 msgr2=0x7fbe9c0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbea1509640 1 -- 172.21.15.52:0/1769146814 shutdown_connections 2024-09-15T20:47:18.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.661+0000 7fbea1509640 1 -- 172.21.15.52:0/1769146814 wait complete. 2024-09-15T20:47:18.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbea1509640 1 Processor -- start 2024-09-15T20:47:18.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbea1509640 1 -- start start 2024-09-15T20:47:18.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbea1509640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe9c070900 0x7fbe9c14e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbea1509640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbe9c0b2630 0x7fbe9c14f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbea1509640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9c150170 0x7fbe9c0aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbea1509640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c147a30 con 0x7fbe9c150170 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbea1509640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c1478b0 con 0x7fbe9c070900 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbea1509640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9c1564a0 con 0x7fbe9c0b2630 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9c150170 0x7fbe9c0aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9a7fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbe9c0b2630 0x7fbe9c14f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9c150170 0x7fbe9c0aa4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45750/0 (socket says 172.21.15.52:45750) 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9a7fc640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbe9c0b2630 0x7fbe9c14f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:45080/0 (socket says 172.21.15.52:45080) 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9b7fe640 1 -- 172.21.15.52:0/4062128269 learned_addr learned my addr 172.21.15.52:0/4062128269 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9affd640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe9c070900 0x7fbe9c14e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9b7fe640 1 -- 172.21.15.52:0/4062128269 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbe9c0b2630 msgr2=0x7fbe9c14f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9b7fe640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbe9c0b2630 0x7fbe9c14f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.669 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9b7fe640 1 -- 172.21.15.52:0/4062128269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe9c070900 msgr2=0x7fbe9c14e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9b7fe640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe9c070900 0x7fbe9c14e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9b7fe640 1 -- 172.21.15.52:0/4062128269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c0ab7b0 con 0x7fbe9c150170 2024-09-15T20:47:18.670 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9a7fc640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbe9c0b2630 0x7fbe9c14f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:18.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe9b7fe640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9c150170 0x7fbe9c0aa4e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00b410 tx=0x7fbe8c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe937fe640 1 -- 172.21.15.52:0/4062128269 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c015020 con 0x7fbe9c150170 2024-09-15T20:47:18.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe937fe640 1 -- 172.21.15.52:0/4062128269 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8c011830 con 0x7fbe9c150170 2024-09-15T20:47:18.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbea1509640 1 -- 172.21.15.52:0/4062128269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9c0abd70 con 0x7fbe9c150170 2024-09-15T20:47:18.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe937fe640 1 -- 172.21.15.52:0/4062128269 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c011c20 con 0x7fbe9c150170 2024-09-15T20:47:18.671 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbea1509640 1 -- 172.21.15.52:0/4062128269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9c14fba0 con 0x7fbe9c150170 2024-09-15T20:47:18.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbea1509640 1 -- 172.21.15.52:0/4062128269 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe9c070d60 con 0x7fbe9c150170 2024-09-15T20:47:18.672 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe937fe640 1 -- 172.21.15.52:0/4062128269 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fbe8c018020 con 0x7fbe9c150170 2024-09-15T20:47:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.665+0000 7fbe937fe640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fbe7c072ec0 0x7fbe7c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.669+0000 7fbe937fe640 1 -- 172.21.15.52:0/4062128269 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7fbe8c093830 con 0x7fbe9c150170 2024-09-15T20:47:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.669+0000 7fbe9affd640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fbe7c072ec0 0x7fbe7c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.669+0000 7fbe9affd640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fbe7c072ec0 0x7fbe7c075380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbe94007fd0 tx=0x7fbe94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.673 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.669+0000 7fbe937fe640 1 -- 172.21.15.52:0/4062128269 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fbe8c01f020 con 0x7fbe9c150170 2024-09-15T20:47:18.834 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.829+0000 7fbea1509640 1 -- 172.21.15.52:0/4062128269 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe9c069770 con 0x7fbe7c072ec0 2024-09-15T20:47:18.836 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.833+0000 7fbe937fe640 1 -- 172.21.15.52:0/4062128269 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+35857 (secure 0 0 0) 0x7fbe9c069770 con 0x7fbe7c072ec0 2024-09-15T20:47:18.837 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:47:18.837 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-15T20:47:18.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.837+0000 7fbea1509640 1 -- 172.21.15.52:0/4062128269 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fbe7c072ec0 msgr2=0x7fbe7c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.837+0000 7fbea1509640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fbe7c072ec0 0x7fbe7c075380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbe94007fd0 tx=0x7fbe94009040 comp rx=0 tx=0).stop 2024-09-15T20:47:18.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.837+0000 7fbea1509640 1 -- 172.21.15.52:0/4062128269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9c150170 msgr2=0x7fbe9c0aa4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.837+0000 7fbea1509640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9c150170 0x7fbe9c0aa4e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00b410 tx=0x7fbe8c00b8d0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.837+0000 7fbea1509640 1 -- 172.21.15.52:0/4062128269 shutdown_connections 2024-09-15T20:47:18.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.837+0000 7fbea1509640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fbe7c072ec0 0x7fbe7c075380 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.837+0000 7fbea1509640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbe9c150170 0x7fbe9c0aa4e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.837+0000 7fbea1509640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fbe9c0b2630 0x7fbe9c14f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.837+0000 7fbea1509640 1 --2- 172.21.15.52:0/4062128269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe9c070900 0x7fbe9c14e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.839 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.837+0000 7fbea1509640 1 -- 172.21.15.52:0/4062128269 >> 172.21.15.52:0/4062128269 conn(0x7fbe9c0b57c0 msgr2=0x7fbe9c0744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.837+0000 7fbea1509640 1 -- 172.21.15.52:0/4062128269 shutdown_connections 2024-09-15T20:47:18.840 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.837+0000 7fbea1509640 1 -- 172.21.15.52:0/4062128269 wait complete. 2024-09-15T20:47:18.855 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-15T20:47:17.214884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227352,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747368,"statfs":{"total":773094113280,"available":772861304832,"internally_reserved":0,"allocated":2842624,"data_stored":1664182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.769946"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.474109+0000","last_change":"2024-09-15T20:47:14.474673+0000","last_active":"2024-09-15T20:47:14.474109+0000","last_peered":"2024-09-15T20:47:14.474109+0000","last_clean":"2024-09-15T20:47:14.474109+0000","last_became_active":"2024-09-15T20:47:12.471373+0000","last_became_peered":"2024-09-15T20:47:12.471373+0000","last_unstale":"2024-09-15T20:47:14.474109+0000","last_undegraded":"2024-09-15T20:47:14.474109+0000","last_fullsized":"2024-09-15T20:47:14.474109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:47.666907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018866289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.472305+0000","last_change":"2024-09-15T20:47:14.472821+0000","last_active":"2024-09-15T20:47:14.472305+0000","last_peered":"2024-09-15T20:47:14.472305+0000","last_clean":"2024-09-15T20:47:14.472305+0000","last_became_active":"2024-09-15T20:47:12.468530+0000","last_became_peered":"2024-09-15T20:47:12.468530+0000","last_unstale":"2024-09-15T20:47:14.472305+0000","last_undegraded":"2024-09-15T20:47:14.472305+0000","last_fullsized":"2024-09-15T20:47:14.472305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:33.831606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000891339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.474345+0000","last_change":"2024-09-15T20:47:14.475000+0000","last_active":"2024-09-15T20:47:14.474345+0000","last_peered":"2024-09-15T20:47:14.474345+0000","last_clean":"2024-09-15T20:47:14.474345+0000","last_became_active":"2024-09-15T20:47:12.461531+0000","last_became_peered":"2024-09-15T20:47:12.461531+0000","last_unstale":"2024-09-15T20:47:14.474345+0000","last_undegraded":"2024-09-15T20:47:14.474345+0000","last_fullsized":"2024-09-15T20:47:14.474345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:28.018623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022230399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.985764+0000","last_change":"2024-09-15T20:47:14.986335+0000","last_active":"2024-09-15T20:47:14.985764+0000","last_peered":"2024-09-15T20:47:14.985764+0000","last_clean":"2024-09-15T20:47:14.985764+0000","last_became_active":"2024-09-15T20:47:12.468184+0000","last_became_peered":"2024-09-15T20:47:12.468184+0000","last_unstale":"2024-09-15T20:47:14.985764+0000","last_undegraded":"2024-09-15T20:47:14.985764+0000","last_fullsized":"2024-09-15T20:47:14.985764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:30.408559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001176739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.474210+0000","last_change":"2024-09-15T20:47:14.474210+0000","last_active":"2024-09-15T20:47:14.474210+0000","last_peered":"2024-09-15T20:47:14.474210+0000","last_clean":"2024-09-15T20:47:14.474210+0000","last_became_active":"2024-09-15T20:47:12.471091+0000","last_became_peered":"2024-09-15T20:47:12.471091+0000","last_unstale":"2024-09-15T20:47:14.474210+0000","last_undegraded":"2024-09-15T20:47:14.474210+0000","last_fullsized":"2024-09-15T20:47:14.474210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:42.228249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530579999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.986963+0000","last_change":"2024-09-15T20:47:14.986963+0000","last_active":"2024-09-15T20:47:14.986963+0000","last_peered":"2024-09-15T20:47:14.986963+0000","last_clean":"2024-09-15T20:47:14.986963+0000","last_became_active":"2024-09-15T20:47:12.462360+0000","last_became_peered":"2024-09-15T20:47:12.462360+0000","last_unstale":"2024-09-15T20:47:14.986963+0000","last_undegraded":"2024-09-15T20:47:14.986963+0000","last_fullsized":"2024-09-15T20:47:14.986963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:39.175611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011324970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.473407+0000","last_change":"2024-09-15T20:47:14.473959+0000","last_active":"2024-09-15T20:47:14.473407+0000","last_peered":"2024-09-15T20:47:14.473407+0000","last_clean":"2024-09-15T20:47:14.473407+0000","last_became_active":"2024-09-15T20:47:12.463812+0000","last_became_peered":"2024-09-15T20:47:12.463812+0000","last_unstale":"2024-09-15T20:47:14.473407+0000","last_undegraded":"2024-09-15T20:47:14.473407+0000","last_fullsized":"2024-09-15T20:47:14.473407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:19.954840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001226357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.474808+0000","last_change":"2024-09-15T20:47:14.475335+0000","last_active":"2024-09-15T20:47:14.474808+0000","last_peered":"2024-09-15T20:47:14.474808+0000","last_clean":"2024-09-15T20:47:14.474808+0000","last_became_active":"2024-09-15T20:47:12.469021+0000","last_became_peered":"2024-09-15T20:47:12.469021+0000","last_unstale":"2024-09-15T20:47:14.474808+0000","last_undegraded":"2024-09-15T20:47:14.474808+0000","last_fullsized":"2024-09-15T20:47:14.474808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:19.117864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025466540000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.471844+0000","last_change":"2024-09-15T20:47:07.291789+0000","last_active":"2024-09-15T20:47:14.471844+0000","last_peered":"2024-09-15T20:47:14.471844+0000","last_clean":"2024-09-15T20:47:14.471844+0000","last_became_active":"2024-09-15T20:47:07.289970+0000","last_became_peered":"2024-09-15T20:47:07.289970+0000","last_unstale":"2024-09-15T20:47:14.471844+0000","last_undegraded":"2024-09-15T20:47:14.471844+0000","last_fullsized":"2024-09-15T20:47:14.471844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:05.400631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:05.400631+0000","last_clean_scrub_stamp":"2024-09-15T20:47:05.400631+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:27.776984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":753664,"data_stored":604714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":75786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":604714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":75786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T20:47:18.856 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T20:47:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.961+0000 7f0d21c37640 1 Processor -- start 2024-09-15T20:47:18.965 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.961+0000 7f0d21c37640 1 -- start start 2024-09-15T20:47:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d1c0b2630 0x7f0d1c070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d1c145300 0x7f0d1c13ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d1c145730 con 0x7f0d1c13e630 2024-09-15T20:47:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0d1c0b2a10 con 0x7f0d1c0b2630 2024-09-15T20:47:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f0d1c141290 con 0x7f0d1c145300 2024-09-15T20:47:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1bfff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d1c145300 0x7f0d1c13ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1affd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0d1c13e630 0x7f0d1c144bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47468/0 (socket says 172.21.15.52:47468) 2024-09-15T20:47:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1affd640 1 -- 172.21.15.52:0/868240363 learned_addr learned my addr 172.21.15.52:0/868240363 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1b7fe640 1 --2- 172.21.15.52:0/868240363 >> v2:172.21.15.81:3300/0 conn(0x7f0d1c0b2630 0x7f0d1c070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1a7fc640 1 -- 172.21.15.52:0/868240363 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656728114 0 0) 0x7f0d0c001120 con 0x7f0d1c13e630 2024-09-15T20:47:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1bfff640 1 -- 172.21.15.52:0/868240363 >> v2:172.21.15.81:3300/0 conn(0x7f0d1c0b2630 msgr2=0x7f0d1c070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1bfff640 1 --2- 172.21.15.52:0/868240363 >> v2:172.21.15.81:3300/0 conn(0x7f0d1c0b2630 0x7f0d1c070900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1bfff640 1 -- 172.21.15.52:0/868240363 >> v1:172.21.15.52:6789/0 conn(0x7f0d1c13e630 legacy=0x7f0d1c144bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1bfff640 1 -- 172.21.15.52:0/868240363 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1c074fe0 con 0x7f0d1c145300 2024-09-15T20:47:18.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1b7fe640 1 --2- 172.21.15.52:0/868240363 >> v2:172.21.15.81:3300/0 conn(0x7f0d1c0b2630 0x7f0d1c070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:47:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1bfff640 1 --2- 172.21.15.52:0/868240363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d1c145300 0x7f0d1c13ea60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0d140097c0 tx=0x7f0d1401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa9c73e960b3f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1a7fc640 1 -- 172.21.15.52:0/868240363 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140b0070 con 0x7f0d1c145300 2024-09-15T20:47:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1a7fc640 1 -- 172.21.15.52:0/868240363 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d140ab600 con 0x7f0d1c145300 2024-09-15T20:47:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d1a7fc640 1 -- 172.21.15.52:0/868240363 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140ab9d0 con 0x7f0d1c145300 2024-09-15T20:47:18.969 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 -- 172.21.15.52:0/868240363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d1c145300 msgr2=0x7f0d1c13ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 --2- 172.21.15.52:0/868240363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d1c145300 0x7f0d1c13ea60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0d140097c0 tx=0x7f0d1401c3f0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 -- 172.21.15.52:0/868240363 shutdown_connections 2024-09-15T20:47:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 --2- 172.21.15.52:0/868240363 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d1c145300 0x7f0d1c13ea60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 --2- 172.21.15.52:0/868240363 >> v2:172.21.15.81:3300/0 conn(0x7f0d1c0b2630 0x7f0d1c070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 -- 172.21.15.52:0/868240363 >> 172.21.15.52:0/868240363 conn(0x7f0d1c0b57c0 msgr2=0x7f0d1c0b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:18.970 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 -- 172.21.15.52:0/868240363 shutdown_connections 2024-09-15T20:47:18.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.965+0000 7f0d21c37640 1 -- 172.21.15.52:0/868240363 wait complete. 2024-09-15T20:47:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d21c37640 1 Processor -- start 2024-09-15T20:47:18.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d21c37640 1 -- start start 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d21c37640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d1c0b2630 0x7f0d1c135c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d21c37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c13e630 0x7f0d1c143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d21c37640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d1c145300 0x7f0d1c13da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d21c37640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1c14e750 con 0x7f0d1c0b2630 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d21c37640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1c14e5d0 con 0x7f0d1c13e630 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d21c37640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f0d1c14e8d0 con 0x7f0d1c145300 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d1c0b2630 0x7f0d1c135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d1bfff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d1c145300 0x7f0d1c13da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d1b7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d1c0b2630 0x7f0d1c135c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45758/0 (socket says 172.21.15.52:45758) 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d1b7fe640 1 -- 172.21.15.52:0/1489743070 learned_addr learned my addr 172.21.15.52:0/1489743070 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d1bfff640 1 -- 172.21.15.52:0/1489743070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c13e630 msgr2=0x7f0d1c143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d1affd640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c13e630 0x7f0d1c143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d1bfff640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c13e630 0x7f0d1c143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.973 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d1bfff640 1 -- 172.21.15.52:0/1489743070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d1c0b2630 msgr2=0x7f0d1c135c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d1bfff640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d1c0b2630 0x7f0d1c135c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d1bfff640 1 -- 172.21.15.52:0/1489743070 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1c13c750 con 0x7f0d1c145300 2024-09-15T20:47:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d1b7fe640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d1c0b2630 0x7f0d1c135c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d1bfff640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d1c145300 0x7f0d1c13da60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0d140ab000 tx=0x7f0d14019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d13fff640 1 -- 172.21.15.52:0/1489743070 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140ba070 con 0x7f0d1c145300 2024-09-15T20:47:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d13fff640 1 -- 172.21.15.52:0/1489743070 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d140b5670 con 0x7f0d1c145300 2024-09-15T20:47:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d21c37640 1 -- 172.21.15.52:0/1489743070 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d1c13c9c0 con 0x7f0d1c145300 2024-09-15T20:47:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d13fff640 1 -- 172.21.15.52:0/1489743070 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140b0040 con 0x7f0d1c145300 2024-09-15T20:47:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d21c37640 1 -- 172.21.15.52:0/1489743070 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d1c13cf80 con 0x7f0d1c145300 2024-09-15T20:47:18.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d21c37640 1 -- 172.21.15.52:0/1489743070 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d1c070900 con 0x7f0d1c145300 2024-09-15T20:47:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.969+0000 7f0d13fff640 1 -- 172.21.15.52:0/1489743070 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f0d140b3070 con 0x7f0d1c145300 2024-09-15T20:47:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.973+0000 7f0d13fff640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0cfc072ef0 0x7f0cfc0753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.973+0000 7f0d13fff640 1 -- 172.21.15.52:0/1489743070 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f0d1412e180 con 0x7f0d1c145300 2024-09-15T20:47:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.973+0000 7f0d1b7fe640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0cfc072ef0 0x7f0cfc0753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:18.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.973+0000 7f0d1b7fe640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0cfc072ef0 0x7f0cfc0753b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400d9e0 tx=0x7f0d040078d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:18.977 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:18.973+0000 7f0d13fff640 1 -- 172.21.15.52:0/1489743070 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f0d14016070 con 0x7f0d1c145300 2024-09-15T20:47:19.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.137+0000 7f0d21c37640 1 -- 172.21.15.52:0/1489743070 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d1c0b1300 con 0x7f0cfc072ef0 2024-09-15T20:47:19.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d13fff640 1 -- 172.21.15.52:0/1489743070 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+35857 (secure 0 0 0) 0x7f0d1c0b1300 con 0x7f0cfc072ef0 2024-09-15T20:47:19.142 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:47:19.142 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-15T20:47:19.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d21c37640 1 -- 172.21.15.52:0/1489743070 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0cfc072ef0 msgr2=0x7f0cfc0753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:19.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d21c37640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0cfc072ef0 0x7f0cfc0753b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400d9e0 tx=0x7f0d040078d0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.144 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d21c37640 1 -- 172.21.15.52:0/1489743070 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d1c145300 msgr2=0x7f0d1c13da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d21c37640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d1c145300 0x7f0d1c13da60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0d140ab000 tx=0x7f0d14019190 comp rx=0 tx=0).stop 2024-09-15T20:47:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d21c37640 1 -- 172.21.15.52:0/1489743070 shutdown_connections 2024-09-15T20:47:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d21c37640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0cfc072ef0 0x7f0cfc0753b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d21c37640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0d1c145300 0x7f0d1c13da60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d21c37640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d1c13e630 0x7f0d1c143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d21c37640 1 --2- 172.21.15.52:0/1489743070 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d1c0b2630 0x7f0d1c135c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d21c37640 1 -- 172.21.15.52:0/1489743070 >> 172.21.15.52:0/1489743070 conn(0x7f0d1c0b57c0 msgr2=0x7f0d1c073730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d21c37640 1 -- 172.21.15.52:0/1489743070 shutdown_connections 2024-09-15T20:47:19.145 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.141+0000 7f0d21c37640 1 -- 172.21.15.52:0/1489743070 wait complete. 2024-09-15T20:47:19.161 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-15T20:47:17.214884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227352,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747368,"statfs":{"total":773094113280,"available":772861304832,"internally_reserved":0,"allocated":2842624,"data_stored":1664182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.769946"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.474109+0000","last_change":"2024-09-15T20:47:14.474673+0000","last_active":"2024-09-15T20:47:14.474109+0000","last_peered":"2024-09-15T20:47:14.474109+0000","last_clean":"2024-09-15T20:47:14.474109+0000","last_became_active":"2024-09-15T20:47:12.471373+0000","last_became_peered":"2024-09-15T20:47:12.471373+0000","last_unstale":"2024-09-15T20:47:14.474109+0000","last_undegraded":"2024-09-15T20:47:14.474109+0000","last_fullsized":"2024-09-15T20:47:14.474109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:47.666907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018866289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.472305+0000","last_change":"2024-09-15T20:47:14.472821+0000","last_active":"2024-09-15T20:47:14.472305+0000","last_peered":"2024-09-15T20:47:14.472305+0000","last_clean":"2024-09-15T20:47:14.472305+0000","last_became_active":"2024-09-15T20:47:12.468530+0000","last_became_peered":"2024-09-15T20:47:12.468530+0000","last_unstale":"2024-09-15T20:47:14.472305+0000","last_undegraded":"2024-09-15T20:47:14.472305+0000","last_fullsized":"2024-09-15T20:47:14.472305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:33.831606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000891339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.474345+0000","last_change":"2024-09-15T20:47:14.475000+0000","last_active":"2024-09-15T20:47:14.474345+0000","last_peered":"2024-09-15T20:47:14.474345+0000","last_clean":"2024-09-15T20:47:14.474345+0000","last_became_active":"2024-09-15T20:47:12.461531+0000","last_became_peered":"2024-09-15T20:47:12.461531+0000","last_unstale":"2024-09-15T20:47:14.474345+0000","last_undegraded":"2024-09-15T20:47:14.474345+0000","last_fullsized":"2024-09-15T20:47:14.474345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:28.018623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022230399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.985764+0000","last_change":"2024-09-15T20:47:14.986335+0000","last_active":"2024-09-15T20:47:14.985764+0000","last_peered":"2024-09-15T20:47:14.985764+0000","last_clean":"2024-09-15T20:47:14.985764+0000","last_became_active":"2024-09-15T20:47:12.468184+0000","last_became_peered":"2024-09-15T20:47:12.468184+0000","last_unstale":"2024-09-15T20:47:14.985764+0000","last_undegraded":"2024-09-15T20:47:14.985764+0000","last_fullsized":"2024-09-15T20:47:14.985764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:30.408559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001176739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.474210+0000","last_change":"2024-09-15T20:47:14.474210+0000","last_active":"2024-09-15T20:47:14.474210+0000","last_peered":"2024-09-15T20:47:14.474210+0000","last_clean":"2024-09-15T20:47:14.474210+0000","last_became_active":"2024-09-15T20:47:12.471091+0000","last_became_peered":"2024-09-15T20:47:12.471091+0000","last_unstale":"2024-09-15T20:47:14.474210+0000","last_undegraded":"2024-09-15T20:47:14.474210+0000","last_fullsized":"2024-09-15T20:47:14.474210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:42.228249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530579999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.986963+0000","last_change":"2024-09-15T20:47:14.986963+0000","last_active":"2024-09-15T20:47:14.986963+0000","last_peered":"2024-09-15T20:47:14.986963+0000","last_clean":"2024-09-15T20:47:14.986963+0000","last_became_active":"2024-09-15T20:47:12.462360+0000","last_became_peered":"2024-09-15T20:47:12.462360+0000","last_unstale":"2024-09-15T20:47:14.986963+0000","last_undegraded":"2024-09-15T20:47:14.986963+0000","last_fullsized":"2024-09-15T20:47:14.986963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:39.175611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011324970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.473407+0000","last_change":"2024-09-15T20:47:14.473959+0000","last_active":"2024-09-15T20:47:14.473407+0000","last_peered":"2024-09-15T20:47:14.473407+0000","last_clean":"2024-09-15T20:47:14.473407+0000","last_became_active":"2024-09-15T20:47:12.463812+0000","last_became_peered":"2024-09-15T20:47:12.463812+0000","last_unstale":"2024-09-15T20:47:14.473407+0000","last_undegraded":"2024-09-15T20:47:14.473407+0000","last_fullsized":"2024-09-15T20:47:14.473407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:19.954840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001226357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.474808+0000","last_change":"2024-09-15T20:47:14.475335+0000","last_active":"2024-09-15T20:47:14.474808+0000","last_peered":"2024-09-15T20:47:14.474808+0000","last_clean":"2024-09-15T20:47:14.474808+0000","last_became_active":"2024-09-15T20:47:12.469021+0000","last_became_peered":"2024-09-15T20:47:12.469021+0000","last_unstale":"2024-09-15T20:47:14.474808+0000","last_undegraded":"2024-09-15T20:47:14.474808+0000","last_fullsized":"2024-09-15T20:47:14.474808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:19.117864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025466540000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T20:47:14.471844+0000","last_change":"2024-09-15T20:47:07.291789+0000","last_active":"2024-09-15T20:47:14.471844+0000","last_peered":"2024-09-15T20:47:14.471844+0000","last_clean":"2024-09-15T20:47:14.471844+0000","last_became_active":"2024-09-15T20:47:07.289970+0000","last_became_peered":"2024-09-15T20:47:07.289970+0000","last_unstale":"2024-09-15T20:47:14.471844+0000","last_undegraded":"2024-09-15T20:47:14.471844+0000","last_fullsized":"2024-09-15T20:47:14.471844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:05.400631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:05.400631+0000","last_clean_scrub_stamp":"2024-09-15T20:47:05.400631+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:27.776984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":753664,"data_stored":604714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":221184,"data_stored":75786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":604714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":75786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T20:47:19.162 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T20:47:19.162 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T20:47:19.162 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T20:47:19.162 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T20:47:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.281+0000 7fc6baa57640 1 Processor -- start 2024-09-15T20:47:19.285 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.281+0000 7fc6baa57640 1 -- start start 2024-09-15T20:47:19.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6baa57640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc6b40746b0 0x7fc6b4072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:19.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6baa57640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b4074d40 con 0x7fc6b40b2630 2024-09-15T20:47:19.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6baa57640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b4072660 con 0x7fc6b4072fd0 2024-09-15T20:47:19.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6baa57640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b4074b20 con 0x7fc6b40746b0 2024-09-15T20:47:19.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6b8ff4640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc6b40746b0 0x7fc6b4072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:19.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6b3fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc6b40b2630 0x7fc6b4136720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:47476/0 (socket says 172.21.15.52:47476) 2024-09-15T20:47:19.286 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6b3fff640 1 -- 172.21.15.52:0/551663531 learned_addr learned my addr 172.21.15.52:0/551663531 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6b37fe640 1 -- 172.21.15.52:0/551663531 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229353872 0 0) 0x7fc6b4074d40 con 0x7fc6b40b2630 2024-09-15T20:47:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6b37fe640 1 -- 172.21.15.52:0/551663531 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6a0003530 con 0x7fc6b40b2630 2024-09-15T20:47:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6b8ff4640 1 -- 172.21.15.52:0/551663531 >> v1:172.21.15.81:6789/0 conn(0x7fc6b4072fd0 legacy=0x7fc6b4071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6b8ff4640 1 -- 172.21.15.52:0/551663531 >> v1:172.21.15.52:6789/0 conn(0x7fc6b40b2630 legacy=0x7fc6b4136720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6b8ff4640 1 -- 172.21.15.52:0/551663531 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b413dc60 con 0x7fc6b40746b0 2024-09-15T20:47:19.289 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6b8ff4640 1 --2- 172.21.15.52:0/551663531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b40746b0 0x7fc6b4072120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009d90 tx=0x7fc6ac01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5568f87767b3efd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6b37fe640 1 -- 172.21.15.52:0/551663531 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0b2070 con 0x7fc6b40746b0 2024-09-15T20:47:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6b37fe640 1 -- 172.21.15.52:0/551663531 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6ac0a5890 con 0x7fc6b40746b0 2024-09-15T20:47:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6b37fe640 1 -- 172.21.15.52:0/551663531 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ac0a5c40 con 0x7fc6b40746b0 2024-09-15T20:47:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6baa57640 1 -- 172.21.15.52:0/551663531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b40746b0 msgr2=0x7fc6b4072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6baa57640 1 --2- 172.21.15.52:0/551663531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b40746b0 0x7fc6b4072120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac009d90 tx=0x7fc6ac01c8c0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6baa57640 1 -- 172.21.15.52:0/551663531 shutdown_connections 2024-09-15T20:47:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6baa57640 1 --2- 172.21.15.52:0/551663531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b40746b0 0x7fc6b4072120 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.285+0000 7fc6baa57640 1 -- 172.21.15.52:0/551663531 >> 172.21.15.52:0/551663531 conn(0x7fc6b40b57c0 msgr2=0x7fc6b40b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 -- 172.21.15.52:0/551663531 shutdown_connections 2024-09-15T20:47:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 -- 172.21.15.52:0/551663531 wait complete. 2024-09-15T20:47:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 Processor -- start 2024-09-15T20:47:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 -- start start 2024-09-15T20:47:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b40746b0 0x7fc6b4139010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:19.292 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6b40b2630 0x7fc6b413a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b413ac20 0x7fc6b41335f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b4070730 con 0x7fc6b413ac20 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b40705b0 con 0x7fc6b40746b0 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b40708b0 con 0x7fc6b40b2630 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6b8ff4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b413ac20 0x7fc6b41335f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6abfff640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6b40b2630 0x7fc6b413a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6b8ff4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b413ac20 0x7fc6b41335f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:45768/0 (socket says 172.21.15.52:45768) 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6b8ff4640 1 -- 172.21.15.52:0/610007342 learned_addr learned my addr 172.21.15.52:0/610007342 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6abfff640 1 -- 172.21.15.52:0/610007342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b40746b0 msgr2=0x7fc6b4139010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6b3fff640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b40746b0 0x7fc6b4139010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6abfff640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b40746b0 0x7fc6b4139010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6abfff640 1 -- 172.21.15.52:0/610007342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b413ac20 msgr2=0x7fc6b41335f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:19.293 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6abfff640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b413ac20 0x7fc6b41335f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6abfff640 1 -- 172.21.15.52:0/610007342 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b4141c70 con 0x7fc6b40b2630 2024-09-15T20:47:19.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6b8ff4640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b413ac20 0x7fc6b41335f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:19.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6abfff640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6b40b2630 0x7fc6b413a6e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00c410 tx=0x7fc69c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:19.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6b17fa640 1 -- 172.21.15.52:0/610007342 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c017070 con 0x7fc6b40b2630 2024-09-15T20:47:19.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6b17fa640 1 -- 172.21.15.52:0/610007342 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69c0069e0 con 0x7fc6b40b2630 2024-09-15T20:47:19.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 -- 172.21.15.52:0/610007342 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b413b160 con 0x7fc6b40b2630 2024-09-15T20:47:19.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6b17fa640 1 -- 172.21.15.52:0/610007342 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c006e10 con 0x7fc6b40b2630 2024-09-15T20:47:19.294 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 -- 172.21.15.52:0/610007342 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b4133e10 con 0x7fc6b40b2630 2024-09-15T20:47:19.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6baa57640 1 -- 172.21.15.52:0/610007342 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b4136720 con 0x7fc6b40b2630 2024-09-15T20:47:19.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.289+0000 7fc6b17fa640 1 -- 172.21.15.52:0/610007342 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fc69c01a070 con 0x7fc6b40b2630 2024-09-15T20:47:19.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.293+0000 7fc6b17fa640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fc694072ec0 0x7fc694075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:19.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.293+0000 7fc6b17fa640 1 -- 172.21.15.52:0/610007342 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7fc69c092c90 con 0x7fc6b40b2630 2024-09-15T20:47:19.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.293+0000 7fc6b3fff640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fc694072ec0 0x7fc694075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:19.295 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.293+0000 7fc6b3fff640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fc694072ec0 0x7fc694075380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4007fd0 tx=0x7fc6a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:19.298 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.297+0000 7fc6b17fa640 1 -- 172.21.15.52:0/610007342 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fc69c05dad0 con 0x7fc6b40b2630 2024-09-15T20:47:19.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.497+0000 7fc6baa57640 1 -- 172.21.15.52:0/610007342 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc6b413b330 con 0x7fc6b40b2630 2024-09-15T20:47:19.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.497+0000 7fc6b17fa640 1 -- 172.21.15.52:0/610007342 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc69c062500 con 0x7fc6b40b2630 2024-09-15T20:47:19.502 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:47:19.502 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T20:47:19.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.501+0000 7fc6baa57640 1 -- 172.21.15.52:0/610007342 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fc694072ec0 msgr2=0x7fc694075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:19.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.501+0000 7fc6baa57640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fc694072ec0 0x7fc694075380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4007fd0 tx=0x7fc6a4009040 comp rx=0 tx=0).stop 2024-09-15T20:47:19.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.501+0000 7fc6baa57640 1 -- 172.21.15.52:0/610007342 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6b40b2630 msgr2=0x7fc6b413a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:19.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.501+0000 7fc6baa57640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6b40b2630 0x7fc6b413a6e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00c410 tx=0x7fc69c00c8d0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.501+0000 7fc6baa57640 1 -- 172.21.15.52:0/610007342 shutdown_connections 2024-09-15T20:47:19.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.501+0000 7fc6baa57640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fc694072ec0 0x7fc694075380 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.501+0000 7fc6baa57640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc6b413ac20 0x7fc6b41335f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.501+0000 7fc6baa57640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc6b40b2630 0x7fc6b413a6e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.501+0000 7fc6baa57640 1 --2- 172.21.15.52:0/610007342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b40746b0 0x7fc6b4139010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.501+0000 7fc6baa57640 1 -- 172.21.15.52:0/610007342 >> 172.21.15.52:0/610007342 conn(0x7fc6b40b57c0 msgr2=0x7fc6b414af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:19.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.501+0000 7fc6baa57640 1 -- 172.21.15.52:0/610007342 shutdown_connections 2024-09-15T20:47:19.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.501+0000 7fc6baa57640 1 -- 172.21.15.52:0/610007342 wait complete. 2024-09-15T20:47:19.520 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T20:47:19.520 INFO:teuthology.run_tasks:Running task exec... 2024-09-15T20:47:19.532 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T20:47:19.534 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:47:19.534 DEBUG:teuthology.orchestra.run.smithi052:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd pool create cephsqlite' 2024-09-15T20:47:19.653 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.649+0000 7f5924c65640 1 Processor -- start 2024-09-15T20:47:19.654 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.649+0000 7f5924c65640 1 -- start start 2024-09-15T20:47:19.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f5924c65640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f592006e720 0x7f592006f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:19.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f5924c65640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 0x7f5920148650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:19.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f5924c65640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5920072d80 con 0x7f5920073760 2024-09-15T20:47:19.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f5924c65640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f592006f9d0 con 0x7f592006e720 2024-09-15T20:47:19.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f5924c65640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f592006eb00 con 0x7f5920073bd0 2024-09-15T20:47:19.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f591ed9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 0x7f5920148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:19.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f591ed9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 0x7f5920148650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:38498/0 (socket says 172.21.15.52:38498) 2024-09-15T20:47:19.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f591ed9d640 1 -- 172.21.15.52:0/347715280 learned_addr learned my addr 172.21.15.52:0/347715280 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:19.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f591e59c640 1 --2- 172.21.15.52:0/347715280 >> v2:172.21.15.81:3300/0 conn(0x7f592006e720 0x7f592006f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:19.655 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f591ed9d640 1 -- 172.21.15.52:0/347715280 >> v2:172.21.15.81:3300/0 conn(0x7f592006e720 msgr2=0x7f592006f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:19.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f591ed9d640 1 --2- 172.21.15.52:0/347715280 >> v2:172.21.15.81:3300/0 conn(0x7f592006e720 0x7f592006f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f591ed9d640 1 -- 172.21.15.52:0/347715280 >> v1:172.21.15.81:6789/0 conn(0x7f5920073760 legacy=0x7f5920147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:19.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f591ed9d640 1 -- 172.21.15.52:0/347715280 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5920073060 con 0x7f5920073bd0 2024-09-15T20:47:19.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f591ed9d640 1 --2- 172.21.15.52:0/347715280 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 0x7f5920148650 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5910009870 tx=0x7f591001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2e90725f60747b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:19.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f591d59a640 1 -- 172.21.15.52:0/347715280 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59100b1070 con 0x7f5920073bd0 2024-09-15T20:47:19.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f591d59a640 1 -- 172.21.15.52:0/347715280 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59100ac410 con 0x7f5920073bd0 2024-09-15T20:47:19.658 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.653+0000 7f591d59a640 1 -- 172.21.15.52:0/347715280 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59100ac7e0 con 0x7f5920073bd0 2024-09-15T20:47:19.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 -- 172.21.15.52:0/347715280 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 msgr2=0x7f5920148650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:19.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 --2- 172.21.15.52:0/347715280 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 0x7f5920148650 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5910009870 tx=0x7f591001c540 comp rx=0 tx=0).stop 2024-09-15T20:47:19.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 -- 172.21.15.52:0/347715280 shutdown_connections 2024-09-15T20:47:19.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 --2- 172.21.15.52:0/347715280 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 0x7f5920148650 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 --2- 172.21.15.52:0/347715280 >> v2:172.21.15.81:3300/0 conn(0x7f592006e720 0x7f592006f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 -- 172.21.15.52:0/347715280 >> 172.21.15.52:0/347715280 conn(0x7f59200b7630 msgr2=0x7f59200b7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:19.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 -- 172.21.15.52:0/347715280 shutdown_connections 2024-09-15T20:47:19.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 -- 172.21.15.52:0/347715280 wait complete. 2024-09-15T20:47:19.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 Processor -- start 2024-09-15T20:47:19.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 -- start start 2024-09-15T20:47:19.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f592006e720 0x7f59200b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:19.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5920073760 0x7f59200abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:19.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 0x7f59200ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:19.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5920154d50 con 0x7f5920073760 2024-09-15T20:47:19.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5920154bd0 con 0x7f592006e720 2024-09-15T20:47:19.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f5920154ed0 con 0x7f5920073bd0 2024-09-15T20:47:19.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591ed9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 0x7f59200ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:19.662 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5920073760 0x7f59200abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:19.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591dd9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5920073760 0x7f59200abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53594/0 (socket says 172.21.15.52:53594) 2024-09-15T20:47:19.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591ed9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 0x7f59200ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:38512/0 (socket says 172.21.15.52:38512) 2024-09-15T20:47:19.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591dd9b640 1 -- 172.21.15.52:0/4155371140 learned_addr learned my addr 172.21.15.52:0/4155371140 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:19.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591e59c640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f592006e720 0x7f59200b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:19.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591ed9d640 1 -- 172.21.15.52:0/4155371140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f592006e720 msgr2=0x7f59200b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:19.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591ed9d640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f592006e720 0x7f59200b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591ed9d640 1 -- 172.21.15.52:0/4155371140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5920073760 msgr2=0x7f59200abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:19.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591ed9d640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5920073760 0x7f59200abd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:19.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591ed9d640 1 -- 172.21.15.52:0/4155371140 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59200ac4a0 con 0x7f5920073bd0 2024-09-15T20:47:19.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591dd9b640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5920073760 0x7f59200abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:19.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591e59c640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f592006e720 0x7f59200b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:47:19.663 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f591ed9d640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 0x7f59200ac9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59100ac000 tx=0x7f59100192e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:19.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f590effd640 1 -- 172.21.15.52:0/4155371140 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59100b1040 con 0x7f5920073bd0 2024-09-15T20:47:19.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f590effd640 1 -- 172.21.15.52:0/4155371140 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59100bc070 con 0x7f5920073bd0 2024-09-15T20:47:19.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 -- 172.21.15.52:0/4155371140 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59200ae110 con 0x7f5920073bd0 2024-09-15T20:47:19.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f590effd640 1 -- 172.21.15.52:0/4155371140 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59100b7450 con 0x7f5920073bd0 2024-09-15T20:47:19.664 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.657+0000 7f5924c65640 1 -- 172.21.15.52:0/4155371140 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f59200aa430 con 0x7f5920073bd0 2024-09-15T20:47:19.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.661+0000 7f5924c65640 1 -- 172.21.15.52:0/4155371140 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f592006f490 con 0x7f5920073bd0 2024-09-15T20:47:19.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.661+0000 7f590effd640 1 -- 172.21.15.52:0/4155371140 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f59100b75f0 con 0x7f5920073bd0 2024-09-15T20:47:19.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.661+0000 7f590effd640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5900072ec0 0x7f5900075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:19.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.661+0000 7f590effd640 1 -- 172.21.15.52:0/4155371140 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5266+0+0 (secure 0 0 0) 0x7f591012dbf0 con 0x7f5920073bd0 2024-09-15T20:47:19.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.661+0000 7f591e59c640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5900072ec0 0x7f5900075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:19.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.661+0000 7f591e59c640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5900072ec0 0x7f5900075380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5918007330 tx=0x7f591800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:19.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.665+0000 7f590effd640 1 -- 172.21.15.52:0/4155371140 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f5910016130 con 0x7f5920073bd0 2024-09-15T20:47:19.833 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:19.829+0000 7f5924c65640 1 -- 172.21.15.52:0/4155371140 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephsqlite"} v 0) -- 0x7f592006a130 con 0x7f5920073bd0 2024-09-15T20:47:20.550 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.545+0000 7f590effd640 1 -- 172.21.15.52:0/4155371140 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephsqlite"}]=0 pool 'cephsqlite' created v23) ==== 110+0+0 (secure 0 0 0) 0x7f59100f8ff0 con 0x7f5920073bd0 2024-09-15T20:47:20.550 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephsqlite' created 2024-09-15T20:47:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.557+0000 7f5924c65640 1 -- 172.21.15.52:0/4155371140 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5900072ec0 msgr2=0x7f5900075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.557+0000 7f5924c65640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5900072ec0 0x7f5900075380 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5918007330 tx=0x7f591800b040 comp rx=0 tx=0).stop 2024-09-15T20:47:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.557+0000 7f5924c65640 1 -- 172.21.15.52:0/4155371140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 msgr2=0x7f59200ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.557+0000 7f5924c65640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 0x7f59200ac9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59100ac000 tx=0x7f59100192e0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.557+0000 7f5924c65640 1 -- 172.21.15.52:0/4155371140 shutdown_connections 2024-09-15T20:47:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.557+0000 7f5924c65640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5900072ec0 0x7f5900075380 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.557+0000 7f5924c65640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5920073bd0 0x7f59200ac9d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.557+0000 7f5924c65640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5920073760 0x7f59200abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.561 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.557+0000 7f5924c65640 1 --2- 172.21.15.52:0/4155371140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f592006e720 0x7f59200b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.557+0000 7f5924c65640 1 -- 172.21.15.52:0/4155371140 >> 172.21.15.52:0/4155371140 conn(0x7f59200b7630 msgr2=0x7f59200b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.557+0000 7f5924c65640 1 -- 172.21.15.52:0/4155371140 shutdown_connections 2024-09-15T20:47:20.562 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.557+0000 7f5924c65640 1 -- 172.21.15.52:0/4155371140 wait complete. 2024-09-15T20:47:20.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph auth get-or-create client.libcephsqlite mon '"'"'profile simple-rados-client-with-blocklist'"'"' osd '"'"'allow rwx pool=cephsqlite'"'"' >> /etc/ceph/ceph.keyring' 2024-09-15T20:47:20.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eb532a640 1 Processor -- start 2024-09-15T20:47:20.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eb532a640 1 -- start start 2024-09-15T20:47:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eb532a640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5eb0141280 0x7f5eb00aee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eb532a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5eb013e670 0x7f5eb013eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eb532a640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb00aa5d0 con 0x7f5eb00b24e0 2024-09-15T20:47:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eb532a640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5eb00b28c0 con 0x7f5eb0141280 2024-09-15T20:47:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eb532a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5eb01455d0 con 0x7f5eb013e670 2024-09-15T20:47:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eaeffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5eb00b24e0 0x7f5eb0144ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:55428/0 (socket says 172.21.15.52:55428) 2024-09-15T20:47:20.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eaeffd640 1 -- 172.21.15.52:0/1320523683 learned_addr learned my addr 172.21.15.52:0/1320523683 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:47:20.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eae7fc640 1 --2- 172.21.15.52:0/1320523683 >> v2:172.21.15.52:3300/0 conn(0x7f5eb0141280 0x7f5eb00aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:20.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eadffb640 1 -- 172.21.15.52:0/1320523683 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324888017 0 0) 0x7f5ea0001120 con 0x7f5eb00b24e0 2024-09-15T20:47:20.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eaf7fe640 1 --2- 172.21.15.52:0/1320523683 >> v2:172.21.15.81:3300/0 conn(0x7f5eb013e670 0x7f5eb013eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:20.725 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eadffb640 1 -- 172.21.15.52:0/1320523683 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e98003530 con 0x7f5eb00b24e0 2024-09-15T20:47:20.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eae7fc640 1 -- 172.21.15.52:0/1320523683 >> v2:172.21.15.81:3300/0 conn(0x7f5eb013e670 msgr2=0x7f5eb013eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:47:20.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eae7fc640 1 --2- 172.21.15.52:0/1320523683 >> v2:172.21.15.81:3300/0 conn(0x7f5eb013e670 0x7f5eb013eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eae7fc640 1 -- 172.21.15.52:0/1320523683 >> v1:172.21.15.52:6789/0 conn(0x7f5eb00b24e0 legacy=0x7f5eb0144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:20.726 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.721+0000 7f5eae7fc640 1 -- 172.21.15.52:0/1320523683 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb01449a0 con 0x7f5eb0141280 2024-09-15T20:47:20.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eae7fc640 1 --2- 172.21.15.52:0/1320523683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0141280 0x7f5eb00aee20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00705e0 tx=0x7f5ea401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2eb04133b29226 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eadffb640 1 -- 172.21.15.52:0/1320523683 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea40ab5f0 con 0x7f5eb0141280 2024-09-15T20:47:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eadffb640 1 -- 172.21.15.52:0/1320523683 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea40b0070 con 0x7f5eb0141280 2024-09-15T20:47:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eadffb640 1 -- 172.21.15.52:0/1320523683 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea40ab9b0 con 0x7f5eb0141280 2024-09-15T20:47:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 -- 172.21.15.52:0/1320523683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0141280 msgr2=0x7f5eb00aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 --2- 172.21.15.52:0/1320523683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0141280 0x7f5eb00aee20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00705e0 tx=0x7f5ea401c3d0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 -- 172.21.15.52:0/1320523683 shutdown_connections 2024-09-15T20:47:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 --2- 172.21.15.52:0/1320523683 >> v2:172.21.15.81:3300/0 conn(0x7f5eb013e670 0x7f5eb013eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 --2- 172.21.15.52:0/1320523683 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb0141280 0x7f5eb00aee20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 -- 172.21.15.52:0/1320523683 >> 172.21.15.52:0/1320523683 conn(0x7f5eb00b5670 msgr2=0x7f5eb00b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 -- 172.21.15.52:0/1320523683 shutdown_connections 2024-09-15T20:47:20.728 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 -- 172.21.15.52:0/1320523683 wait complete. 2024-09-15T20:47:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 Processor -- start 2024-09-15T20:47:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 -- start start 2024-09-15T20:47:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5eb00b24e0 0x7f5eb00ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb013e670 0x7f5eb0145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb0141280 0x7f5eb013b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb014e740 con 0x7f5eb013e670 2024-09-15T20:47:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb014e5c0 con 0x7f5eb0141280 2024-09-15T20:47:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eb532a640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb014e8c0 con 0x7f5eb00b24e0 2024-09-15T20:47:20.731 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eae7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb013e670 0x7f5eb0145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eaeffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5eb00b24e0 0x7f5eb00ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eaeffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5eb00b24e0 0x7f5eb00ae080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:38522/0 (socket says 172.21.15.52:38522) 2024-09-15T20:47:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eaeffd640 1 -- 172.21.15.52:0/914301890 learned_addr learned my addr 172.21.15.52:0/914301890 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:47:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eae7fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb013e670 0x7f5eb0145bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:53608/0 (socket says 172.21.15.52:53608) 2024-09-15T20:47:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eaf7fe640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb0141280 0x7f5eb013b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eaeffd640 1 -- 172.21.15.52:0/914301890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb0141280 msgr2=0x7f5eb013b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eaeffd640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb0141280 0x7f5eb013b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eaeffd640 1 -- 172.21.15.52:0/914301890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb013e670 msgr2=0x7f5eb0145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eaeffd640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb013e670 0x7f5eb0145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eaeffd640 1 -- 172.21.15.52:0/914301890 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb0147230 con 0x7f5eb00b24e0 2024-09-15T20:47:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eae7fc640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb013e670 0x7f5eb0145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:47:20.732 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.725+0000 7f5eaeffd640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5eb00b24e0 0x7f5eb00ae080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000c730 tx=0x7f5ea000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.729+0000 7f5e977fe640 1 -- 172.21.15.52:0/914301890 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0017070 con 0x7f5eb00b24e0 2024-09-15T20:47:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.729+0000 7f5e977fe640 1 -- 172.21.15.52:0/914301890 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ea0005ac0 con 0x7f5eb00b24e0 2024-09-15T20:47:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.729+0000 7f5eb532a640 1 -- 172.21.15.52:0/914301890 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb00ae680 con 0x7f5eb00b24e0 2024-09-15T20:47:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.729+0000 7f5e977fe640 1 -- 172.21.15.52:0/914301890 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0007070 con 0x7f5eb00b24e0 2024-09-15T20:47:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.729+0000 7f5eb532a640 1 -- 172.21.15.52:0/914301890 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb013b830 con 0x7f5eb00b24e0 2024-09-15T20:47:20.733 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.729+0000 7f5eb532a640 1 -- 172.21.15.52:0/914301890 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb013eb20 con 0x7f5eb00b24e0 2024-09-15T20:47:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.729+0000 7f5e977fe640 1 -- 172.21.15.52:0/914301890 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f5ea001a070 con 0x7f5eb00b24e0 2024-09-15T20:47:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.729+0000 7f5e977fe640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5e9c072ec0 0x7f5e9c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:47:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.729+0000 7f5e977fe640 1 -- 172.21.15.52:0/914301890 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5587+0+0 (secure 0 0 0) 0x7f5ea0092d40 con 0x7f5eb00b24e0 2024-09-15T20:47:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.729+0000 7f5eae7fc640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5e9c072ec0 0x7f5e9c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:47:20.734 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.729+0000 7f5eae7fc640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5e9c072ec0 0x7f5e9c075380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40af000 tx=0x7f5ea40a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:47:20.737 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.733+0000 7f5e977fe640 1 -- 172.21.15.52:0/914301890 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f5eb00aa5d0 con 0x7f5eb00b24e0 2024-09-15T20:47:20.963 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.961+0000 7f5eb532a640 1 -- 172.21.15.52:0/914301890 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.libcephsqlite", "caps": ["mon", "profile simple-rados-client-with-blocklist", "osd", "allow rwx pool=cephsqlite"]} v 0) -- 0x7f5eb0069140 con 0x7f5eb00b24e0 2024-09-15T20:47:20.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.969+0000 7f5e977fe640 1 -- 172.21.15.52:0/914301890 <== mon.2 v2:172.21.15.52:3301/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.libcephsqlite", "caps": ["mon", "profile simple-rados-client-with-blocklist", "osd", "allow rwx pool=cephsqlite"]}]=0 v7) ==== 199+0+71 (secure 0 0 0) 0x7f5ea005da40 con 0x7f5eb00b24e0 2024-09-15T20:47:20.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.973+0000 7f5eb532a640 1 -- 172.21.15.52:0/914301890 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5e9c072ec0 msgr2=0x7f5e9c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:20.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.973+0000 7f5eb532a640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5e9c072ec0 0x7f5e9c075380 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40af000 tx=0x7f5ea40a7000 comp rx=0 tx=0).stop 2024-09-15T20:47:20.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.973+0000 7f5eb532a640 1 -- 172.21.15.52:0/914301890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5eb00b24e0 msgr2=0x7f5eb00ae080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:47:20.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.973+0000 7f5eb532a640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5eb00b24e0 0x7f5eb00ae080 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000c730 tx=0x7f5ea000cbf0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.973+0000 7f5eb532a640 1 -- 172.21.15.52:0/914301890 shutdown_connections 2024-09-15T20:47:20.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.973+0000 7f5eb532a640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5e9c072ec0 0x7f5e9c075380 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.973+0000 7f5eb532a640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eb0141280 0x7f5eb013b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.973+0000 7f5eb532a640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5eb013e670 0x7f5eb0145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.973+0000 7f5eb532a640 1 --2- 172.21.15.52:0/914301890 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5eb00b24e0 0x7f5eb00ae080 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:47:20.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.973+0000 7f5eb532a640 1 -- 172.21.15.52:0/914301890 >> 172.21.15.52:0/914301890 conn(0x7f5eb00b5670 msgr2=0x7f5eb013f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:47:20.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.973+0000 7f5eb532a640 1 -- 172.21.15.52:0/914301890 shutdown_connections 2024-09-15T20:47:20.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:47:20.973+0000 7f5eb532a640 1 -- 172.21.15.52:0/914301890 wait complete. 2024-09-15T20:47:20.990 INFO:teuthology.run_tasks:Running task exec... 2024-09-15T20:47:20.999 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T20:47:21.000 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:47:21.000 DEBUG:teuthology.orchestra.run.smithi052:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr' 2024-09-15T20:47:21.040 INFO:teuthology.orchestra.run.smithi052.stdout:[==========] Running 20 tests from 1 test suite. 2024-09-15T20:47:21.041 INFO:teuthology.orchestra.run.smithi052.stdout:[----------] Global test environment set-up. 2024-09-15T20:47:21.041 INFO:teuthology.orchestra.run.smithi052.stdout:[----------] 20 tests from CephSQLiteTest 2024-09-15T20:47:26.048 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.Create 2024-09-15T20:47:26.065 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/ff305c1c-e188-4f4d-bd74-b1d87bbded60.db?vfs=ceph 2024-09-15T20:47:26.065 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:26.075 INFO:teuthology.orchestra.run.smithi052.stdout:CREATE TABLE foo (a INT); 2024-09-15T20:47:26.105 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.Create (57 ms) 2024-09-15T20:47:26.105 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.InsertBulk4096 2024-09-15T20:47:26.120 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/30697e1f-f2c3-4aa2-aee0-bde938fd35c2.db?vfs=ceph 2024-09-15T20:47:26.121 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:26.132 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA page_size = 4096;CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOM() FROM c LIMIT 1000000;PRAGMA page_size; 2024-09-15T20:47:27.965 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.InsertBulk4096 (1861 ms) 2024-09-15T20:47:27.966 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.InsertBulk 2024-09-15T20:47:27.974 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/71e5d8cc-7069-4adb-b8b4-e7f1bb405fb3.db?vfs=ceph 2024-09-15T20:47:27.974 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:27.978 INFO:teuthology.orchestra.run.smithi052.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOM() FROM c LIMIT 1000000; 2024-09-15T20:47:28.540 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.InsertBulk (574 ms) 2024-09-15T20:47:28.540 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.UpdateBulk 2024-09-15T20:47:28.551 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/40f9b64b-240c-47c6-91ab-dbe6873fc6a3.db?vfs=ceph 2024-09-15T20:47:28.551 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:28.559 INFO:teuthology.orchestra.run.smithi052.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;SELECT SUM(a) FROM foo;UPDATE foo SET a = a+a;SELECT SUM(a) FROM foo; 2024-09-15T20:47:29.687 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.UpdateBulk (1147 ms) 2024-09-15T20:47:29.687 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.InsertRate 2024-09-15T20:47:29.699 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/ce58dabe-bdc7-4e56-9219-304156eea06a.db?vfs=ceph 2024-09-15T20:47:29.699 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:29.704 INFO:teuthology.orchestra.run.smithi052.stdout:CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2024-09-15T20:47:33.128 INFO:teuthology.orchestra.run.smithi052.stdout:transactions per second: 29.4467 2024-09-15T20:47:33.129 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.InsertRate (3442 ms) 2024-09-15T20:47:33.129 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.DatabaseShrink 2024-09-15T20:47:33.142 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/ddd82c57-601f-47be-b9cd-3cb7e5b5b5bf.db?vfs=ceph 2024-09-15T20:47:33.142 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:33.149 INFO:teuthology.orchestra.run.smithi052.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;DELETE FROM foo WHERE RANDOM()%4 < 3;VACUUM; 2024-09-15T20:47:34.710 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.DatabaseShrink (1582 ms) 2024-09-15T20:47:34.711 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveRate 2024-09-15T20:47:34.719 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/2f2704ad-2bf8-4256-908f-110b4bab38f3.db?vfs=ceph 2024-09-15T20:47:34.719 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:34.723 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA locking_mode=EXCLUSIVE;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2024-09-15T20:47:36.200 INFO:teuthology.orchestra.run.smithi052.stdout:transactions per second: 68.685 2024-09-15T20:47:36.205 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.InsertExclusiveRate (1494 ms) 2024-09-15T20:47:36.205 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveWALRate 2024-09-15T20:47:36.220 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/e5dc4dc6-e4fa-4331-a72a-983627741aa8.db?vfs=ceph 2024-09-15T20:47:36.220 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:36.229 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA locking_mode=EXCLUSIVE;PRAGMA journal_mode=WAL;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2024-09-15T20:47:36.830 INFO:teuthology.orchestra.run.smithi052.stdout:transactions per second: 183.834 2024-09-15T20:47:36.867 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.InsertExclusiveWALRate (662 ms) 2024-09-15T20:47:36.867 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.WALTransactionSync 2024-09-15T20:47:36.880 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/032658ac-92c1-478a-8741-23b8a5d0daca.db?vfs=ceph 2024-09-15T20:47:36.880 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:36.886 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA locking_mode=EXCLUSIVE;PRAGMA journal_mode=WAL;CREATE TABLE foo (a INT);INSERT INTO perf (v) VALUES (ceph_perf());BEGIN TRANSACTION;INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount'; 2024-09-15T20:47:36.966 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.WALTransactionSync (99 ms) 2024-09-15T20:47:36.966 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.PersistTransactionSync 2024-09-15T20:47:36.980 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/6686ae36-3592-4783-9d5d-b29e744101f4.db?vfs=ceph 2024-09-15T20:47:36.980 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:36.989 INFO:teuthology.orchestra.run.smithi052.stdout:BEGIN TRANSACTION;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount'; 2024-09-15T20:47:37.033 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.PersistTransactionSync (68 ms) 2024-09-15T20:47:37.034 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveLock 2024-09-15T20:47:37.046 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/e495b07b-2029-46c7-9a25-0cccee83ed2c.db?vfs=ceph 2024-09-15T20:47:37.046 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:37.054 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA locking_mode=EXCLUSIVE;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_lock.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_lock.avgcount';SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.lock' AND b.fullkey = '$.libcephsqlite_striper.lock'; 2024-09-15T20:47:37.087 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.InsertExclusiveLock (53 ms) 2024-09-15T20:47:37.087 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.TransactionSizeUpdate 2024-09-15T20:47:37.098 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/14698f79-586a-4d22-ba54-de4f6ea23144.db?vfs=ceph 2024-09-15T20:47:37.098 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:37.102 INFO:teuthology.orchestra.run.smithi052.stdout:BEGIN TRANSACTION;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.update_size' AND b.fullkey = '$.libcephsqlite_striper.update_size'; 2024-09-15T20:47:37.133 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.TransactionSizeUpdate (47 ms) 2024-09-15T20:47:37.133 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.AllocatedGrowth 2024-09-15T20:47:37.146 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/8da90341-b4cc-486f-9356-df3b6baffd0d.db?vfs=ceph 2024-09-15T20:47:37.146 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:37.155 INFO:teuthology.orchestra.run.smithi052.stdout:CREATE TABLE foo (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.update_allocated' AND b.fullkey = '$.libcephsqlite_striper.update_allocated'; 2024-09-15T20:47:44.855 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.AllocatedGrowth (7721 ms) 2024-09-15T20:47:44.855 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.DeleteBulk 2024-09-15T20:47:44.868 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/caf8bfd0-3d09-4e57-8e73-8e3545729681.db?vfs=ceph 2024-09-15T20:47:44.868 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:44.873 INFO:teuthology.orchestra.run.smithi052.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;DELETE FROM foo WHERE RANDOM()%2 == 0; 2024-09-15T20:47:45.845 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.DeleteBulk (990 ms) 2024-09-15T20:47:45.845 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.DropMassive 2024-09-15T20:47:45.855 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/acbf87b2-b72f-49a3-962e-c6f8c5228b86.db?vfs=ceph 2024-09-15T20:47:45.855 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:47:45.859 INFO:teuthology.orchestra.run.smithi052.stdout:CREATE TABLE foo (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;DROP TABLE foo;VACUUM;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.shrink' AND b.fullkey = '$.libcephsqlite_striper.shrink';SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.shrink_bytes' AND b.fullkey = '$.libcephsqlite_striper.shrink_bytes'; 2024-09-15T20:48:21.911 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.DropMassive (36064 ms) 2024-09-15T20:48:21.911 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.InsertMassiveVerify 2024-09-15T20:48:21.919 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/93fdfc53-1810-4d84-bef1-2a1117bc34e0.db?vfs=ceph 2024-09-15T20:48:21.919 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:48:21.924 INFO:teuthology.orchestra.run.smithi052.stdout:CREATE TABLE foo (a BLOB);CREATE TEMPORARY TABLE bar (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO bar (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;SELECT a FROM bar;INSERT INTO foo (a) SELECT a FROM bar;SELECT a FROM foo; 2024-09-15T20:48:36.124 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.InsertMassiveVerify (14214 ms) 2024-09-15T20:48:36.125 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.PerfValid 2024-09-15T20:48:36.138 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/fa9c13c2-8408-427f-8e78-d3a6dc589114.db?vfs=ceph 2024-09-15T20:48:36.138 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:48:36.149 INFO:teuthology.orchestra.run.smithi052.stdout:SELECT json_valid(ceph_perf()); 2024-09-15T20:48:36.149 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.PerfValid (26 ms) 2024-09-15T20:48:36.150 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.StatusValid 2024-09-15T20:48:36.161 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/ceae395f-cf90-4c7d-9a0d-bc51a3ec3e1d.db?vfs=ceph 2024-09-15T20:48:36.161 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:48:36.169 INFO:teuthology.orchestra.run.smithi052.stdout:SELECT json_valid(ceph_status()); 2024-09-15T20:48:36.169 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.StatusValid (19 ms) 2024-09-15T20:48:36.169 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.CurrentTime 2024-09-15T20:48:36.179 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/a7ad7c87-a3b6-4a44-87db-402946f3ace6.db?vfs=ceph 2024-09-15T20:48:36.179 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:48:36.184 INFO:teuthology.orchestra.run.smithi052.stdout:SELECT strftime('%s', 'now'); 2024-09-15T20:48:36.185 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.CurrentTime (16 ms) 2024-09-15T20:48:36.185 INFO:teuthology.orchestra.run.smithi052.stdout:[ RUN ] CephSQLiteTest.StatusFields 2024-09-15T20:48:36.198 INFO:teuthology.orchestra.run.smithi052.stdout:using database: file:cephsqlite:/85ac5054-8e90-44fc-91d6-a360a0241457.db?vfs=ceph 2024-09-15T20:48:36.198 INFO:teuthology.orchestra.run.smithi052.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-09-15T20:48:36.213 INFO:teuthology.orchestra.run.smithi052.stdout:SELECT json_extract(ceph_status(), '$.addr');SELECT json_extract(ceph_status(), '$.id'); 2024-09-15T20:48:36.214 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:0/2825338914 2024-09-15T20:48:36.214 INFO:teuthology.orchestra.run.smithi052.stdout:4443 2024-09-15T20:48:36.214 INFO:teuthology.orchestra.run.smithi052.stdout:[ OK ] CephSQLiteTest.StatusFields (28 ms) 2024-09-15T20:48:36.214 INFO:teuthology.orchestra.run.smithi052.stdout:[----------] 20 tests from CephSQLiteTest (70164 ms total) 2024-09-15T20:48:36.214 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:48:36.215 INFO:teuthology.orchestra.run.smithi052.stdout:[----------] Global test environment tear-down 2024-09-15T20:48:36.215 INFO:teuthology.orchestra.run.smithi052.stdout:[==========] 20 tests from 1 test suite ran. (75171 ms total) 2024-09-15T20:48:36.215 INFO:teuthology.orchestra.run.smithi052.stdout:[ PASSED ] 20 tests. 2024-09-15T20:48:36.254 INFO:teuthology.run_tasks:Running task workunit... 2024-09-15T20:48:36.273 INFO:tasks.workunit:Pulling workunits from ref 7498493279982dfe87f00616198a5967475f6169 2024-09-15T20:48:36.274 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-15T20:48:36.274 DEBUG:teuthology.orchestra.run.smithi052:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-15T20:48:36.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:48:36.300 INFO:teuthology.orchestra.run.smithi052.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-15T20:48:36.300 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-15T20:48:36.351 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-15T20:48:36.351 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-15T20:48:36.400 INFO:tasks.workunit:timeout=3h 2024-09-15T20:48:36.400 INFO:tasks.workunit:cleanup=True 2024-09-15T20:48:36.401 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7498493279982dfe87f00616198a5967475f6169 2024-09-15T20:48:36.453 INFO:tasks.workunit.client.0.smithi052.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-15T20:49:30.767 INFO:tasks.workunit.client.0.smithi052.stderr:Note: switching to '7498493279982dfe87f00616198a5967475f6169'. 2024-09-15T20:49:30.767 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-15T20:49:30.768 INFO:tasks.workunit.client.0.smithi052.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-15T20:49:30.768 INFO:tasks.workunit.client.0.smithi052.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-15T20:49:30.768 INFO:tasks.workunit.client.0.smithi052.stderr:state without impacting any branches by switching back to a branch. 2024-09-15T20:49:30.768 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-15T20:49:30.768 INFO:tasks.workunit.client.0.smithi052.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-15T20:49:30.768 INFO:tasks.workunit.client.0.smithi052.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-15T20:49:30.769 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-15T20:49:30.769 INFO:tasks.workunit.client.0.smithi052.stderr: git switch -c 2024-09-15T20:49:30.769 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-15T20:49:30.769 INFO:tasks.workunit.client.0.smithi052.stderr:Or undo this operation with: 2024-09-15T20:49:30.769 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-15T20:49:30.769 INFO:tasks.workunit.client.0.smithi052.stderr: git switch - 2024-09-15T20:49:30.770 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-15T20:49:30.770 INFO:tasks.workunit.client.0.smithi052.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-15T20:49:30.770 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-15T20:49:30.770 INFO:tasks.workunit.client.0.smithi052.stderr:HEAD is now at 74984932799 Merge pull request #59797 from zdover23/wip-doc-2024-09-15-install-install-storage-cluster 2024-09-15T20:49:30.771 DEBUG:teuthology.orchestra.run.smithi052:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-15T20:49:30.817 INFO:tasks.workunit.client.0.smithi052.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-15T20:49:30.821 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T20:49:30.821 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-15T20:49:31.556 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-15T20:49:31.657 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-15T20:49:31.710 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T20:49:31.712 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T20:49:31.712 INFO:tasks.workunit.client.0.smithi052.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-15T20:49:31.758 INFO:tasks.workunit.client.0.smithi052.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T20:49:31.763 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-15T20:49:31.763 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-15T20:49:31.812 INFO:tasks.workunit:Running workunits matching rados/test_libcephsqlite.sh on client.0... 2024-09-15T20:49:31.813 INFO:tasks.workunit:Running workunit rados/test_libcephsqlite.sh... 2024-09-15T20:49:31.814 DEBUG:teuthology.orchestra.run.smithi052:workunit test rados/test_libcephsqlite.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7498493279982dfe87f00616198a5967475f6169 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CEPH_ARGS='--id libcephsqlite --no-log-to-stderr' adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh cephsqlite 2024-09-15T20:49:31.864 INFO:tasks.workunit.client.0.smithi052.stderr:+ pool=cephsqlite 2024-09-15T20:49:31.864 INFO:tasks.workunit.client.0.smithi052.stderr:++ basename /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh 2024-09-15T20:49:31.865 INFO:tasks.workunit.client.0.smithi052.stderr:+ ns=test_libcephsqlite.sh 2024-09-15T20:49:31.865 INFO:tasks.workunit.client.0.smithi052.stderr:+ striper rm baz.db 2024-09-15T20:49:31.865 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-09-15T20:49:31.924 INFO:tasks.workunit.client.0.smithi052.stderr:+ sqlite 2024-09-15T20:49:31.924 INFO:tasks.workunit.client.0.smithi052.stderr:+ background= 2024-09-15T20:49:31.924 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' '' = b ']' 2024-09-15T20:49:31.924 INFO:tasks.workunit.client.0.smithi052.stderr:++ cat 2024-09-15T20:49:31.924 INFO:tasks.workunit.client.0.smithi052.stderr:+ a='create table if not exists foo (a INT); 2024-09-15T20:49:31.924 INFO:tasks.workunit.client.0.smithi052.stderr:insert into foo (a) values (RANDOM()); 2024-09-15T20:49:31.924 INFO:tasks.workunit.client.0.smithi052.stderr:drop table foo;' 2024-09-15T20:49:31.924 INFO:tasks.workunit.client.0.smithi052.stderr:+ printf %s 'create table if not exists foo (a INT); 2024-09-15T20:49:31.924 INFO:tasks.workunit.client.0.smithi052.stderr:insert into foo (a) values (RANDOM()); 2024-09-15T20:49:31.925 INFO:tasks.workunit.client.0.smithi052.stderr:drop table foo;' 2024-09-15T20:49:31.925 INFO:tasks.workunit.client.0.smithi052.stderr:create table if not exists foo (a INT); 2024-09-15T20:49:31.925 INFO:tasks.workunit.client.0.smithi052.stderr:insert into foo (a) values (RANDOM()); 2024-09-15T20:49:31.925 INFO:tasks.workunit.client.0.smithi052.stderr:drop table foo;+ '[' '' '!=' b ']' 2024-09-15T20:49:31.925 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 2024-09-15T20:49:31.925 INFO:tasks.workunit.client.0.smithi052.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-15T20:49:32.224 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-15T20:49:32.225 INFO:tasks.workunit.client.0.smithi052.stderr:real 0m0.302s 2024-09-15T20:49:32.225 INFO:tasks.workunit.client.0.smithi052.stderr:user 0m0.043s 2024-09-15T20:49:32.225 INFO:tasks.workunit.client.0.smithi052.stderr:sys 0m0.033s 2024-09-15T20:49:32.225 INFO:tasks.workunit.client.0.smithi052.stderr:+ striper stat baz.db 2024-09-15T20:49:32.225 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper stat baz.db 2024-09-15T20:49:32.262 INFO:tasks.workunit.client.0.smithi052.stdout:cephsqlite/baz.db mtime 2024-09-15T20:49:32.000000+0000, size 8192 2024-09-15T20:49:32.265 INFO:tasks.workunit.client.0.smithi052.stderr:+ striper rm baz.db 2024-09-15T20:49:32.266 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-09-15T20:49:32.316 INFO:tasks.workunit.client.0.smithi052.stderr:+ sqlite 2024-09-15T20:49:32.316 INFO:tasks.workunit.client.0.smithi052.stderr:++ repeat 10 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:32.316 INFO:tasks.workunit.client.0.smithi052.stderr:++ n=10 2024-09-15T20:49:32.316 INFO:tasks.workunit.client.0.smithi052.stderr:++ shift 2024-09-15T20:49:32.316 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i = 0 )) 2024-09-15T20:49:32.316 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 10 )) 2024-09-15T20:49:32.316 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:32.316 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:32.316 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 10 )) 2024-09-15T20:49:32.316 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 10 )) 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 10 )) 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 10 )) 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 10 )) 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:32.317 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 10 )) 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 10 )) 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 10 )) 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 10 )) 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 10 )) 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:+ background= 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' '' = b ']' 2024-09-15T20:49:32.318 INFO:tasks.workunit.client.0.smithi052.stderr:++ cat 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:+ a='CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:SELECT LENGTH(text) FROM rand; 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:DROP TABLE rand;' 2024-09-15T20:49:32.319 INFO:tasks.workunit.client.0.smithi052.stderr:+ printf %s 'CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:SELECT LENGTH(text) FROM rand; 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:DROP TABLE rand;' 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-15T20:49:32.320 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:SELECT LENGTH(text) FROM rand; 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:DROP TABLE rand;+ '[' '' '!=' b ']' 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 2024-09-15T20:49:32.321 INFO:tasks.workunit.client.0.smithi052.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-15T20:49:33.330 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.330 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.330 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.330 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.330 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.330 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.330 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.331 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.331 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.331 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.522 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-15T20:49:33.523 INFO:tasks.workunit.client.0.smithi052.stderr:real 0m1.200s 2024-09-15T20:49:33.523 INFO:tasks.workunit.client.0.smithi052.stderr:user 0m0.132s 2024-09-15T20:49:33.523 INFO:tasks.workunit.client.0.smithi052.stderr:sys 0m0.049s 2024-09-15T20:49:33.523 INFO:tasks.workunit.client.0.smithi052.stderr:+ sqlite 2024-09-15T20:49:33.523 INFO:tasks.workunit.client.0.smithi052.stderr:++ repeat 100 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.523 INFO:tasks.workunit.client.0.smithi052.stderr:++ n=100 2024-09-15T20:49:33.523 INFO:tasks.workunit.client.0.smithi052.stderr:++ shift 2024-09-15T20:49:33.523 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i = 0 )) 2024-09-15T20:49:33.523 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.523 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.523 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.523 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.524 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.525 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.526 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.527 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.528 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.529 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.530 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.531 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.532 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.533 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.533 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.533 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.533 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.533 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.533 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.533 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.533 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.533 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.533 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.533 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.533 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.534 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.535 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.536 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.536 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.536 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.536 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.536 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.536 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.536 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.536 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.536 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.536 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.536 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.536 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.537 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.538 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.539 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.540 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.540 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.540 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.540 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.540 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.540 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.540 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.540 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.540 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.540 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.540 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.540 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.541 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.542 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.542 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.542 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.542 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.542 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.542 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.542 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.542 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.542 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.542 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.542 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.542 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.543 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.544 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.544 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.544 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.544 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.544 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.544 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.544 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.544 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.544 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.544 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.544 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.544 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.545 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( ++i )) 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:++ (( i < 100 )) 2024-09-15T20:49:33.546 INFO:tasks.workunit.client.0.smithi052.stderr:+ background= 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' '' = b ']' 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:++ cat 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:+ a='BEGIN TRANSACTION; 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.547 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.548 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.549 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.550 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.551 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.552 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.553 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:COMMIT; 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:SELECT LENGTH(text) FROM rand; 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:DROP TABLE rand;' 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:+ printf %s 'BEGIN TRANSACTION; 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-15T20:49:33.554 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.555 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.556 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.557 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.558 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.559 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.560 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.561 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.562 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.562 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.562 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.562 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.562 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.562 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.562 INFO:tasks.workunit.client.0.smithi052.stderr:COMMIT; 2024-09-15T20:49:33.562 INFO:tasks.workunit.client.0.smithi052.stderr:SELECT LENGTH(text) FROM rand; 2024-09-15T20:49:33.562 INFO:tasks.workunit.client.0.smithi052.stderr:DROP TABLE rand;' 2024-09-15T20:49:33.562 INFO:tasks.workunit.client.0.smithi052.stderr:BEGIN TRANSACTION; 2024-09-15T20:49:33.562 INFO:tasks.workunit.client.0.smithi052.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-09-15T20:49:33.562 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.563 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.564 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.565 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.566 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.567 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.568 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.569 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.570 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.570 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.570 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.570 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-09-15T20:49:33.570 INFO:tasks.workunit.client.0.smithi052.stderr:COMMIT; 2024-09-15T20:49:33.570 INFO:tasks.workunit.client.0.smithi052.stderr:SELECT LENGTH(text) FROM rand; 2024-09-15T20:49:33.570 INFO:tasks.workunit.client.0.smithi052.stderr:DROP TABLE rand;+ '[' '' '!=' b ']' 2024-09-15T20:49:33.570 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 2024-09-15T20:49:33.570 INFO:tasks.workunit.client.0.smithi052.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-15T20:49:33.921 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.921 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.921 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.921 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.921 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.921 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.921 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.921 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.921 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.921 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.921 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.921 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.922 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.923 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.924 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.924 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.924 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.924 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.924 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.924 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.924 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.924 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.925 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.926 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.927 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.927 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.927 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.927 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.927 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.927 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.927 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.927 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.927 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.927 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:33.928 INFO:tasks.workunit.client.0.smithi052.stdout:4096 2024-09-15T20:49:34.871 INFO:tasks.workunit.client.0.smithi052.stderr: 2024-09-15T20:49:34.872 INFO:tasks.workunit.client.0.smithi052.stderr:real 0m1.357s 2024-09-15T20:49:34.872 INFO:tasks.workunit.client.0.smithi052.stderr:user 0m0.134s 2024-09-15T20:49:34.872 INFO:tasks.workunit.client.0.smithi052.stderr:sys 0m0.070s 2024-09-15T20:49:34.872 INFO:tasks.workunit.client.0.smithi052.stderr:+ striper rm baz.db 2024-09-15T20:49:34.872 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-09-15T20:49:34.929 INFO:tasks.workunit.client.0.smithi052.stderr:+ date 2024-09-15T20:49:34.929 INFO:tasks.workunit.client.0.smithi052.stdout:Sun Sep 15 08:49:34 PM UTC 2024 2024-09-15T20:49:34.930 INFO:tasks.workunit.client.0.smithi052.stderr:+ sqlite b 2024-09-15T20:49:34.930 INFO:tasks.workunit.client.0.smithi052.stderr:+ background=b 2024-09-15T20:49:34.930 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' b = b ']' 2024-09-15T20:49:34.930 INFO:tasks.workunit.client.0.smithi052.stderr:+ shift 2024-09-15T20:49:34.930 INFO:tasks.workunit.client.0.smithi052.stderr:++ cat 2024-09-15T20:49:34.931 INFO:tasks.workunit.client.0.smithi052.stderr:+ a='CREATE TABLE foo (a BLOB); 2024-09-15T20:49:34.931 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO foo VALUES ("start"); 2024-09-15T20:49:34.931 INFO:tasks.workunit.client.0.smithi052.stderr:WITH RECURSIVE c(x) AS 2024-09-15T20:49:34.931 INFO:tasks.workunit.client.0.smithi052.stderr: ( 2024-09-15T20:49:34.931 INFO:tasks.workunit.client.0.smithi052.stderr: VALUES(1) 2024-09-15T20:49:34.931 INFO:tasks.workunit.client.0.smithi052.stderr: UNION ALL 2024-09-15T20:49:34.931 INFO:tasks.workunit.client.0.smithi052.stderr: SELECT x+1 2024-09-15T20:49:34.931 INFO:tasks.workunit.client.0.smithi052.stderr: FROM c 2024-09-15T20:49:34.931 INFO:tasks.workunit.client.0.smithi052.stderr: ) 2024-09-15T20:49:34.931 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO foo (a) 2024-09-15T20:49:34.931 INFO:tasks.workunit.client.0.smithi052.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr: FROM c 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr: LIMIT (1<<20);' 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr:+ printf %s 'CREATE TABLE foo (a BLOB); 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO foo VALUES ("start"); 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr:WITH RECURSIVE c(x) AS 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr: ( 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr: VALUES(1) 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr: UNION ALL 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr: SELECT x+1 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr: FROM c 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr: ) 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO foo (a) 2024-09-15T20:49:34.932 INFO:tasks.workunit.client.0.smithi052.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr: FROM c 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr: LIMIT (1<<20);' 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr:CREATE TABLE foo (a BLOB); 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO foo VALUES ("start"); 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr:WITH RECURSIVE c(x) AS 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr: ( 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr: VALUES(1) 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr: UNION ALL 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr: SELECT x+1 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr: FROM c 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr: ) 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO foo (a) 2024-09-15T20:49:34.933 INFO:tasks.workunit.client.0.smithi052.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-15T20:49:34.934 INFO:tasks.workunit.client.0.smithi052.stderr: FROM c 2024-09-15T20:49:34.934 INFO:tasks.workunit.client.0.smithi052.stderr: LIMIT (1<<20);+ '[' b '!=' b ']' 2024-09-15T20:49:34.934 INFO:tasks.workunit.client.0.smithi052.stderr:+ sleep 10 2024-09-15T20:49:34.934 INFO:tasks.workunit.client.0.smithi052.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-15T20:49:44.932 INFO:tasks.workunit.client.0.smithi052.stdout:done 2024-09-15T20:49:44.933 INFO:tasks.workunit.client.0.smithi052.stderr:+ echo done 2024-09-15T20:49:44.933 INFO:tasks.workunit.client.0.smithi052.stderr:+ jobs -l 2024-09-15T20:49:44.933 INFO:tasks.workunit.client.0.smithi052.stdout:[1]+ 31799 Running sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" & 2024-09-15T20:49:44.934 INFO:tasks.workunit.client.0.smithi052.stderr:++ jobs -p 2024-09-15T20:49:44.934 INFO:tasks.workunit.client.0.smithi052.stderr:+ kill -KILL -- 31799 2024-09-15T20:49:44.934 INFO:tasks.workunit.client.0.smithi052.stderr:+ date 2024-09-15T20:49:44.934 INFO:tasks.workunit.client.0.smithi052.stdout:Sun Sep 15 08:49:44 PM UTC 2024 2024-09-15T20:49:44.934 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 2024-09-15T20:49:44.935 INFO:tasks.workunit.client.0.smithi052.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh: line 95: 31799 Killed sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" 2024-09-15T20:49:44.935 INFO:tasks.workunit.client.0.smithi052.stderr:+ date 2024-09-15T20:49:44.935 INFO:tasks.workunit.client.0.smithi052.stdout:Sun Sep 15 08:49:44 PM UTC 2024 2024-09-15T20:49:44.936 INFO:tasks.workunit.client.0.smithi052.stderr:++ sqlite 2024-09-15T20:49:44.936 INFO:tasks.workunit.client.0.smithi052.stderr:++ background= 2024-09-15T20:49:44.936 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' = b ']' 2024-09-15T20:49:44.936 INFO:tasks.workunit.client.0.smithi052.stderr:+++ cat 2024-09-15T20:49:44.937 INFO:tasks.workunit.client.0.smithi052.stderr:++ a='SELECT COUNT(*) FROM foo;' 2024-09-15T20:49:44.937 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %s 'SELECT COUNT(*) FROM foo;' 2024-09-15T20:49:44.937 INFO:tasks.workunit.client.0.smithi052.stderr:SELECT COUNT(*) FROM foo;++ '[' '' '!=' b ']' 2024-09-15T20:49:44.937 INFO:tasks.workunit.client.0.smithi052.stderr:++ wait 2024-09-15T20:49:44.937 INFO:tasks.workunit.client.0.smithi052.stderr:++ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-15T20:50:14.700 INFO:tasks.workunit.client.0.smithi052.stderr:+ n=1 2024-09-15T20:50:14.700 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T20:50:14.700 INFO:tasks.workunit.client.0.smithi052.stderr:+ striper rm baz.db 2024-09-15T20:50:14.700 INFO:tasks.workunit.client.0.smithi052.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-09-15T20:50:14.761 INFO:tasks.workunit.client.0.smithi052.stderr:+ date 2024-09-15T20:50:14.762 INFO:tasks.workunit.client.0.smithi052.stdout:Sun Sep 15 08:50:14 PM UTC 2024 2024-09-15T20:50:14.762 INFO:tasks.workunit.client.0.smithi052.stderr:+ sqlite b 2024-09-15T20:50:14.763 INFO:tasks.workunit.client.0.smithi052.stderr:+ background=b 2024-09-15T20:50:14.763 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' b = b ']' 2024-09-15T20:50:14.763 INFO:tasks.workunit.client.0.smithi052.stderr:+ shift 2024-09-15T20:50:14.763 INFO:tasks.workunit.client.0.smithi052.stderr:++ cat 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr:+ a='CREATE TABLE foo (a BLOB); 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO foo VALUES ("start"); 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr:WITH RECURSIVE c(x) AS 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr: ( 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr: VALUES(1) 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr: UNION ALL 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr: SELECT x+1 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr: FROM c 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr: ) 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO foo (a) 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr: FROM c 2024-09-15T20:50:14.764 INFO:tasks.workunit.client.0.smithi052.stderr: LIMIT (1<<20);' 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr:+ printf %s 'CREATE TABLE foo (a BLOB); 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO foo VALUES ("start"); 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr:WITH RECURSIVE c(x) AS 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr: ( 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr: VALUES(1) 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr: UNION ALL 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr: SELECT x+1 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr: FROM c 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr: ) 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO foo (a) 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr: FROM c 2024-09-15T20:50:14.765 INFO:tasks.workunit.client.0.smithi052.stderr: LIMIT (1<<20);' 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr:CREATE TABLE foo (a BLOB); 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO foo VALUES ("start"); 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr:WITH RECURSIVE c(x) AS 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr: ( 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr: VALUES(1) 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr: UNION ALL 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr: SELECT x+1 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr: FROM c 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr: ) 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr:INSERT INTO foo (a) 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr: SELECT RANDOMBLOB(1<<20) 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr: FROM c 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr: LIMIT (1<<20);+ '[' b '!=' b ']' 2024-09-15T20:50:14.766 INFO:tasks.workunit.client.0.smithi052.stderr:+ sleep 20 2024-09-15T20:50:14.767 INFO:tasks.workunit.client.0.smithi052.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-15T20:50:34.765 INFO:tasks.workunit.client.0.smithi052.stdout:[1]+ 31867 Running sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" & 2024-09-15T20:50:34.766 INFO:tasks.workunit.client.0.smithi052.stderr:+ jobs -l 2024-09-15T20:50:34.766 INFO:tasks.workunit.client.0.smithi052.stderr:++ jobs -p 2024-09-15T20:50:34.766 INFO:tasks.workunit.client.0.smithi052.stderr:+ kill -STOP -- 31867 2024-09-15T20:50:34.766 INFO:tasks.workunit.client.0.smithi052.stderr:+ sleep 45 2024-09-15T20:51:19.768 INFO:tasks.workunit.client.0.smithi052.stderr:+ date 2024-09-15T20:51:19.769 INFO:tasks.workunit.client.0.smithi052.stdout:Sun Sep 15 08:51:19 PM UTC 2024 2024-09-15T20:51:19.769 INFO:tasks.workunit.client.0.smithi052.stderr:++ jobs -p 2024-09-15T20:51:19.769 INFO:tasks.workunit.client.0.smithi052.stderr:+ kill -CONT -- 31867 2024-09-15T20:51:19.769 INFO:tasks.workunit.client.0.smithi052.stderr:+ sleep 10 2024-09-15T20:51:19.796 INFO:tasks.workunit.client.0.smithi052.stderr:Error: near line 3: stepping, disk I/O error (10) 2024-09-15T20:51:29.771 INFO:tasks.workunit.client.0.smithi052.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh: line 129: 31867 Segmentation fault (core dumped) sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" 2024-09-15T20:51:29.772 INFO:tasks.workunit.client.0.smithi052.stderr:+ date 2024-09-15T20:51:29.773 INFO:tasks.workunit.client.0.smithi052.stdout:Sun Sep 15 08:51:29 PM UTC 2024 2024-09-15T20:51:29.773 INFO:tasks.workunit.client.0.smithi052.stderr:+ wait 2024-09-15T20:51:29.773 INFO:tasks.workunit.client.0.smithi052.stderr:+ date 2024-09-15T20:51:29.774 INFO:tasks.workunit.client.0.smithi052.stdout:Sun Sep 15 08:51:29 PM UTC 2024 2024-09-15T20:51:29.775 INFO:tasks.workunit.client.0.smithi052.stderr:++ sqlite 2024-09-15T20:51:29.775 INFO:tasks.workunit.client.0.smithi052.stderr:++ background= 2024-09-15T20:51:29.775 INFO:tasks.workunit.client.0.smithi052.stderr:++ '[' '' = b ']' 2024-09-15T20:51:29.776 INFO:tasks.workunit.client.0.smithi052.stderr:+++ cat 2024-09-15T20:51:29.777 INFO:tasks.workunit.client.0.smithi052.stderr:++ a='SELECT COUNT(*) FROM foo;' 2024-09-15T20:51:29.777 INFO:tasks.workunit.client.0.smithi052.stderr:++ printf %s 'SELECT COUNT(*) FROM foo;' 2024-09-15T20:51:29.777 INFO:tasks.workunit.client.0.smithi052.stderr:SELECT COUNT(*) FROM foo;++ '[' '' '!=' b ']' 2024-09-15T20:51:29.777 INFO:tasks.workunit.client.0.smithi052.stderr:++ wait 2024-09-15T20:51:29.778 INFO:tasks.workunit.client.0.smithi052.stderr:++ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-09-15T20:51:30.573 INFO:tasks.workunit.client.0.smithi052.stderr:+ n=1 2024-09-15T20:51:30.573 INFO:tasks.workunit.client.0.smithi052.stderr:+ '[' 1 -eq 1 ']' 2024-09-15T20:51:30.574 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T20:51:30.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T20:51:30.629 INFO:tasks.workunit:Stopping ['rados/test_libcephsqlite.sh cephsqlite'] on client.0... 2024-09-15T20:51:30.629 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-15T20:51:30.996 DEBUG:teuthology.parallel:result is None 2024-09-15T20:51:30.997 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T20:51:31.011 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T20:51:31.011 DEBUG:teuthology.orchestra.run.smithi052:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-15T20:51:31.064 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T20:51:31.065 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T20:51:31.076 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T20:51:31.076 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T20:51:31.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28bb75640 1 Processor -- start 2024-09-15T20:51:31.235 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28bb75640 1 -- start start 2024-09-15T20:51:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28bb75640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa2840708b0 0x7fa284136d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28bb75640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2840733d0 0x7fa284137240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28bb75640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa284143db0 0x7fa284144240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28bb75640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa284073e10 con 0x7fa2840708b0 2024-09-15T20:51:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28bb75640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa284073980 con 0x7fa2840733d0 2024-09-15T20:51:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28bb75640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fa284070c90 con 0x7fa284143db0 2024-09-15T20:51:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa289911640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa2840708b0 0x7fa284136d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28a112640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa284143db0 0x7fa284144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa289911640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa2840708b0 0x7fa284136d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32968/0 (socket says 172.21.15.52:32968) 2024-09-15T20:51:31.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa289911640 1 -- 172.21.15.52:0/918435965 learned_addr learned my addr 172.21.15.52:0/918435965 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa289110640 1 --2- 172.21.15.52:0/918435965 >> v2:172.21.15.81:3300/0 conn(0x7fa2840733d0 0x7fa284137240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28a112640 1 -- 172.21.15.52:0/918435965 >> v2:172.21.15.81:3300/0 conn(0x7fa2840733d0 msgr2=0x7fa284137240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28a112640 1 --2- 172.21.15.52:0/918435965 >> v2:172.21.15.81:3300/0 conn(0x7fa2840733d0 0x7fa284137240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28a112640 1 -- 172.21.15.52:0/918435965 >> v2:172.21.15.52:3300/0 conn(0x7fa2840708b0 msgr2=0x7fa284136d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28a112640 1 --2- 172.21.15.52:0/918435965 >> v2:172.21.15.52:3300/0 conn(0x7fa2840708b0 0x7fa284136d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa28a112640 1 -- 172.21.15.52:0/918435965 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2840aa6d0 con 0x7fa284143db0 2024-09-15T20:51:31.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.233+0000 7fa289911640 1 --2- 172.21.15.52:0/918435965 >> v2:172.21.15.52:3300/0 conn(0x7fa2840708b0 0x7fa284136d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:31.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28a112640 1 --2- 172.21.15.52:0/918435965 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa284143db0 0x7fa284144240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa2840b6910 tx=0x7fa27c01c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e1dbf0fed5ecb2b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:31.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28890f640 1 -- 172.21.15.52:0/918435965 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c0b2070 con 0x7fa284143db0 2024-09-15T20:51:31.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28890f640 1 -- 172.21.15.52:0/918435965 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27c0a5810 con 0x7fa284143db0 2024-09-15T20:51:31.239 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28890f640 1 -- 172.21.15.52:0/918435965 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27c0a5be0 con 0x7fa284143db0 2024-09-15T20:51:31.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 -- 172.21.15.52:0/918435965 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa284143db0 msgr2=0x7fa284144240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 --2- 172.21.15.52:0/918435965 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa284143db0 0x7fa284144240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa2840b6910 tx=0x7fa27c01c880 comp rx=0 tx=0).stop 2024-09-15T20:51:31.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 -- 172.21.15.52:0/918435965 shutdown_connections 2024-09-15T20:51:31.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 --2- 172.21.15.52:0/918435965 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa284143db0 0x7fa284144240 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 --2- 172.21.15.52:0/918435965 >> v2:172.21.15.81:3300/0 conn(0x7fa2840733d0 0x7fa284137240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 --2- 172.21.15.52:0/918435965 >> v2:172.21.15.52:3300/0 conn(0x7fa2840708b0 0x7fa284136d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 -- 172.21.15.52:0/918435965 >> 172.21.15.52:0/918435965 conn(0x7fa2840b59a0 msgr2=0x7fa2840b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:31.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 -- 172.21.15.52:0/918435965 shutdown_connections 2024-09-15T20:51:31.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 -- 172.21.15.52:0/918435965 wait complete. 2024-09-15T20:51:31.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 Processor -- start 2024-09-15T20:51:31.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 -- start start 2024-09-15T20:51:31.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2840708b0 0x7fa284149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.244 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2840733d0 0x7fa28413f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa284143db0 0x7fa2841db240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa284072bd0 con 0x7fa2840708b0 2024-09-15T20:51:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa284072a50 con 0x7fa2840733d0 2024-09-15T20:51:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fa284072d50 con 0x7fa284143db0 2024-09-15T20:51:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa289911640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2840708b0 0x7fa284149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa289911640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2840708b0 0x7fa284149a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32972/0 (socket says 172.21.15.52:32972) 2024-09-15T20:51:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28a112640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa284143db0 0x7fa2841db240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa289911640 1 -- 172.21.15.52:0/3732585614 learned_addr learned my addr 172.21.15.52:0/3732585614 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa289110640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2840733d0 0x7fa28413f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa289911640 1 -- 172.21.15.52:0/3732585614 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa284143db0 msgr2=0x7fa2841db240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa289911640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa284143db0 0x7fa2841db240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa289911640 1 -- 172.21.15.52:0/3732585614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2840733d0 msgr2=0x7fa28413f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa289911640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2840733d0 0x7fa28413f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa289911640 1 -- 172.21.15.52:0/3732585614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa284138f60 con 0x7fa2840708b0 2024-09-15T20:51:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa289110640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2840733d0 0x7fa28413f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:51:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28a112640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa284143db0 0x7fa2841db240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa289911640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2840708b0 0x7fa284149a10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa280009fd0 tx=0x7fa28000ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa27a7fc640 1 -- 172.21.15.52:0/3732585614 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28000ca00 con 0x7fa2840708b0 2024-09-15T20:51:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa27a7fc640 1 -- 172.21.15.52:0/3732585614 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28000cba0 con 0x7fa2840708b0 2024-09-15T20:51:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa27a7fc640 1 -- 172.21.15.52:0/3732585614 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa280004030 con 0x7fa2840708b0 2024-09-15T20:51:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 -- 172.21.15.52:0/3732585614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2840b1b80 con 0x7fa2840708b0 2024-09-15T20:51:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.237+0000 7fa28bb75640 1 -- 172.21.15.52:0/3732585614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28413f760 con 0x7fa2840708b0 2024-09-15T20:51:31.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.241+0000 7fa28bb75640 1 -- 172.21.15.52:0/3732585614 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa284144240 con 0x7fa2840708b0 2024-09-15T20:51:31.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.241+0000 7fa27a7fc640 1 -- 172.21.15.52:0/3732585614 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fa2800041d0 con 0x7fa2840708b0 2024-09-15T20:51:31.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.241+0000 7fa27a7fc640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa268072ec0 0x7fa268075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.241+0000 7fa27a7fc640 1 -- 172.21.15.52:0/3732585614 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7fa280093e30 con 0x7fa2840708b0 2024-09-15T20:51:31.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.241+0000 7fa289110640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa268072ec0 0x7fa268075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.241+0000 7fa289110640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa268072ec0 0x7fa268075380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa28413faf0 tx=0x7fa274008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:31.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.245+0000 7fa27a7fc640 1 -- 172.21.15.52:0/3732585614 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7fa280017020 con 0x7fa2840708b0 2024-09-15T20:51:31.419 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.413+0000 7fa28bb75640 1 -- 172.21.15.52:0/3732585614 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa28406d120 con 0x7fa268072ec0 2024-09-15T20:51:31.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.421+0000 7fa27a7fc640 1 -- 172.21.15.52:0/3732585614 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117428 (secure 0 0 0) 0x7fa28406d120 con 0x7fa268072ec0 2024-09-15T20:51:31.427 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:51:31.427 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-15T20:51:31.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.425+0000 7fa28bb75640 1 -- 172.21.15.52:0/3732585614 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa268072ec0 msgr2=0x7fa268075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.428 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.425+0000 7fa28bb75640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa268072ec0 0x7fa268075380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa28413faf0 tx=0x7fa274008040 comp rx=0 tx=0).stop 2024-09-15T20:51:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.425+0000 7fa28bb75640 1 -- 172.21.15.52:0/3732585614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2840708b0 msgr2=0x7fa284149a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.425+0000 7fa28bb75640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2840708b0 0x7fa284149a10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa280009fd0 tx=0x7fa28000ee10 comp rx=0 tx=0).stop 2024-09-15T20:51:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.425+0000 7fa28bb75640 1 -- 172.21.15.52:0/3732585614 shutdown_connections 2024-09-15T20:51:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.425+0000 7fa28bb75640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa268072ec0 0x7fa268075380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.425+0000 7fa28bb75640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa284143db0 0x7fa2841db240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.425+0000 7fa28bb75640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2840733d0 0x7fa28413f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.425+0000 7fa28bb75640 1 --2- 172.21.15.52:0/3732585614 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa2840708b0 0x7fa284149a10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.425+0000 7fa28bb75640 1 -- 172.21.15.52:0/3732585614 >> 172.21.15.52:0/3732585614 conn(0x7fa2840b59a0 msgr2=0x7fa28413a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.425+0000 7fa28bb75640 1 -- 172.21.15.52:0/3732585614 shutdown_connections 2024-09-15T20:51:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.425+0000 7fa28bb75640 1 -- 172.21.15.52:0/3732585614 wait complete. 2024-09-15T20:51:31.446 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-15T20:51:31.292639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3574134075,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":0,"num_read":2563,"num_read_kb":2563,"num_write":159731,"num_write_kb":5637871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161528,"ondisk_log_size":161528,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8554280,"kb_used_data":6692072,"kb_used_omap":12,"kb_used_meta":1862067,"kb_avail":746420440,"statfs":{"total":773094113280,"available":764334530560,"internally_reserved":0,"allocated":6852681728,"data_stored":6847027774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1906757168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":32768,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003296"},"pg_stats":[{"pgid":"3.1f","version":"25'2778","reported_seq":2799,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.633832+0000","last_change":"2024-09-15T20:47:21.015285+0000","last_active":"2024-09-15T20:50:14.633832+0000","last_peered":"2024-09-15T20:50:14.633832+0000","last_clean":"2024-09-15T20:50:14.633832+0000","last_became_active":"2024-09-15T20:47:21.011783+0000","last_became_peered":"2024-09-15T20:47:21.011783+0000","last_unstale":"2024-09-15T20:50:14.633832+0000","last_undegraded":"2024-09-15T20:50:14.633832+0000","last_fullsized":"2024-09-15T20:50:14.633832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2778,"log_dups_size":0,"ondisk_log_size":2778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:05.541594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63045632,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":2788,"num_write_kb":119877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5176","reported_seq":5193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:22.569954+0000","last_change":"2024-09-15T20:47:21.015253+0000","last_active":"2024-09-15T20:50:22.569954+0000","last_peered":"2024-09-15T20:50:22.569954+0000","last_clean":"2024-09-15T20:50:22.569954+0000","last_became_active":"2024-09-15T20:47:21.012740+0000","last_became_peered":"2024-09-15T20:47:21.012740+0000","last_unstale":"2024-09-15T20:50:22.569954+0000","last_undegraded":"2024-09-15T20:50:22.569954+0000","last_fullsized":"2024-09-15T20:50:22.569954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5176,"log_dups_size":0,"ondisk_log_size":5176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:00:44.351671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5153,"num_write_kb":141699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"26'6012","reported_seq":6028,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:28.707096+0000","last_change":"2024-09-15T20:47:21.009274+0000","last_active":"2024-09-15T20:50:28.707096+0000","last_peered":"2024-09-15T20:50:28.707096+0000","last_clean":"2024-09-15T20:50:28.707096+0000","last_became_active":"2024-09-15T20:47:21.008254+0000","last_became_peered":"2024-09-15T20:47:21.008254+0000","last_unstale":"2024-09-15T20:50:28.707096+0000","last_undegraded":"2024-09-15T20:50:28.707096+0000","last_fullsized":"2024-09-15T20:50:28.707096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6012,"log_dups_size":0,"ondisk_log_size":6012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:25.171093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5984,"num_write_kb":200879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"25'3552","reported_seq":3575,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445935+0000","last_change":"2024-09-15T20:47:21.007102+0000","last_active":"2024-09-15T20:51:30.445935+0000","last_peered":"2024-09-15T20:51:30.445935+0000","last_clean":"2024-09-15T20:51:30.445935+0000","last_became_active":"2024-09-15T20:47:21.006831+0000","last_became_peered":"2024-09-15T20:47:21.006831+0000","last_unstale":"2024-09-15T20:51:30.445935+0000","last_undegraded":"2024-09-15T20:51:30.445935+0000","last_fullsized":"2024-09-15T20:51:30.445935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:43.612856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3557,"num_write_kb":160908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"26'2770","reported_seq":2790,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.969699+0000","last_change":"2024-09-15T20:47:21.010908+0000","last_active":"2024-09-15T20:50:14.969699+0000","last_peered":"2024-09-15T20:50:14.969699+0000","last_clean":"2024-09-15T20:50:14.969699+0000","last_became_active":"2024-09-15T20:47:21.009995+0000","last_became_peered":"2024-09-15T20:47:21.009995+0000","last_unstale":"2024-09-15T20:50:14.969699+0000","last_undegraded":"2024-09-15T20:50:14.969699+0000","last_fullsized":"2024-09-15T20:50:14.969699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2770,"log_dups_size":0,"ondisk_log_size":2770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:16.024768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79700496,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":15,"num_read_kb":11,"num_write":2741,"num_write_kb":123666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"26'7925","reported_seq":7958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445548+0000","last_change":"2024-09-15T20:47:21.023842+0000","last_active":"2024-09-15T20:51:30.445548+0000","last_peered":"2024-09-15T20:51:30.445548+0000","last_clean":"2024-09-15T20:51:30.445548+0000","last_became_active":"2024-09-15T20:47:21.023610+0000","last_became_peered":"2024-09-15T20:47:21.023610+0000","last_unstale":"2024-09-15T20:51:30.445548+0000","last_undegraded":"2024-09-15T20:51:30.445548+0000","last_fullsized":"2024-09-15T20:51:30.445548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":7925,"log_dups_size":0,"ondisk_log_size":7925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:29:25.867670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146120704,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":56,"num_read_kb":171,"num_write":7933,"num_write_kb":198258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"26'5268","reported_seq":5295,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:32.418516+0000","last_change":"2024-09-15T20:47:21.007395+0000","last_active":"2024-09-15T20:50:32.418516+0000","last_peered":"2024-09-15T20:50:32.418516+0000","last_clean":"2024-09-15T20:50:32.418516+0000","last_became_active":"2024-09-15T20:47:21.005632+0000","last_became_peered":"2024-09-15T20:47:21.005632+0000","last_unstale":"2024-09-15T20:50:32.418516+0000","last_undegraded":"2024-09-15T20:50:32.418516+0000","last_fullsized":"2024-09-15T20:50:32.418516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:11.496243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":5236,"num_write_kb":197894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"26'6364","reported_seq":6383,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:32.221176+0000","last_change":"2024-09-15T20:47:21.023466+0000","last_active":"2024-09-15T20:50:32.221176+0000","last_peered":"2024-09-15T20:50:32.221176+0000","last_clean":"2024-09-15T20:50:32.221176+0000","last_became_active":"2024-09-15T20:47:21.016879+0000","last_became_peered":"2024-09-15T20:47:21.016879+0000","last_unstale":"2024-09-15T20:50:32.221176+0000","last_undegraded":"2024-09-15T20:50:32.221176+0000","last_fullsized":"2024-09-15T20:50:32.221176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6364,"log_dups_size":0,"ondisk_log_size":6364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:17.404898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":6371,"num_write_kb":181001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"26'6415","reported_seq":6431,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:35.523866+0000","last_change":"2024-09-15T20:47:21.018582+0000","last_active":"2024-09-15T20:50:35.523866+0000","last_peered":"2024-09-15T20:50:35.523866+0000","last_clean":"2024-09-15T20:50:35.523866+0000","last_became_active":"2024-09-15T20:47:21.016813+0000","last_became_peered":"2024-09-15T20:47:21.016813+0000","last_unstale":"2024-09-15T20:50:35.523866+0000","last_undegraded":"2024-09-15T20:50:35.523866+0000","last_fullsized":"2024-09-15T20:50:35.523866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6415,"log_dups_size":0,"ondisk_log_size":6415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T21:41:01.610631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6412,"num_write_kb":184897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"26'3751","reported_seq":3767,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.870226+0000","last_change":"2024-09-15T20:47:21.010645+0000","last_active":"2024-09-15T20:50:14.870226+0000","last_peered":"2024-09-15T20:50:14.870226+0000","last_clean":"2024-09-15T20:50:14.870226+0000","last_became_active":"2024-09-15T20:47:21.010350+0000","last_became_peered":"2024-09-15T20:47:21.010350+0000","last_unstale":"2024-09-15T20:50:14.870226+0000","last_undegraded":"2024-09-15T20:50:14.870226+0000","last_fullsized":"2024-09-15T20:50:14.870226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3751,"log_dups_size":0,"ondisk_log_size":3751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T21:26:17.071795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3727,"num_write_kb":156934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"26'5784","reported_seq":5808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477618+0000","last_change":"2024-09-15T20:47:21.017244+0000","last_active":"2024-09-15T20:51:30.477618+0000","last_peered":"2024-09-15T20:51:30.477618+0000","last_clean":"2024-09-15T20:51:30.477618+0000","last_became_active":"2024-09-15T20:47:21.016999+0000","last_became_peered":"2024-09-15T20:47:21.016999+0000","last_unstale":"2024-09-15T20:51:30.477618+0000","last_undegraded":"2024-09-15T20:51:30.477618+0000","last_fullsized":"2024-09-15T20:51:30.477618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5784,"log_dups_size":0,"ondisk_log_size":5784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:18.918849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":5791,"num_write_kb":176448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"26'6373","reported_seq":6401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:25.303453+0000","last_change":"2024-09-15T20:47:21.010964+0000","last_active":"2024-09-15T20:50:25.303453+0000","last_peered":"2024-09-15T20:50:25.303453+0000","last_clean":"2024-09-15T20:50:25.303453+0000","last_became_active":"2024-09-15T20:47:21.010694+0000","last_became_peered":"2024-09-15T20:47:21.010694+0000","last_unstale":"2024-09-15T20:50:25.303453+0000","last_undegraded":"2024-09-15T20:50:25.303453+0000","last_fullsized":"2024-09-15T20:50:25.303453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6373,"log_dups_size":0,"ondisk_log_size":6373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:44.740081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":6347,"num_write_kb":171391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.577247+0000","last_change":"2024-09-15T20:47:14.474673+0000","last_active":"2024-09-15T20:50:14.577247+0000","last_peered":"2024-09-15T20:50:14.577247+0000","last_clean":"2024-09-15T20:50:14.577247+0000","last_became_active":"2024-09-15T20:47:12.471373+0000","last_became_peered":"2024-09-15T20:47:12.471373+0000","last_unstale":"2024-09-15T20:50:14.577247+0000","last_undegraded":"2024-09-15T20:50:14.577247+0000","last_fullsized":"2024-09-15T20:50:14.577247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:47.666907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018866289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'6610","reported_seq":6628,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:51:19.805553+0000","last_change":"2024-09-15T20:47:21.019817+0000","last_active":"2024-09-15T20:51:19.805553+0000","last_peered":"2024-09-15T20:51:19.805553+0000","last_clean":"2024-09-15T20:51:19.805553+0000","last_became_active":"2024-09-15T20:47:21.019020+0000","last_became_peered":"2024-09-15T20:47:21.019020+0000","last_unstale":"2024-09-15T20:51:19.805553+0000","last_undegraded":"2024-09-15T20:51:19.805553+0000","last_fullsized":"2024-09-15T20:51:19.805553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6610,"log_dups_size":0,"ondisk_log_size":6610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:33.686995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137986560,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6595,"num_write_kb":207131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.579788+0000","last_change":"2024-09-15T20:47:14.472821+0000","last_active":"2024-09-15T20:50:14.579788+0000","last_peered":"2024-09-15T20:50:14.579788+0000","last_clean":"2024-09-15T20:50:14.579788+0000","last_became_active":"2024-09-15T20:47:12.468530+0000","last_became_peered":"2024-09-15T20:47:12.468530+0000","last_unstale":"2024-09-15T20:50:14.579788+0000","last_undegraded":"2024-09-15T20:50:14.579788+0000","last_fullsized":"2024-09-15T20:50:14.579788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:33.831606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000891339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4891","reported_seq":4918,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.969875+0000","last_change":"2024-09-15T20:47:21.021835+0000","last_active":"2024-09-15T20:50:14.969875+0000","last_peered":"2024-09-15T20:50:14.969875+0000","last_clean":"2024-09-15T20:50:14.969875+0000","last_became_active":"2024-09-15T20:47:21.021031+0000","last_became_peered":"2024-09-15T20:47:21.021031+0000","last_unstale":"2024-09-15T20:50:14.969875+0000","last_undegraded":"2024-09-15T20:50:14.969875+0000","last_fullsized":"2024-09-15T20:50:14.969875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4891,"log_dups_size":0,"ondisk_log_size":4891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:21.527979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":4866,"num_write_kb":218628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.577645+0000","last_change":"2024-09-15T20:47:14.475000+0000","last_active":"2024-09-15T20:50:14.577645+0000","last_peered":"2024-09-15T20:50:14.577645+0000","last_clean":"2024-09-15T20:50:14.577645+0000","last_became_active":"2024-09-15T20:47:12.461531+0000","last_became_peered":"2024-09-15T20:47:12.461531+0000","last_unstale":"2024-09-15T20:50:14.577645+0000","last_undegraded":"2024-09-15T20:50:14.577645+0000","last_fullsized":"2024-09-15T20:50:14.577645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:28.018623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022230399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'8341","reported_seq":8401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:34.363218+0000","last_change":"2024-09-15T20:47:21.026683+0000","last_active":"2024-09-15T20:50:34.363218+0000","last_peered":"2024-09-15T20:50:34.363218+0000","last_clean":"2024-09-15T20:50:34.363218+0000","last_became_active":"2024-09-15T20:47:21.025918+0000","last_became_peered":"2024-09-15T20:47:21.025918+0000","last_unstale":"2024-09-15T20:50:34.363218+0000","last_undegraded":"2024-09-15T20:50:34.363218+0000","last_fullsized":"2024-09-15T20:50:34.363218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":8341,"log_dups_size":0,"ondisk_log_size":8341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:52.672994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135988904,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":174,"num_read_kb":136,"num_write":8413,"num_write_kb":232061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.636018+0000","last_change":"2024-09-15T20:47:14.986335+0000","last_active":"2024-09-15T20:50:14.636018+0000","last_peered":"2024-09-15T20:50:14.636018+0000","last_clean":"2024-09-15T20:50:14.636018+0000","last_became_active":"2024-09-15T20:47:12.468184+0000","last_became_peered":"2024-09-15T20:47:12.468184+0000","last_unstale":"2024-09-15T20:50:14.636018+0000","last_undegraded":"2024-09-15T20:50:14.636018+0000","last_fullsized":"2024-09-15T20:50:14.636018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:30.408559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001176739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'4297","reported_seq":4324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:51:19.808832+0000","last_change":"2024-09-15T20:47:21.018098+0000","last_active":"2024-09-15T20:51:19.808832+0000","last_peered":"2024-09-15T20:51:19.808832+0000","last_clean":"2024-09-15T20:51:19.808832+0000","last_became_active":"2024-09-15T20:47:21.017736+0000","last_became_peered":"2024-09-15T20:47:21.017736+0000","last_unstale":"2024-09-15T20:51:19.808832+0000","last_undegraded":"2024-09-15T20:51:19.808832+0000","last_fullsized":"2024-09-15T20:51:19.808832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4297,"log_dups_size":0,"ondisk_log_size":4297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:38.019405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78276432,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":24,"num_read_kb":82,"num_write":4316,"num_write_kb":145640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"25'5330","reported_seq":5348,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477548+0000","last_change":"2024-09-15T20:47:21.009225+0000","last_active":"2024-09-15T20:51:30.477548+0000","last_peered":"2024-09-15T20:51:30.477548+0000","last_clean":"2024-09-15T20:51:30.477548+0000","last_became_active":"2024-09-15T20:47:21.008994+0000","last_became_peered":"2024-09-15T20:47:21.008994+0000","last_unstale":"2024-09-15T20:51:30.477548+0000","last_undegraded":"2024-09-15T20:51:30.477548+0000","last_fullsized":"2024-09-15T20:51:30.477548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5330,"log_dups_size":0,"ondisk_log_size":5330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:01.453378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5329,"num_write_kb":197895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.576694+0000","last_change":"2024-09-15T20:47:14.474210+0000","last_active":"2024-09-15T20:50:14.576694+0000","last_peered":"2024-09-15T20:50:14.576694+0000","last_clean":"2024-09-15T20:50:14.576694+0000","last_became_active":"2024-09-15T20:47:12.471091+0000","last_became_peered":"2024-09-15T20:47:12.471091+0000","last_unstale":"2024-09-15T20:50:14.576694+0000","last_undegraded":"2024-09-15T20:50:14.576694+0000","last_fullsized":"2024-09-15T20:50:14.576694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:42.228249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530579999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"26'3415","reported_seq":3542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.973637+0000","last_change":"2024-09-15T20:47:21.024516+0000","last_active":"2024-09-15T20:50:14.973637+0000","last_peered":"2024-09-15T20:50:14.973637+0000","last_clean":"2024-09-15T20:50:14.973637+0000","last_became_active":"2024-09-15T20:47:21.023619+0000","last_became_peered":"2024-09-15T20:47:21.023619+0000","last_unstale":"2024-09-15T20:50:14.973637+0000","last_undegraded":"2024-09-15T20:50:14.973637+0000","last_fullsized":"2024-09-15T20:50:14.973637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3415,"log_dups_size":0,"ondisk_log_size":3415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:18.323622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371536,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":138,"num_read_kb":254,"num_write":3502,"num_write_kb":132957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.563348+0000","last_change":"2024-09-15T20:47:14.986963+0000","last_active":"2024-09-15T20:50:14.563348+0000","last_peered":"2024-09-15T20:50:14.563348+0000","last_clean":"2024-09-15T20:50:14.563348+0000","last_became_active":"2024-09-15T20:47:12.462360+0000","last_became_peered":"2024-09-15T20:47:12.462360+0000","last_unstale":"2024-09-15T20:50:14.563348+0000","last_undegraded":"2024-09-15T20:50:14.563348+0000","last_fullsized":"2024-09-15T20:50:14.563348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:39.175611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011324970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"26'3755","reported_seq":3771,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.878523+0000","last_change":"2024-09-15T20:47:21.018553+0000","last_active":"2024-09-15T20:50:14.878523+0000","last_peered":"2024-09-15T20:50:14.878523+0000","last_clean":"2024-09-15T20:50:14.878523+0000","last_became_active":"2024-09-15T20:47:21.017058+0000","last_became_peered":"2024-09-15T20:47:21.017058+0000","last_unstale":"2024-09-15T20:50:14.878523+0000","last_undegraded":"2024-09-15T20:50:14.878523+0000","last_fullsized":"2024-09-15T20:50:14.878523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3755,"log_dups_size":0,"ondisk_log_size":3755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:15.985307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3728,"num_write_kb":173059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.576395+0000","last_change":"2024-09-15T20:47:14.473959+0000","last_active":"2024-09-15T20:50:14.576395+0000","last_peered":"2024-09-15T20:50:14.576395+0000","last_clean":"2024-09-15T20:50:14.576395+0000","last_became_active":"2024-09-15T20:47:12.463812+0000","last_became_peered":"2024-09-15T20:47:12.463812+0000","last_unstale":"2024-09-15T20:50:14.576395+0000","last_undegraded":"2024-09-15T20:50:14.576395+0000","last_fullsized":"2024-09-15T20:50:14.576395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:19.954840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001226357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"26'4114","reported_seq":4130,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:30.062153+0000","last_change":"2024-09-15T20:47:21.006238+0000","last_active":"2024-09-15T20:50:30.062153+0000","last_peered":"2024-09-15T20:50:30.062153+0000","last_clean":"2024-09-15T20:50:30.062153+0000","last_became_active":"2024-09-15T20:47:21.005584+0000","last_became_peered":"2024-09-15T20:47:21.005584+0000","last_unstale":"2024-09-15T20:50:30.062153+0000","last_undegraded":"2024-09-15T20:50:30.062153+0000","last_fullsized":"2024-09-15T20:50:30.062153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4114,"log_dups_size":0,"ondisk_log_size":4114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:22.836701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4109,"num_write_kb":152323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.577590+0000","last_change":"2024-09-15T20:47:14.475335+0000","last_active":"2024-09-15T20:50:14.577590+0000","last_peered":"2024-09-15T20:50:14.577590+0000","last_clean":"2024-09-15T20:50:14.577590+0000","last_became_active":"2024-09-15T20:47:12.469021+0000","last_became_peered":"2024-09-15T20:47:12.469021+0000","last_unstale":"2024-09-15T20:50:14.577590+0000","last_undegraded":"2024-09-15T20:50:14.577590+0000","last_fullsized":"2024-09-15T20:50:14.577590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:19.117864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025466540000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445172+0000","last_change":"2024-09-15T20:47:07.291789+0000","last_active":"2024-09-15T20:51:30.445172+0000","last_peered":"2024-09-15T20:51:30.445172+0000","last_clean":"2024-09-15T20:51:30.445172+0000","last_became_active":"2024-09-15T20:47:07.289970+0000","last_became_peered":"2024-09-15T20:47:07.289970+0000","last_unstale":"2024-09-15T20:51:30.445172+0000","last_undegraded":"2024-09-15T20:51:30.445172+0000","last_fullsized":"2024-09-15T20:51:30.445172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:05.400631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:05.400631+0000","last_clean_scrub_stamp":"2024-09-15T20:47:05.400631+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:27.776984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"26'3475","reported_seq":3491,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.987842+0000","last_change":"2024-09-15T20:47:21.018143+0000","last_active":"2024-09-15T20:50:14.987842+0000","last_peered":"2024-09-15T20:50:14.987842+0000","last_clean":"2024-09-15T20:50:14.987842+0000","last_became_active":"2024-09-15T20:47:21.017326+0000","last_became_peered":"2024-09-15T20:47:21.017326+0000","last_unstale":"2024-09-15T20:50:14.987842+0000","last_undegraded":"2024-09-15T20:50:14.987842+0000","last_fullsized":"2024-09-15T20:50:14.987842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:39.169392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3405,"num_write_kb":176771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"26'8068","reported_seq":8190,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:33.356575+0000","last_change":"2024-09-15T20:47:21.005970+0000","last_active":"2024-09-15T20:50:33.356575+0000","last_peered":"2024-09-15T20:50:33.356575+0000","last_clean":"2024-09-15T20:50:33.356575+0000","last_became_active":"2024-09-15T20:47:21.005684+0000","last_became_peered":"2024-09-15T20:47:21.005684+0000","last_unstale":"2024-09-15T20:50:33.356575+0000","last_undegraded":"2024-09-15T20:50:33.356575+0000","last_fullsized":"2024-09-15T20:50:33.356575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":8068,"log_dups_size":0,"ondisk_log_size":8068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:57.048864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104858112,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":356,"num_read_kb":316,"num_write":6023,"num_write_kb":166026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"26'6134","reported_seq":6174,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:34.593906+0000","last_change":"2024-09-15T20:47:21.006726+0000","last_active":"2024-09-15T20:50:34.593906+0000","last_peered":"2024-09-15T20:50:34.593906+0000","last_clean":"2024-09-15T20:50:34.593906+0000","last_became_active":"2024-09-15T20:47:21.006304+0000","last_became_peered":"2024-09-15T20:47:21.006304+0000","last_unstale":"2024-09-15T20:50:34.593906+0000","last_undegraded":"2024-09-15T20:50:34.593906+0000","last_fullsized":"2024-09-15T20:50:34.593906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6134,"log_dups_size":0,"ondisk_log_size":6134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:22.106814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138543632,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":97,"num_read_kb":78,"num_write":6159,"num_write_kb":180177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"25'4305","reported_seq":4322,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.563227+0000","last_change":"2024-09-15T20:47:21.026764+0000","last_active":"2024-09-15T20:50:14.563227+0000","last_peered":"2024-09-15T20:50:14.563227+0000","last_clean":"2024-09-15T20:50:14.563227+0000","last_became_active":"2024-09-15T20:47:21.025992+0000","last_became_peered":"2024-09-15T20:47:21.025992+0000","last_unstale":"2024-09-15T20:50:14.563227+0000","last_undegraded":"2024-09-15T20:50:14.563227+0000","last_fullsized":"2024-09-15T20:50:14.563227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4305,"log_dups_size":0,"ondisk_log_size":4305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:34.126386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113312264,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4307,"num_write_kb":192020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"27'2811","reported_seq":2829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.521390+0000","last_change":"2024-09-15T20:47:21.019750+0000","last_active":"2024-09-15T20:51:30.521390+0000","last_peered":"2024-09-15T20:51:30.521390+0000","last_clean":"2024-09-15T20:51:30.521390+0000","last_became_active":"2024-09-15T20:47:21.019431+0000","last_became_peered":"2024-09-15T20:47:21.019431+0000","last_unstale":"2024-09-15T20:51:30.521390+0000","last_undegraded":"2024-09-15T20:51:30.521390+0000","last_fullsized":"2024-09-15T20:51:30.521390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2811,"log_dups_size":0,"ondisk_log_size":2811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:09.223242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69863248,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2764,"num_write_kb":138455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"26'3208","reported_seq":3226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.866246+0000","last_change":"2024-09-15T20:47:21.002739+0000","last_active":"2024-09-15T20:50:14.866246+0000","last_peered":"2024-09-15T20:50:14.866246+0000","last_clean":"2024-09-15T20:50:14.866246+0000","last_became_active":"2024-09-15T20:47:21.002454+0000","last_became_peered":"2024-09-15T20:47:21.002454+0000","last_unstale":"2024-09-15T20:50:14.866246+0000","last_undegraded":"2024-09-15T20:50:14.866246+0000","last_fullsized":"2024-09-15T20:50:14.866246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:03.783169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111936016,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":3190,"num_write_kb":137614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"26'5657","reported_seq":6052,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:15.049278+0000","last_change":"2024-09-15T20:47:21.008704+0000","last_active":"2024-09-15T20:50:15.049278+0000","last_peered":"2024-09-15T20:50:15.049278+0000","last_clean":"2024-09-15T20:50:15.049278+0000","last_became_active":"2024-09-15T20:47:21.007899+0000","last_became_peered":"2024-09-15T20:47:21.007899+0000","last_unstale":"2024-09-15T20:50:15.049278+0000","last_undegraded":"2024-09-15T20:50:15.049278+0000","last_fullsized":"2024-09-15T20:50:15.049278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5657,"log_dups_size":0,"ondisk_log_size":5657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:28.324549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114958864,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1304,"num_read_kb":1127,"num_write":6119,"num_write_kb":191597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'4887","reported_seq":4908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.520257+0000","last_change":"2024-09-15T20:47:21.009343+0000","last_active":"2024-09-15T20:51:30.520257+0000","last_peered":"2024-09-15T20:51:30.520257+0000","last_clean":"2024-09-15T20:51:30.520257+0000","last_became_active":"2024-09-15T20:47:21.008922+0000","last_became_peered":"2024-09-15T20:47:21.008922+0000","last_unstale":"2024-09-15T20:51:30.520257+0000","last_undegraded":"2024-09-15T20:51:30.520257+0000","last_fullsized":"2024-09-15T20:51:30.520257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4887,"log_dups_size":0,"ondisk_log_size":4887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:30.517648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":4843,"num_write_kb":242701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'5581","reported_seq":5599,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445098+0000","last_change":"2024-09-15T20:47:21.028647+0000","last_active":"2024-09-15T20:51:30.445098+0000","last_peered":"2024-09-15T20:51:30.445098+0000","last_clean":"2024-09-15T20:51:30.445098+0000","last_became_active":"2024-09-15T20:47:21.028396+0000","last_became_peered":"2024-09-15T20:47:21.028396+0000","last_unstale":"2024-09-15T20:51:30.445098+0000","last_undegraded":"2024-09-15T20:51:30.445098+0000","last_fullsized":"2024-09-15T20:51:30.445098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5581,"log_dups_size":0,"ondisk_log_size":5581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:45.063111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149618688,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5530,"num_write_kb":231368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"25'3819","reported_seq":3843,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.576279+0000","last_change":"2024-09-15T20:47:21.009991+0000","last_active":"2024-09-15T20:50:14.576279+0000","last_peered":"2024-09-15T20:50:14.576279+0000","last_clean":"2024-09-15T20:50:14.576279+0000","last_became_active":"2024-09-15T20:47:21.009741+0000","last_became_peered":"2024-09-15T20:47:21.009741+0000","last_unstale":"2024-09-15T20:50:14.576279+0000","last_undegraded":"2024-09-15T20:50:14.576279+0000","last_fullsized":"2024-09-15T20:50:14.576279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3819,"log_dups_size":0,"ondisk_log_size":3819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T20:50:34.892506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130680656,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":3826,"num_write_kb":196699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'2664","reported_seq":2704,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.967125+0000","last_change":"2024-09-15T20:47:21.015487+0000","last_active":"2024-09-15T20:50:14.967125+0000","last_peered":"2024-09-15T20:50:14.967125+0000","last_clean":"2024-09-15T20:50:14.967125+0000","last_became_active":"2024-09-15T20:47:21.012712+0000","last_became_peered":"2024-09-15T20:47:21.012712+0000","last_unstale":"2024-09-15T20:50:14.967125+0000","last_undegraded":"2024-09-15T20:50:14.967125+0000","last_fullsized":"2024-09-15T20:50:14.967125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2664,"log_dups_size":0,"ondisk_log_size":2664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:01.394914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080896,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":94,"num_read_kb":81,"num_write":2658,"num_write_kb":115655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"26'7923","reported_seq":7940,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:27.449463+0000","last_change":"2024-09-15T20:47:21.012518+0000","last_active":"2024-09-15T20:50:27.449463+0000","last_peered":"2024-09-15T20:50:27.449463+0000","last_clean":"2024-09-15T20:50:27.449463+0000","last_became_active":"2024-09-15T20:47:21.012087+0000","last_became_peered":"2024-09-15T20:47:21.012087+0000","last_unstale":"2024-09-15T20:50:27.449463+0000","last_undegraded":"2024-09-15T20:50:27.449463+0000","last_fullsized":"2024-09-15T20:50:27.449463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":7923,"log_dups_size":0,"ondisk_log_size":7923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:50.852789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125895176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":7906,"num_write_kb":193612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3573543688,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":0,"num_read":2497,"num_read_kb":2508,"num_write":159628,"num_write_kb":5636241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6849433600,"data_stored":6845163144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161453,"ondisk_log_size":161453,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555500,"kb_used_data":474332,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":93816340,"statfs":{"total":96636764160,"available":96067932160,"internally_reserved":0,"allocated":485715968,"data_stored":485307172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":83098058},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509497,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1212960,"kb_used_data":938896,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93158880,"statfs":{"total":96636764160,"available":95394693120,"internally_reserved":0,"allocated":961429504,"data_stored":960571724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1182172,"kb_used_data":926156,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93189668,"statfs":{"total":96636764160,"available":95426220032,"internally_reserved":0,"allocated":948383744,"data_stored":947692488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1023460,"kb_used_data":807700,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":93348380,"statfs":{"total":96636764160,"available":95588741120,"internally_reserved":0,"allocated":827084800,"data_stored":826445331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220920262},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1064716,"kb_used_data":821180,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":93307124,"statfs":{"total":96636764160,"available":95546494976,"internally_reserved":0,"allocated":840888320,"data_stored":840202232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":923192,"kb_used_data":721320,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":93448648,"statfs":{"total":96636764160,"available":95691415552,"internally_reserved":0,"allocated":738631680,"data_stored":738005624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206698949},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542199,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1364792,"kb_used_data":1067112,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":93007048,"statfs":{"total":96636764160,"available":95239217152,"internally_reserved":0,"allocated":1092722688,"data_stored":1091855327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":304806343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1227488,"kb_used_data":935376,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93144352,"statfs":{"total":96636764160,"available":95379816448,"internally_reserved":0,"allocated":957825024,"data_stored":956947876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":948101120,"data_stored":947584016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":960626688,"data_stored":959943044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":957554688,"data_stored":956848124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1092448256,"data_stored":1091755556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":738361344,"data_stored":737905872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":840085504,"data_stored":839573552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":826810368,"data_stored":826345560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":485445632,"data_stored":485207420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T20:51:31.448 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T20:51:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f70174e9640 1 Processor -- start 2024-09-15T20:51:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f70174e9640 1 -- start start 2024-09-15T20:51:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f70174e9640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7010074290 0x7f701014b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f70174e9640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7010073880 con 0x7f7010070fb0 2024-09-15T20:51:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f70174e9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70100ab060 con 0x7f70100734a0 2024-09-15T20:51:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f70174e9640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f70100746c0 con 0x7f7010074290 2024-09-15T20:51:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f7014a84640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7010070fb0 0x7f701013d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57256/0 (socket says 172.21.15.52:57256) 2024-09-15T20:51:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f7015a86640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7010074290 0x7f701014b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f7014a84640 1 -- 172.21.15.52:0/3621063533 learned_addr learned my addr 172.21.15.52:0/3621063533 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f7007fff640 1 -- 172.21.15.52:0/3621063533 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426526105 0 0) 0x7f7000001120 con 0x7f7010070fb0 2024-09-15T20:51:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f7007fff640 1 -- 172.21.15.52:0/3621063533 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ffc003530 con 0x7f7010070fb0 2024-09-15T20:51:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f7015a86640 1 -- 172.21.15.52:0/3621063533 >> v1:172.21.15.81:6789/0 conn(0x7f70100734a0 legacy=0x7f7010140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f7015a86640 1 -- 172.21.15.52:0/3621063533 >> v1:172.21.15.52:6789/0 conn(0x7f7010070fb0 legacy=0x7f701013d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.579 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.573+0000 7f7015a86640 1 -- 172.21.15.52:0/3621063533 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7010074970 con 0x7f7010074290 2024-09-15T20:51:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7015a86640 1 --2- 172.21.15.52:0/3621063533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7010074290 0x7f701014b9d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70080097c0 tx=0x7f700801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3b6480a39a2269 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7007fff640 1 -- 172.21.15.52:0/3621063533 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70080b0070 con 0x7f7010074290 2024-09-15T20:51:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7007fff640 1 -- 172.21.15.52:0/3621063533 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70080ab400 con 0x7f7010074290 2024-09-15T20:51:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7007fff640 1 -- 172.21.15.52:0/3621063533 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70080ab7d0 con 0x7f7010074290 2024-09-15T20:51:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 -- 172.21.15.52:0/3621063533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7010074290 msgr2=0x7f701014b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 --2- 172.21.15.52:0/3621063533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7010074290 0x7f701014b9d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f70080097c0 tx=0x7f700801c3f0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 -- 172.21.15.52:0/3621063533 shutdown_connections 2024-09-15T20:51:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 --2- 172.21.15.52:0/3621063533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7010074290 0x7f701014b9d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 -- 172.21.15.52:0/3621063533 >> 172.21.15.52:0/3621063533 conn(0x7f70100b6300 msgr2=0x7f70100b6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 -- 172.21.15.52:0/3621063533 shutdown_connections 2024-09-15T20:51:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 -- 172.21.15.52:0/3621063533 wait complete. 2024-09-15T20:51:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 Processor -- start 2024-09-15T20:51:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 -- start start 2024-09-15T20:51:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7010070fb0 0x7f70100b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70100734a0 0x7f70101dc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7010074290 0x7f70101417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f70100713c0 con 0x7f7010070fb0 2024-09-15T20:51:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f701013dac0 con 0x7f7010074290 2024-09-15T20:51:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f70174e9640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f701014e140 con 0x7f70100734a0 2024-09-15T20:51:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7015285640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7010070fb0 0x7f70100b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7014a84640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70100734a0 0x7f70101dc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7015285640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7010070fb0 0x7f70100b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:32988/0 (socket says 172.21.15.52:32988) 2024-09-15T20:51:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7015285640 1 -- 172.21.15.52:0/1520893790 learned_addr learned my addr 172.21.15.52:0/1520893790 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7015285640 1 -- 172.21.15.52:0/1520893790 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70100734a0 msgr2=0x7f70101dc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7015a86640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7010074290 0x7f70101417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7015285640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70100734a0 0x7f70101dc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7015285640 1 -- 172.21.15.52:0/1520893790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7010074290 msgr2=0x7f70101417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7015285640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7010074290 0x7f70101417d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7015285640 1 -- 172.21.15.52:0/1520893790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70101dc930 con 0x7f7010070fb0 2024-09-15T20:51:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7014a84640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70100734a0 0x7f70101dc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.577+0000 7f7015285640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7010070fb0 0x7f70100b1250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f700c00c870 tx=0x7f700c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.581+0000 7f7005ffb640 1 -- 172.21.15.52:0/1520893790 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c003b80 con 0x7f7010070fb0 2024-09-15T20:51:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.581+0000 7f7005ffb640 1 -- 172.21.15.52:0/1520893790 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f700c003d20 con 0x7f7010070fb0 2024-09-15T20:51:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.581+0000 7f70174e9640 1 -- 172.21.15.52:0/1520893790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70101dcde0 con 0x7f7010070fb0 2024-09-15T20:51:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.581+0000 7f7005ffb640 1 -- 172.21.15.52:0/1520893790 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c00aa90 con 0x7f7010070fb0 2024-09-15T20:51:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.581+0000 7f70174e9640 1 -- 172.21.15.52:0/1520893790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7010141ee0 con 0x7f7010070fb0 2024-09-15T20:51:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.581+0000 7f70174e9640 1 -- 172.21.15.52:0/1520893790 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f701013d1a0 con 0x7f7010070fb0 2024-09-15T20:51:31.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.581+0000 7f7005ffb640 1 -- 172.21.15.52:0/1520893790 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f700c00ac30 con 0x7f7010070fb0 2024-09-15T20:51:31.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.581+0000 7f7005ffb640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f6ff4072ec0 0x7f6ff4075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.581+0000 7f7005ffb640 1 -- 172.21.15.52:0/1520893790 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f700c093a80 con 0x7f7010070fb0 2024-09-15T20:51:31.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.581+0000 7f7014a84640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f6ff4072ec0 0x7f6ff4075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.581+0000 7f7014a84640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f6ff4072ec0 0x7f6ff4075380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7010144270 tx=0x7f7000009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:31.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.585+0000 7f7005ffb640 1 -- 172.21.15.52:0/1520893790 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f700c05ed10 con 0x7f7010070fb0 2024-09-15T20:51:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.753+0000 7f70174e9640 1 -- 172.21.15.52:0/1520893790 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f701013aee0 con 0x7f6ff4072ec0 2024-09-15T20:51:31.762 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.757+0000 7f7005ffb640 1 -- 172.21.15.52:0/1520893790 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117428 (secure 0 0 0) 0x7f701013aee0 con 0x7f6ff4072ec0 2024-09-15T20:51:31.764 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:51:31.764 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-15T20:51:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.761+0000 7f70174e9640 1 -- 172.21.15.52:0/1520893790 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f6ff4072ec0 msgr2=0x7f6ff4075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.765 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.761+0000 7f70174e9640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f6ff4072ec0 0x7f6ff4075380 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7010144270 tx=0x7f7000009040 comp rx=0 tx=0).stop 2024-09-15T20:51:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.761+0000 7f70174e9640 1 -- 172.21.15.52:0/1520893790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7010070fb0 msgr2=0x7f70100b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.761+0000 7f70174e9640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7010070fb0 0x7f70100b1250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f700c00c870 tx=0x7f700c00cd30 comp rx=0 tx=0).stop 2024-09-15T20:51:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.761+0000 7f70174e9640 1 -- 172.21.15.52:0/1520893790 shutdown_connections 2024-09-15T20:51:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.761+0000 7f70174e9640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f6ff4072ec0 0x7f6ff4075380 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.761+0000 7f70174e9640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7010074290 0x7f70101417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.761+0000 7f70174e9640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f70100734a0 0x7f70101dc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.761+0000 7f70174e9640 1 --2- 172.21.15.52:0/1520893790 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7010070fb0 0x7f70100b1250 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.761+0000 7f70174e9640 1 -- 172.21.15.52:0/1520893790 >> 172.21.15.52:0/1520893790 conn(0x7f70100b6300 msgr2=0x7f701013b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:31.766 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.761+0000 7f70174e9640 1 -- 172.21.15.52:0/1520893790 shutdown_connections 2024-09-15T20:51:31.767 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.761+0000 7f70174e9640 1 -- 172.21.15.52:0/1520893790 wait complete. 2024-09-15T20:51:31.783 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-15T20:51:31.292639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3574134075,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":0,"num_read":2563,"num_read_kb":2563,"num_write":159731,"num_write_kb":5637871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161528,"ondisk_log_size":161528,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8554280,"kb_used_data":6692072,"kb_used_omap":12,"kb_used_meta":1862067,"kb_avail":746420440,"statfs":{"total":773094113280,"available":764334530560,"internally_reserved":0,"allocated":6852681728,"data_stored":6847027774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1906757168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":32768,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003296"},"pg_stats":[{"pgid":"3.1f","version":"25'2778","reported_seq":2799,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.633832+0000","last_change":"2024-09-15T20:47:21.015285+0000","last_active":"2024-09-15T20:50:14.633832+0000","last_peered":"2024-09-15T20:50:14.633832+0000","last_clean":"2024-09-15T20:50:14.633832+0000","last_became_active":"2024-09-15T20:47:21.011783+0000","last_became_peered":"2024-09-15T20:47:21.011783+0000","last_unstale":"2024-09-15T20:50:14.633832+0000","last_undegraded":"2024-09-15T20:50:14.633832+0000","last_fullsized":"2024-09-15T20:50:14.633832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2778,"log_dups_size":0,"ondisk_log_size":2778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:05.541594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63045632,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":2788,"num_write_kb":119877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5176","reported_seq":5193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:22.569954+0000","last_change":"2024-09-15T20:47:21.015253+0000","last_active":"2024-09-15T20:50:22.569954+0000","last_peered":"2024-09-15T20:50:22.569954+0000","last_clean":"2024-09-15T20:50:22.569954+0000","last_became_active":"2024-09-15T20:47:21.012740+0000","last_became_peered":"2024-09-15T20:47:21.012740+0000","last_unstale":"2024-09-15T20:50:22.569954+0000","last_undegraded":"2024-09-15T20:50:22.569954+0000","last_fullsized":"2024-09-15T20:50:22.569954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5176,"log_dups_size":0,"ondisk_log_size":5176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:00:44.351671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5153,"num_write_kb":141699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"26'6012","reported_seq":6028,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:28.707096+0000","last_change":"2024-09-15T20:47:21.009274+0000","last_active":"2024-09-15T20:50:28.707096+0000","last_peered":"2024-09-15T20:50:28.707096+0000","last_clean":"2024-09-15T20:50:28.707096+0000","last_became_active":"2024-09-15T20:47:21.008254+0000","last_became_peered":"2024-09-15T20:47:21.008254+0000","last_unstale":"2024-09-15T20:50:28.707096+0000","last_undegraded":"2024-09-15T20:50:28.707096+0000","last_fullsized":"2024-09-15T20:50:28.707096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6012,"log_dups_size":0,"ondisk_log_size":6012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:25.171093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5984,"num_write_kb":200879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"25'3552","reported_seq":3575,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445935+0000","last_change":"2024-09-15T20:47:21.007102+0000","last_active":"2024-09-15T20:51:30.445935+0000","last_peered":"2024-09-15T20:51:30.445935+0000","last_clean":"2024-09-15T20:51:30.445935+0000","last_became_active":"2024-09-15T20:47:21.006831+0000","last_became_peered":"2024-09-15T20:47:21.006831+0000","last_unstale":"2024-09-15T20:51:30.445935+0000","last_undegraded":"2024-09-15T20:51:30.445935+0000","last_fullsized":"2024-09-15T20:51:30.445935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:43.612856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3557,"num_write_kb":160908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"26'2770","reported_seq":2790,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.969699+0000","last_change":"2024-09-15T20:47:21.010908+0000","last_active":"2024-09-15T20:50:14.969699+0000","last_peered":"2024-09-15T20:50:14.969699+0000","last_clean":"2024-09-15T20:50:14.969699+0000","last_became_active":"2024-09-15T20:47:21.009995+0000","last_became_peered":"2024-09-15T20:47:21.009995+0000","last_unstale":"2024-09-15T20:50:14.969699+0000","last_undegraded":"2024-09-15T20:50:14.969699+0000","last_fullsized":"2024-09-15T20:50:14.969699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2770,"log_dups_size":0,"ondisk_log_size":2770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:16.024768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79700496,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":15,"num_read_kb":11,"num_write":2741,"num_write_kb":123666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"26'7925","reported_seq":7958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445548+0000","last_change":"2024-09-15T20:47:21.023842+0000","last_active":"2024-09-15T20:51:30.445548+0000","last_peered":"2024-09-15T20:51:30.445548+0000","last_clean":"2024-09-15T20:51:30.445548+0000","last_became_active":"2024-09-15T20:47:21.023610+0000","last_became_peered":"2024-09-15T20:47:21.023610+0000","last_unstale":"2024-09-15T20:51:30.445548+0000","last_undegraded":"2024-09-15T20:51:30.445548+0000","last_fullsized":"2024-09-15T20:51:30.445548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":7925,"log_dups_size":0,"ondisk_log_size":7925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:29:25.867670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146120704,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":56,"num_read_kb":171,"num_write":7933,"num_write_kb":198258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"26'5268","reported_seq":5295,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:32.418516+0000","last_change":"2024-09-15T20:47:21.007395+0000","last_active":"2024-09-15T20:50:32.418516+0000","last_peered":"2024-09-15T20:50:32.418516+0000","last_clean":"2024-09-15T20:50:32.418516+0000","last_became_active":"2024-09-15T20:47:21.005632+0000","last_became_peered":"2024-09-15T20:47:21.005632+0000","last_unstale":"2024-09-15T20:50:32.418516+0000","last_undegraded":"2024-09-15T20:50:32.418516+0000","last_fullsized":"2024-09-15T20:50:32.418516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:11.496243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":5236,"num_write_kb":197894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"26'6364","reported_seq":6383,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:32.221176+0000","last_change":"2024-09-15T20:47:21.023466+0000","last_active":"2024-09-15T20:50:32.221176+0000","last_peered":"2024-09-15T20:50:32.221176+0000","last_clean":"2024-09-15T20:50:32.221176+0000","last_became_active":"2024-09-15T20:47:21.016879+0000","last_became_peered":"2024-09-15T20:47:21.016879+0000","last_unstale":"2024-09-15T20:50:32.221176+0000","last_undegraded":"2024-09-15T20:50:32.221176+0000","last_fullsized":"2024-09-15T20:50:32.221176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6364,"log_dups_size":0,"ondisk_log_size":6364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:17.404898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":6371,"num_write_kb":181001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"26'6415","reported_seq":6431,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:35.523866+0000","last_change":"2024-09-15T20:47:21.018582+0000","last_active":"2024-09-15T20:50:35.523866+0000","last_peered":"2024-09-15T20:50:35.523866+0000","last_clean":"2024-09-15T20:50:35.523866+0000","last_became_active":"2024-09-15T20:47:21.016813+0000","last_became_peered":"2024-09-15T20:47:21.016813+0000","last_unstale":"2024-09-15T20:50:35.523866+0000","last_undegraded":"2024-09-15T20:50:35.523866+0000","last_fullsized":"2024-09-15T20:50:35.523866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6415,"log_dups_size":0,"ondisk_log_size":6415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T21:41:01.610631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6412,"num_write_kb":184897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"26'3751","reported_seq":3767,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.870226+0000","last_change":"2024-09-15T20:47:21.010645+0000","last_active":"2024-09-15T20:50:14.870226+0000","last_peered":"2024-09-15T20:50:14.870226+0000","last_clean":"2024-09-15T20:50:14.870226+0000","last_became_active":"2024-09-15T20:47:21.010350+0000","last_became_peered":"2024-09-15T20:47:21.010350+0000","last_unstale":"2024-09-15T20:50:14.870226+0000","last_undegraded":"2024-09-15T20:50:14.870226+0000","last_fullsized":"2024-09-15T20:50:14.870226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3751,"log_dups_size":0,"ondisk_log_size":3751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T21:26:17.071795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3727,"num_write_kb":156934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"26'5784","reported_seq":5808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477618+0000","last_change":"2024-09-15T20:47:21.017244+0000","last_active":"2024-09-15T20:51:30.477618+0000","last_peered":"2024-09-15T20:51:30.477618+0000","last_clean":"2024-09-15T20:51:30.477618+0000","last_became_active":"2024-09-15T20:47:21.016999+0000","last_became_peered":"2024-09-15T20:47:21.016999+0000","last_unstale":"2024-09-15T20:51:30.477618+0000","last_undegraded":"2024-09-15T20:51:30.477618+0000","last_fullsized":"2024-09-15T20:51:30.477618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5784,"log_dups_size":0,"ondisk_log_size":5784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:18.918849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":5791,"num_write_kb":176448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"26'6373","reported_seq":6401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:25.303453+0000","last_change":"2024-09-15T20:47:21.010964+0000","last_active":"2024-09-15T20:50:25.303453+0000","last_peered":"2024-09-15T20:50:25.303453+0000","last_clean":"2024-09-15T20:50:25.303453+0000","last_became_active":"2024-09-15T20:47:21.010694+0000","last_became_peered":"2024-09-15T20:47:21.010694+0000","last_unstale":"2024-09-15T20:50:25.303453+0000","last_undegraded":"2024-09-15T20:50:25.303453+0000","last_fullsized":"2024-09-15T20:50:25.303453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6373,"log_dups_size":0,"ondisk_log_size":6373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:44.740081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":6347,"num_write_kb":171391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.577247+0000","last_change":"2024-09-15T20:47:14.474673+0000","last_active":"2024-09-15T20:50:14.577247+0000","last_peered":"2024-09-15T20:50:14.577247+0000","last_clean":"2024-09-15T20:50:14.577247+0000","last_became_active":"2024-09-15T20:47:12.471373+0000","last_became_peered":"2024-09-15T20:47:12.471373+0000","last_unstale":"2024-09-15T20:50:14.577247+0000","last_undegraded":"2024-09-15T20:50:14.577247+0000","last_fullsized":"2024-09-15T20:50:14.577247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:47.666907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018866289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'6610","reported_seq":6628,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:51:19.805553+0000","last_change":"2024-09-15T20:47:21.019817+0000","last_active":"2024-09-15T20:51:19.805553+0000","last_peered":"2024-09-15T20:51:19.805553+0000","last_clean":"2024-09-15T20:51:19.805553+0000","last_became_active":"2024-09-15T20:47:21.019020+0000","last_became_peered":"2024-09-15T20:47:21.019020+0000","last_unstale":"2024-09-15T20:51:19.805553+0000","last_undegraded":"2024-09-15T20:51:19.805553+0000","last_fullsized":"2024-09-15T20:51:19.805553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6610,"log_dups_size":0,"ondisk_log_size":6610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:33.686995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137986560,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6595,"num_write_kb":207131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.579788+0000","last_change":"2024-09-15T20:47:14.472821+0000","last_active":"2024-09-15T20:50:14.579788+0000","last_peered":"2024-09-15T20:50:14.579788+0000","last_clean":"2024-09-15T20:50:14.579788+0000","last_became_active":"2024-09-15T20:47:12.468530+0000","last_became_peered":"2024-09-15T20:47:12.468530+0000","last_unstale":"2024-09-15T20:50:14.579788+0000","last_undegraded":"2024-09-15T20:50:14.579788+0000","last_fullsized":"2024-09-15T20:50:14.579788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:33.831606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000891339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4891","reported_seq":4918,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.969875+0000","last_change":"2024-09-15T20:47:21.021835+0000","last_active":"2024-09-15T20:50:14.969875+0000","last_peered":"2024-09-15T20:50:14.969875+0000","last_clean":"2024-09-15T20:50:14.969875+0000","last_became_active":"2024-09-15T20:47:21.021031+0000","last_became_peered":"2024-09-15T20:47:21.021031+0000","last_unstale":"2024-09-15T20:50:14.969875+0000","last_undegraded":"2024-09-15T20:50:14.969875+0000","last_fullsized":"2024-09-15T20:50:14.969875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4891,"log_dups_size":0,"ondisk_log_size":4891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:21.527979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":4866,"num_write_kb":218628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.577645+0000","last_change":"2024-09-15T20:47:14.475000+0000","last_active":"2024-09-15T20:50:14.577645+0000","last_peered":"2024-09-15T20:50:14.577645+0000","last_clean":"2024-09-15T20:50:14.577645+0000","last_became_active":"2024-09-15T20:47:12.461531+0000","last_became_peered":"2024-09-15T20:47:12.461531+0000","last_unstale":"2024-09-15T20:50:14.577645+0000","last_undegraded":"2024-09-15T20:50:14.577645+0000","last_fullsized":"2024-09-15T20:50:14.577645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:28.018623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022230399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'8341","reported_seq":8401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:34.363218+0000","last_change":"2024-09-15T20:47:21.026683+0000","last_active":"2024-09-15T20:50:34.363218+0000","last_peered":"2024-09-15T20:50:34.363218+0000","last_clean":"2024-09-15T20:50:34.363218+0000","last_became_active":"2024-09-15T20:47:21.025918+0000","last_became_peered":"2024-09-15T20:47:21.025918+0000","last_unstale":"2024-09-15T20:50:34.363218+0000","last_undegraded":"2024-09-15T20:50:34.363218+0000","last_fullsized":"2024-09-15T20:50:34.363218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":8341,"log_dups_size":0,"ondisk_log_size":8341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:52.672994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135988904,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":174,"num_read_kb":136,"num_write":8413,"num_write_kb":232061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.636018+0000","last_change":"2024-09-15T20:47:14.986335+0000","last_active":"2024-09-15T20:50:14.636018+0000","last_peered":"2024-09-15T20:50:14.636018+0000","last_clean":"2024-09-15T20:50:14.636018+0000","last_became_active":"2024-09-15T20:47:12.468184+0000","last_became_peered":"2024-09-15T20:47:12.468184+0000","last_unstale":"2024-09-15T20:50:14.636018+0000","last_undegraded":"2024-09-15T20:50:14.636018+0000","last_fullsized":"2024-09-15T20:50:14.636018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:30.408559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001176739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'4297","reported_seq":4324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:51:19.808832+0000","last_change":"2024-09-15T20:47:21.018098+0000","last_active":"2024-09-15T20:51:19.808832+0000","last_peered":"2024-09-15T20:51:19.808832+0000","last_clean":"2024-09-15T20:51:19.808832+0000","last_became_active":"2024-09-15T20:47:21.017736+0000","last_became_peered":"2024-09-15T20:47:21.017736+0000","last_unstale":"2024-09-15T20:51:19.808832+0000","last_undegraded":"2024-09-15T20:51:19.808832+0000","last_fullsized":"2024-09-15T20:51:19.808832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4297,"log_dups_size":0,"ondisk_log_size":4297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:38.019405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78276432,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":24,"num_read_kb":82,"num_write":4316,"num_write_kb":145640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"25'5330","reported_seq":5348,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477548+0000","last_change":"2024-09-15T20:47:21.009225+0000","last_active":"2024-09-15T20:51:30.477548+0000","last_peered":"2024-09-15T20:51:30.477548+0000","last_clean":"2024-09-15T20:51:30.477548+0000","last_became_active":"2024-09-15T20:47:21.008994+0000","last_became_peered":"2024-09-15T20:47:21.008994+0000","last_unstale":"2024-09-15T20:51:30.477548+0000","last_undegraded":"2024-09-15T20:51:30.477548+0000","last_fullsized":"2024-09-15T20:51:30.477548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5330,"log_dups_size":0,"ondisk_log_size":5330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:01.453378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5329,"num_write_kb":197895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.576694+0000","last_change":"2024-09-15T20:47:14.474210+0000","last_active":"2024-09-15T20:50:14.576694+0000","last_peered":"2024-09-15T20:50:14.576694+0000","last_clean":"2024-09-15T20:50:14.576694+0000","last_became_active":"2024-09-15T20:47:12.471091+0000","last_became_peered":"2024-09-15T20:47:12.471091+0000","last_unstale":"2024-09-15T20:50:14.576694+0000","last_undegraded":"2024-09-15T20:50:14.576694+0000","last_fullsized":"2024-09-15T20:50:14.576694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:42.228249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530579999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"26'3415","reported_seq":3542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.973637+0000","last_change":"2024-09-15T20:47:21.024516+0000","last_active":"2024-09-15T20:50:14.973637+0000","last_peered":"2024-09-15T20:50:14.973637+0000","last_clean":"2024-09-15T20:50:14.973637+0000","last_became_active":"2024-09-15T20:47:21.023619+0000","last_became_peered":"2024-09-15T20:47:21.023619+0000","last_unstale":"2024-09-15T20:50:14.973637+0000","last_undegraded":"2024-09-15T20:50:14.973637+0000","last_fullsized":"2024-09-15T20:50:14.973637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3415,"log_dups_size":0,"ondisk_log_size":3415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:18.323622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371536,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":138,"num_read_kb":254,"num_write":3502,"num_write_kb":132957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.563348+0000","last_change":"2024-09-15T20:47:14.986963+0000","last_active":"2024-09-15T20:50:14.563348+0000","last_peered":"2024-09-15T20:50:14.563348+0000","last_clean":"2024-09-15T20:50:14.563348+0000","last_became_active":"2024-09-15T20:47:12.462360+0000","last_became_peered":"2024-09-15T20:47:12.462360+0000","last_unstale":"2024-09-15T20:50:14.563348+0000","last_undegraded":"2024-09-15T20:50:14.563348+0000","last_fullsized":"2024-09-15T20:50:14.563348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:39.175611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011324970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"26'3755","reported_seq":3771,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.878523+0000","last_change":"2024-09-15T20:47:21.018553+0000","last_active":"2024-09-15T20:50:14.878523+0000","last_peered":"2024-09-15T20:50:14.878523+0000","last_clean":"2024-09-15T20:50:14.878523+0000","last_became_active":"2024-09-15T20:47:21.017058+0000","last_became_peered":"2024-09-15T20:47:21.017058+0000","last_unstale":"2024-09-15T20:50:14.878523+0000","last_undegraded":"2024-09-15T20:50:14.878523+0000","last_fullsized":"2024-09-15T20:50:14.878523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3755,"log_dups_size":0,"ondisk_log_size":3755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:15.985307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3728,"num_write_kb":173059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.576395+0000","last_change":"2024-09-15T20:47:14.473959+0000","last_active":"2024-09-15T20:50:14.576395+0000","last_peered":"2024-09-15T20:50:14.576395+0000","last_clean":"2024-09-15T20:50:14.576395+0000","last_became_active":"2024-09-15T20:47:12.463812+0000","last_became_peered":"2024-09-15T20:47:12.463812+0000","last_unstale":"2024-09-15T20:50:14.576395+0000","last_undegraded":"2024-09-15T20:50:14.576395+0000","last_fullsized":"2024-09-15T20:50:14.576395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:19.954840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001226357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"26'4114","reported_seq":4130,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:30.062153+0000","last_change":"2024-09-15T20:47:21.006238+0000","last_active":"2024-09-15T20:50:30.062153+0000","last_peered":"2024-09-15T20:50:30.062153+0000","last_clean":"2024-09-15T20:50:30.062153+0000","last_became_active":"2024-09-15T20:47:21.005584+0000","last_became_peered":"2024-09-15T20:47:21.005584+0000","last_unstale":"2024-09-15T20:50:30.062153+0000","last_undegraded":"2024-09-15T20:50:30.062153+0000","last_fullsized":"2024-09-15T20:50:30.062153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4114,"log_dups_size":0,"ondisk_log_size":4114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:22.836701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4109,"num_write_kb":152323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.577590+0000","last_change":"2024-09-15T20:47:14.475335+0000","last_active":"2024-09-15T20:50:14.577590+0000","last_peered":"2024-09-15T20:50:14.577590+0000","last_clean":"2024-09-15T20:50:14.577590+0000","last_became_active":"2024-09-15T20:47:12.469021+0000","last_became_peered":"2024-09-15T20:47:12.469021+0000","last_unstale":"2024-09-15T20:50:14.577590+0000","last_undegraded":"2024-09-15T20:50:14.577590+0000","last_fullsized":"2024-09-15T20:50:14.577590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:19.117864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025466540000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445172+0000","last_change":"2024-09-15T20:47:07.291789+0000","last_active":"2024-09-15T20:51:30.445172+0000","last_peered":"2024-09-15T20:51:30.445172+0000","last_clean":"2024-09-15T20:51:30.445172+0000","last_became_active":"2024-09-15T20:47:07.289970+0000","last_became_peered":"2024-09-15T20:47:07.289970+0000","last_unstale":"2024-09-15T20:51:30.445172+0000","last_undegraded":"2024-09-15T20:51:30.445172+0000","last_fullsized":"2024-09-15T20:51:30.445172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:05.400631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:05.400631+0000","last_clean_scrub_stamp":"2024-09-15T20:47:05.400631+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:27.776984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"26'3475","reported_seq":3491,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.987842+0000","last_change":"2024-09-15T20:47:21.018143+0000","last_active":"2024-09-15T20:50:14.987842+0000","last_peered":"2024-09-15T20:50:14.987842+0000","last_clean":"2024-09-15T20:50:14.987842+0000","last_became_active":"2024-09-15T20:47:21.017326+0000","last_became_peered":"2024-09-15T20:47:21.017326+0000","last_unstale":"2024-09-15T20:50:14.987842+0000","last_undegraded":"2024-09-15T20:50:14.987842+0000","last_fullsized":"2024-09-15T20:50:14.987842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:39.169392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3405,"num_write_kb":176771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"26'8068","reported_seq":8190,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:33.356575+0000","last_change":"2024-09-15T20:47:21.005970+0000","last_active":"2024-09-15T20:50:33.356575+0000","last_peered":"2024-09-15T20:50:33.356575+0000","last_clean":"2024-09-15T20:50:33.356575+0000","last_became_active":"2024-09-15T20:47:21.005684+0000","last_became_peered":"2024-09-15T20:47:21.005684+0000","last_unstale":"2024-09-15T20:50:33.356575+0000","last_undegraded":"2024-09-15T20:50:33.356575+0000","last_fullsized":"2024-09-15T20:50:33.356575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":8068,"log_dups_size":0,"ondisk_log_size":8068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:57.048864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104858112,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":356,"num_read_kb":316,"num_write":6023,"num_write_kb":166026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"26'6134","reported_seq":6174,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:34.593906+0000","last_change":"2024-09-15T20:47:21.006726+0000","last_active":"2024-09-15T20:50:34.593906+0000","last_peered":"2024-09-15T20:50:34.593906+0000","last_clean":"2024-09-15T20:50:34.593906+0000","last_became_active":"2024-09-15T20:47:21.006304+0000","last_became_peered":"2024-09-15T20:47:21.006304+0000","last_unstale":"2024-09-15T20:50:34.593906+0000","last_undegraded":"2024-09-15T20:50:34.593906+0000","last_fullsized":"2024-09-15T20:50:34.593906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6134,"log_dups_size":0,"ondisk_log_size":6134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:22.106814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138543632,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":97,"num_read_kb":78,"num_write":6159,"num_write_kb":180177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"25'4305","reported_seq":4322,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.563227+0000","last_change":"2024-09-15T20:47:21.026764+0000","last_active":"2024-09-15T20:50:14.563227+0000","last_peered":"2024-09-15T20:50:14.563227+0000","last_clean":"2024-09-15T20:50:14.563227+0000","last_became_active":"2024-09-15T20:47:21.025992+0000","last_became_peered":"2024-09-15T20:47:21.025992+0000","last_unstale":"2024-09-15T20:50:14.563227+0000","last_undegraded":"2024-09-15T20:50:14.563227+0000","last_fullsized":"2024-09-15T20:50:14.563227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4305,"log_dups_size":0,"ondisk_log_size":4305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:34.126386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113312264,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4307,"num_write_kb":192020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"27'2811","reported_seq":2829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.521390+0000","last_change":"2024-09-15T20:47:21.019750+0000","last_active":"2024-09-15T20:51:30.521390+0000","last_peered":"2024-09-15T20:51:30.521390+0000","last_clean":"2024-09-15T20:51:30.521390+0000","last_became_active":"2024-09-15T20:47:21.019431+0000","last_became_peered":"2024-09-15T20:47:21.019431+0000","last_unstale":"2024-09-15T20:51:30.521390+0000","last_undegraded":"2024-09-15T20:51:30.521390+0000","last_fullsized":"2024-09-15T20:51:30.521390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2811,"log_dups_size":0,"ondisk_log_size":2811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:09.223242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69863248,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2764,"num_write_kb":138455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"26'3208","reported_seq":3226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.866246+0000","last_change":"2024-09-15T20:47:21.002739+0000","last_active":"2024-09-15T20:50:14.866246+0000","last_peered":"2024-09-15T20:50:14.866246+0000","last_clean":"2024-09-15T20:50:14.866246+0000","last_became_active":"2024-09-15T20:47:21.002454+0000","last_became_peered":"2024-09-15T20:47:21.002454+0000","last_unstale":"2024-09-15T20:50:14.866246+0000","last_undegraded":"2024-09-15T20:50:14.866246+0000","last_fullsized":"2024-09-15T20:50:14.866246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:03.783169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111936016,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":3190,"num_write_kb":137614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"26'5657","reported_seq":6052,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:15.049278+0000","last_change":"2024-09-15T20:47:21.008704+0000","last_active":"2024-09-15T20:50:15.049278+0000","last_peered":"2024-09-15T20:50:15.049278+0000","last_clean":"2024-09-15T20:50:15.049278+0000","last_became_active":"2024-09-15T20:47:21.007899+0000","last_became_peered":"2024-09-15T20:47:21.007899+0000","last_unstale":"2024-09-15T20:50:15.049278+0000","last_undegraded":"2024-09-15T20:50:15.049278+0000","last_fullsized":"2024-09-15T20:50:15.049278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5657,"log_dups_size":0,"ondisk_log_size":5657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:28.324549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114958864,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1304,"num_read_kb":1127,"num_write":6119,"num_write_kb":191597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'4887","reported_seq":4908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.520257+0000","last_change":"2024-09-15T20:47:21.009343+0000","last_active":"2024-09-15T20:51:30.520257+0000","last_peered":"2024-09-15T20:51:30.520257+0000","last_clean":"2024-09-15T20:51:30.520257+0000","last_became_active":"2024-09-15T20:47:21.008922+0000","last_became_peered":"2024-09-15T20:47:21.008922+0000","last_unstale":"2024-09-15T20:51:30.520257+0000","last_undegraded":"2024-09-15T20:51:30.520257+0000","last_fullsized":"2024-09-15T20:51:30.520257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4887,"log_dups_size":0,"ondisk_log_size":4887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:30.517648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":4843,"num_write_kb":242701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'5581","reported_seq":5599,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445098+0000","last_change":"2024-09-15T20:47:21.028647+0000","last_active":"2024-09-15T20:51:30.445098+0000","last_peered":"2024-09-15T20:51:30.445098+0000","last_clean":"2024-09-15T20:51:30.445098+0000","last_became_active":"2024-09-15T20:47:21.028396+0000","last_became_peered":"2024-09-15T20:47:21.028396+0000","last_unstale":"2024-09-15T20:51:30.445098+0000","last_undegraded":"2024-09-15T20:51:30.445098+0000","last_fullsized":"2024-09-15T20:51:30.445098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5581,"log_dups_size":0,"ondisk_log_size":5581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:45.063111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149618688,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5530,"num_write_kb":231368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"25'3819","reported_seq":3843,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.576279+0000","last_change":"2024-09-15T20:47:21.009991+0000","last_active":"2024-09-15T20:50:14.576279+0000","last_peered":"2024-09-15T20:50:14.576279+0000","last_clean":"2024-09-15T20:50:14.576279+0000","last_became_active":"2024-09-15T20:47:21.009741+0000","last_became_peered":"2024-09-15T20:47:21.009741+0000","last_unstale":"2024-09-15T20:50:14.576279+0000","last_undegraded":"2024-09-15T20:50:14.576279+0000","last_fullsized":"2024-09-15T20:50:14.576279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3819,"log_dups_size":0,"ondisk_log_size":3819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T20:50:34.892506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130680656,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":3826,"num_write_kb":196699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'2664","reported_seq":2704,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.967125+0000","last_change":"2024-09-15T20:47:21.015487+0000","last_active":"2024-09-15T20:50:14.967125+0000","last_peered":"2024-09-15T20:50:14.967125+0000","last_clean":"2024-09-15T20:50:14.967125+0000","last_became_active":"2024-09-15T20:47:21.012712+0000","last_became_peered":"2024-09-15T20:47:21.012712+0000","last_unstale":"2024-09-15T20:50:14.967125+0000","last_undegraded":"2024-09-15T20:50:14.967125+0000","last_fullsized":"2024-09-15T20:50:14.967125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2664,"log_dups_size":0,"ondisk_log_size":2664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:01.394914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080896,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":94,"num_read_kb":81,"num_write":2658,"num_write_kb":115655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"26'7923","reported_seq":7940,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:27.449463+0000","last_change":"2024-09-15T20:47:21.012518+0000","last_active":"2024-09-15T20:50:27.449463+0000","last_peered":"2024-09-15T20:50:27.449463+0000","last_clean":"2024-09-15T20:50:27.449463+0000","last_became_active":"2024-09-15T20:47:21.012087+0000","last_became_peered":"2024-09-15T20:47:21.012087+0000","last_unstale":"2024-09-15T20:50:27.449463+0000","last_undegraded":"2024-09-15T20:50:27.449463+0000","last_fullsized":"2024-09-15T20:50:27.449463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":7923,"log_dups_size":0,"ondisk_log_size":7923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:50.852789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125895176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":7906,"num_write_kb":193612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3573543688,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":0,"num_read":2497,"num_read_kb":2508,"num_write":159628,"num_write_kb":5636241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6849433600,"data_stored":6845163144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161453,"ondisk_log_size":161453,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555500,"kb_used_data":474332,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":93816340,"statfs":{"total":96636764160,"available":96067932160,"internally_reserved":0,"allocated":485715968,"data_stored":485307172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":83098058},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509497,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1212960,"kb_used_data":938896,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93158880,"statfs":{"total":96636764160,"available":95394693120,"internally_reserved":0,"allocated":961429504,"data_stored":960571724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1182172,"kb_used_data":926156,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93189668,"statfs":{"total":96636764160,"available":95426220032,"internally_reserved":0,"allocated":948383744,"data_stored":947692488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1023460,"kb_used_data":807700,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":93348380,"statfs":{"total":96636764160,"available":95588741120,"internally_reserved":0,"allocated":827084800,"data_stored":826445331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220920262},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1064716,"kb_used_data":821180,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":93307124,"statfs":{"total":96636764160,"available":95546494976,"internally_reserved":0,"allocated":840888320,"data_stored":840202232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":923192,"kb_used_data":721320,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":93448648,"statfs":{"total":96636764160,"available":95691415552,"internally_reserved":0,"allocated":738631680,"data_stored":738005624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206698949},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542199,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1364792,"kb_used_data":1067112,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":93007048,"statfs":{"total":96636764160,"available":95239217152,"internally_reserved":0,"allocated":1092722688,"data_stored":1091855327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":304806343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1227488,"kb_used_data":935376,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93144352,"statfs":{"total":96636764160,"available":95379816448,"internally_reserved":0,"allocated":957825024,"data_stored":956947876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":948101120,"data_stored":947584016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":960626688,"data_stored":959943044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":957554688,"data_stored":956848124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1092448256,"data_stored":1091755556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":738361344,"data_stored":737905872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":840085504,"data_stored":839573552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":826810368,"data_stored":826345560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":485445632,"data_stored":485207420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T20:51:31.786 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T20:51:31.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T20:51:31.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f536ec5e640 1 Processor -- start 2024-09-15T20:51:31.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f536ec5e640 1 -- start start 2024-09-15T20:51:31.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f536ec5e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5368076390 0x7f5368073e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f536ec5e640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5368076770 con 0x7f5368072f00 2024-09-15T20:51:31.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f536ec5e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53680b26a0 con 0x7f5368073450 2024-09-15T20:51:31.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f536ec5e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5368073970 con 0x7f5368076390 2024-09-15T20:51:31.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f536d1fb640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5368072f00 0x7f5368143c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57260/0 (socket says 172.21.15.52:57260) 2024-09-15T20:51:31.905 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f536d1fb640 1 -- 172.21.15.52:0/3673288507 learned_addr learned my addr 172.21.15.52:0/3673288507 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:31.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f536c9fa640 1 --2- 172.21.15.52:0/3673288507 >> v2:172.21.15.52:3300/0 conn(0x7f5368076390 0x7f5368073e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f536c9fa640 1 -- 172.21.15.52:0/3673288507 >> v1:172.21.15.81:6789/0 conn(0x7f5368073450 legacy=0x7f536813d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f536c9fa640 1 -- 172.21.15.52:0/3673288507 >> v1:172.21.15.52:6789/0 conn(0x7f5368072f00 legacy=0x7f5368143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f536c9fa640 1 -- 172.21.15.52:0/3673288507 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536813e020 con 0x7f5368076390 2024-09-15T20:51:31.906 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.901+0000 7f53677fe640 1 -- 172.21.15.52:0/3673288507 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 469058653 0 0) 0x7f53600014a0 con 0x7f5368072f00 2024-09-15T20:51:31.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536c9fa640 1 --2- 172.21.15.52:0/3673288507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5368076390 0x7f5368073e90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f53580097c0 tx=0x7f535801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3b8e60f71494c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:31.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f53677fe640 1 -- 172.21.15.52:0/3673288507 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53580b0070 con 0x7f5368076390 2024-09-15T20:51:31.907 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f53677fe640 1 -- 172.21.15.52:0/3673288507 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53580ab600 con 0x7f5368076390 2024-09-15T20:51:31.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f53677fe640 1 -- 172.21.15.52:0/3673288507 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53580ab9d0 con 0x7f5368076390 2024-09-15T20:51:31.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 -- 172.21.15.52:0/3673288507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5368076390 msgr2=0x7f5368073e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 --2- 172.21.15.52:0/3673288507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5368076390 0x7f5368073e90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f53580097c0 tx=0x7f535801c480 comp rx=0 tx=0).stop 2024-09-15T20:51:31.908 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 -- 172.21.15.52:0/3673288507 shutdown_connections 2024-09-15T20:51:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 --2- 172.21.15.52:0/3673288507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5368076390 0x7f5368073e90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 -- 172.21.15.52:0/3673288507 >> 172.21.15.52:0/3673288507 conn(0x7f53680b6300 msgr2=0x7f53680b6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 -- 172.21.15.52:0/3673288507 shutdown_connections 2024-09-15T20:51:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 -- 172.21.15.52:0/3673288507 wait complete. 2024-09-15T20:51:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 Processor -- start 2024-09-15T20:51:31.909 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 -- start start 2024-09-15T20:51:31.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368072f00 0x7f536813eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5368073450 0x7f5368146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5368076390 0x7f5368146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5368151f90 con 0x7f5368073450 2024-09-15T20:51:31.911 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5368144560 con 0x7f5368072f00 2024-09-15T20:51:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f5368152110 con 0x7f5368076390 2024-09-15T20:51:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f5367fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5368073450 0x7f5368146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536d1fb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5368076390 0x7f5368146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f5367fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5368073450 0x7f5368146110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33002/0 (socket says 172.21.15.52:33002) 2024-09-15T20:51:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f5367fff640 1 -- 172.21.15.52:0/2363849200 learned_addr learned my addr 172.21.15.52:0/2363849200 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536d1fb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5368076390 0x7f5368146650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46642/0 (socket says 172.21.15.52:46642) 2024-09-15T20:51:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536c9fa640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368072f00 0x7f536813eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.912 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536d1fb640 1 -- 172.21.15.52:0/2363849200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368072f00 msgr2=0x7f536813eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536d1fb640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368072f00 0x7f536813eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536d1fb640 1 -- 172.21.15.52:0/2363849200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5368073450 msgr2=0x7f5368146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536d1fb640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5368073450 0x7f5368146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536d1fb640 1 -- 172.21.15.52:0/2363849200 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5368146b90 con 0x7f5368076390 2024-09-15T20:51:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536c9fa640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368072f00 0x7f536813eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:51:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536d1fb640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5368076390 0x7f5368146650 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5360001780 tx=0x7f536000cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f53657fa640 1 -- 172.21.15.52:0/2363849200 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360018070 con 0x7f5368076390 2024-09-15T20:51:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f53657fa640 1 -- 172.21.15.52:0/2363849200 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5360004d90 con 0x7f5368076390 2024-09-15T20:51:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f536ec5e640 1 -- 172.21.15.52:0/2363849200 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53681410c0 con 0x7f5368076390 2024-09-15T20:51:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.905+0000 7f53657fa640 1 -- 172.21.15.52:0/2363849200 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536000a850 con 0x7f5368076390 2024-09-15T20:51:31.913 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.909+0000 7f536ec5e640 1 -- 172.21.15.52:0/2363849200 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f536813fbb0 con 0x7f5368076390 2024-09-15T20:51:31.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.909+0000 7f536ec5e640 1 -- 172.21.15.52:0/2363849200 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f536813f890 con 0x7f5368076390 2024-09-15T20:51:31.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.909+0000 7f53657fa640 1 -- 172.21.15.52:0/2363849200 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f536001b070 con 0x7f5368076390 2024-09-15T20:51:31.914 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.909+0000 7f53657fa640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5354072ec0 0x7f5354075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:31.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.909+0000 7f53657fa640 1 -- 172.21.15.52:0/2363849200 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f5360093180 con 0x7f5368076390 2024-09-15T20:51:31.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.909+0000 7f536c9fa640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5354072ec0 0x7f5354075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:31.915 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.909+0000 7f536c9fa640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5354072ec0 0x7f5354075380 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f53580ad000 tx=0x7f53580a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:31.917 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:31.913+0000 7f53657fa640 1 -- 172.21.15.52:0/2363849200 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f536813f890 con 0x7f5368076390 2024-09-15T20:51:32.081 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.077+0000 7f536ec5e640 1 -- 172.21.15.52:0/2363849200 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5368139e50 con 0x7f5354072ec0 2024-09-15T20:51:32.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f53657fa640 1 -- 172.21.15.52:0/2363849200 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117428 (secure 0 0 0) 0x7f53580ab660 con 0x7f5354072ec0 2024-09-15T20:51:32.089 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:51:32.089 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-15T20:51:32.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f536ec5e640 1 -- 172.21.15.52:0/2363849200 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5354072ec0 msgr2=0x7f5354075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:32.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f536ec5e640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5354072ec0 0x7f5354075380 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f53580ad000 tx=0x7f53580a6000 comp rx=0 tx=0).stop 2024-09-15T20:51:32.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f536ec5e640 1 -- 172.21.15.52:0/2363849200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5368076390 msgr2=0x7f5368146650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:32.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f536ec5e640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5368076390 0x7f5368146650 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5360001780 tx=0x7f536000cb90 comp rx=0 tx=0).stop 2024-09-15T20:51:32.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f536ec5e640 1 -- 172.21.15.52:0/2363849200 shutdown_connections 2024-09-15T20:51:32.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f536ec5e640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5354072ec0 0x7f5354075380 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f536ec5e640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5368076390 0x7f5368146650 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f536ec5e640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5368073450 0x7f5368146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f536ec5e640 1 --2- 172.21.15.52:0/2363849200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5368072f00 0x7f536813eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f536ec5e640 1 -- 172.21.15.52:0/2363849200 >> 172.21.15.52:0/2363849200 conn(0x7f53680b6300 msgr2=0x7f536813a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:32.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f536ec5e640 1 -- 172.21.15.52:0/2363849200 shutdown_connections 2024-09-15T20:51:32.093 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.085+0000 7f536ec5e640 1 -- 172.21.15.52:0/2363849200 wait complete. 2024-09-15T20:51:32.106 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-15T20:51:31.292639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3574134075,"num_objects":884,"num_object_clones":0,"num_object_copies":1768,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":884,"num_whiteouts":0,"num_read":2563,"num_read_kb":2563,"num_write":159731,"num_write_kb":5637871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161528,"ondisk_log_size":161528,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8554280,"kb_used_data":6692072,"kb_used_omap":12,"kb_used_meta":1862067,"kb_avail":746420440,"statfs":{"total":773094113280,"available":764334530560,"internally_reserved":0,"allocated":6852681728,"data_stored":6847027774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1906757168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":32768,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003296"},"pg_stats":[{"pgid":"3.1f","version":"25'2778","reported_seq":2799,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.633832+0000","last_change":"2024-09-15T20:47:21.015285+0000","last_active":"2024-09-15T20:50:14.633832+0000","last_peered":"2024-09-15T20:50:14.633832+0000","last_clean":"2024-09-15T20:50:14.633832+0000","last_became_active":"2024-09-15T20:47:21.011783+0000","last_became_peered":"2024-09-15T20:47:21.011783+0000","last_unstale":"2024-09-15T20:50:14.633832+0000","last_undegraded":"2024-09-15T20:50:14.633832+0000","last_fullsized":"2024-09-15T20:50:14.633832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2778,"log_dups_size":0,"ondisk_log_size":2778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:05.541594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63045632,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":2788,"num_write_kb":119877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"26'5176","reported_seq":5193,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:22.569954+0000","last_change":"2024-09-15T20:47:21.015253+0000","last_active":"2024-09-15T20:50:22.569954+0000","last_peered":"2024-09-15T20:50:22.569954+0000","last_clean":"2024-09-15T20:50:22.569954+0000","last_became_active":"2024-09-15T20:47:21.012740+0000","last_became_peered":"2024-09-15T20:47:21.012740+0000","last_unstale":"2024-09-15T20:50:22.569954+0000","last_undegraded":"2024-09-15T20:50:22.569954+0000","last_fullsized":"2024-09-15T20:50:22.569954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5176,"log_dups_size":0,"ondisk_log_size":5176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:00:44.351671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5153,"num_write_kb":141699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"26'6012","reported_seq":6028,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:28.707096+0000","last_change":"2024-09-15T20:47:21.009274+0000","last_active":"2024-09-15T20:50:28.707096+0000","last_peered":"2024-09-15T20:50:28.707096+0000","last_clean":"2024-09-15T20:50:28.707096+0000","last_became_active":"2024-09-15T20:47:21.008254+0000","last_became_peered":"2024-09-15T20:47:21.008254+0000","last_unstale":"2024-09-15T20:50:28.707096+0000","last_undegraded":"2024-09-15T20:50:28.707096+0000","last_fullsized":"2024-09-15T20:50:28.707096+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6012,"log_dups_size":0,"ondisk_log_size":6012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:25.171093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5984,"num_write_kb":200879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"25'3552","reported_seq":3575,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445935+0000","last_change":"2024-09-15T20:47:21.007102+0000","last_active":"2024-09-15T20:51:30.445935+0000","last_peered":"2024-09-15T20:51:30.445935+0000","last_clean":"2024-09-15T20:51:30.445935+0000","last_became_active":"2024-09-15T20:47:21.006831+0000","last_became_peered":"2024-09-15T20:47:21.006831+0000","last_unstale":"2024-09-15T20:51:30.445935+0000","last_undegraded":"2024-09-15T20:51:30.445935+0000","last_fullsized":"2024-09-15T20:51:30.445935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:43.612856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3557,"num_write_kb":160908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"26'2770","reported_seq":2790,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.969699+0000","last_change":"2024-09-15T20:47:21.010908+0000","last_active":"2024-09-15T20:50:14.969699+0000","last_peered":"2024-09-15T20:50:14.969699+0000","last_clean":"2024-09-15T20:50:14.969699+0000","last_became_active":"2024-09-15T20:47:21.009995+0000","last_became_peered":"2024-09-15T20:47:21.009995+0000","last_unstale":"2024-09-15T20:50:14.969699+0000","last_undegraded":"2024-09-15T20:50:14.969699+0000","last_fullsized":"2024-09-15T20:50:14.969699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2770,"log_dups_size":0,"ondisk_log_size":2770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:16.024768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79700496,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":15,"num_read_kb":11,"num_write":2741,"num_write_kb":123666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"26'7925","reported_seq":7958,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445548+0000","last_change":"2024-09-15T20:47:21.023842+0000","last_active":"2024-09-15T20:51:30.445548+0000","last_peered":"2024-09-15T20:51:30.445548+0000","last_clean":"2024-09-15T20:51:30.445548+0000","last_became_active":"2024-09-15T20:47:21.023610+0000","last_became_peered":"2024-09-15T20:47:21.023610+0000","last_unstale":"2024-09-15T20:51:30.445548+0000","last_undegraded":"2024-09-15T20:51:30.445548+0000","last_fullsized":"2024-09-15T20:51:30.445548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":7925,"log_dups_size":0,"ondisk_log_size":7925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:29:25.867670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146120704,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":56,"num_read_kb":171,"num_write":7933,"num_write_kb":198258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"26'5268","reported_seq":5295,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:32.418516+0000","last_change":"2024-09-15T20:47:21.007395+0000","last_active":"2024-09-15T20:50:32.418516+0000","last_peered":"2024-09-15T20:50:32.418516+0000","last_clean":"2024-09-15T20:50:32.418516+0000","last_became_active":"2024-09-15T20:47:21.005632+0000","last_became_peered":"2024-09-15T20:47:21.005632+0000","last_unstale":"2024-09-15T20:50:32.418516+0000","last_undegraded":"2024-09-15T20:50:32.418516+0000","last_fullsized":"2024-09-15T20:50:32.418516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5268,"log_dups_size":0,"ondisk_log_size":5268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:11.496243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":5236,"num_write_kb":197894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"26'6364","reported_seq":6383,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:32.221176+0000","last_change":"2024-09-15T20:47:21.023466+0000","last_active":"2024-09-15T20:50:32.221176+0000","last_peered":"2024-09-15T20:50:32.221176+0000","last_clean":"2024-09-15T20:50:32.221176+0000","last_became_active":"2024-09-15T20:47:21.016879+0000","last_became_peered":"2024-09-15T20:47:21.016879+0000","last_unstale":"2024-09-15T20:50:32.221176+0000","last_undegraded":"2024-09-15T20:50:32.221176+0000","last_fullsized":"2024-09-15T20:50:32.221176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6364,"log_dups_size":0,"ondisk_log_size":6364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:17.404898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":6371,"num_write_kb":181001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"26'6415","reported_seq":6431,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:35.523866+0000","last_change":"2024-09-15T20:47:21.018582+0000","last_active":"2024-09-15T20:50:35.523866+0000","last_peered":"2024-09-15T20:50:35.523866+0000","last_clean":"2024-09-15T20:50:35.523866+0000","last_became_active":"2024-09-15T20:47:21.016813+0000","last_became_peered":"2024-09-15T20:47:21.016813+0000","last_unstale":"2024-09-15T20:50:35.523866+0000","last_undegraded":"2024-09-15T20:50:35.523866+0000","last_fullsized":"2024-09-15T20:50:35.523866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6415,"log_dups_size":0,"ondisk_log_size":6415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T21:41:01.610631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6412,"num_write_kb":184897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"26'3751","reported_seq":3767,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.870226+0000","last_change":"2024-09-15T20:47:21.010645+0000","last_active":"2024-09-15T20:50:14.870226+0000","last_peered":"2024-09-15T20:50:14.870226+0000","last_clean":"2024-09-15T20:50:14.870226+0000","last_became_active":"2024-09-15T20:47:21.010350+0000","last_became_peered":"2024-09-15T20:47:21.010350+0000","last_unstale":"2024-09-15T20:50:14.870226+0000","last_undegraded":"2024-09-15T20:50:14.870226+0000","last_fullsized":"2024-09-15T20:50:14.870226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3751,"log_dups_size":0,"ondisk_log_size":3751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T21:26:17.071795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3727,"num_write_kb":156934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"26'5784","reported_seq":5808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477618+0000","last_change":"2024-09-15T20:47:21.017244+0000","last_active":"2024-09-15T20:51:30.477618+0000","last_peered":"2024-09-15T20:51:30.477618+0000","last_clean":"2024-09-15T20:51:30.477618+0000","last_became_active":"2024-09-15T20:47:21.016999+0000","last_became_peered":"2024-09-15T20:47:21.016999+0000","last_unstale":"2024-09-15T20:51:30.477618+0000","last_undegraded":"2024-09-15T20:51:30.477618+0000","last_fullsized":"2024-09-15T20:51:30.477618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5784,"log_dups_size":0,"ondisk_log_size":5784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:18.918849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":5791,"num_write_kb":176448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"26'6373","reported_seq":6401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:25.303453+0000","last_change":"2024-09-15T20:47:21.010964+0000","last_active":"2024-09-15T20:50:25.303453+0000","last_peered":"2024-09-15T20:50:25.303453+0000","last_clean":"2024-09-15T20:50:25.303453+0000","last_became_active":"2024-09-15T20:47:21.010694+0000","last_became_peered":"2024-09-15T20:47:21.010694+0000","last_unstale":"2024-09-15T20:50:25.303453+0000","last_undegraded":"2024-09-15T20:50:25.303453+0000","last_fullsized":"2024-09-15T20:50:25.303453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6373,"log_dups_size":0,"ondisk_log_size":6373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:44.740081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":6347,"num_write_kb":171391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.577247+0000","last_change":"2024-09-15T20:47:14.474673+0000","last_active":"2024-09-15T20:50:14.577247+0000","last_peered":"2024-09-15T20:50:14.577247+0000","last_clean":"2024-09-15T20:50:14.577247+0000","last_became_active":"2024-09-15T20:47:12.471373+0000","last_became_peered":"2024-09-15T20:47:12.471373+0000","last_unstale":"2024-09-15T20:50:14.577247+0000","last_undegraded":"2024-09-15T20:50:14.577247+0000","last_fullsized":"2024-09-15T20:50:14.577247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:47.666907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018866289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'6610","reported_seq":6628,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:51:19.805553+0000","last_change":"2024-09-15T20:47:21.019817+0000","last_active":"2024-09-15T20:51:19.805553+0000","last_peered":"2024-09-15T20:51:19.805553+0000","last_clean":"2024-09-15T20:51:19.805553+0000","last_became_active":"2024-09-15T20:47:21.019020+0000","last_became_peered":"2024-09-15T20:47:21.019020+0000","last_unstale":"2024-09-15T20:51:19.805553+0000","last_undegraded":"2024-09-15T20:51:19.805553+0000","last_fullsized":"2024-09-15T20:51:19.805553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6610,"log_dups_size":0,"ondisk_log_size":6610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:33.686995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137986560,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6595,"num_write_kb":207131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.579788+0000","last_change":"2024-09-15T20:47:14.472821+0000","last_active":"2024-09-15T20:50:14.579788+0000","last_peered":"2024-09-15T20:50:14.579788+0000","last_clean":"2024-09-15T20:50:14.579788+0000","last_became_active":"2024-09-15T20:47:12.468530+0000","last_became_peered":"2024-09-15T20:47:12.468530+0000","last_unstale":"2024-09-15T20:50:14.579788+0000","last_undegraded":"2024-09-15T20:50:14.579788+0000","last_fullsized":"2024-09-15T20:50:14.579788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:33.831606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000891339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'4891","reported_seq":4918,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.969875+0000","last_change":"2024-09-15T20:47:21.021835+0000","last_active":"2024-09-15T20:50:14.969875+0000","last_peered":"2024-09-15T20:50:14.969875+0000","last_clean":"2024-09-15T20:50:14.969875+0000","last_became_active":"2024-09-15T20:47:21.021031+0000","last_became_peered":"2024-09-15T20:47:21.021031+0000","last_unstale":"2024-09-15T20:50:14.969875+0000","last_undegraded":"2024-09-15T20:50:14.969875+0000","last_fullsized":"2024-09-15T20:50:14.969875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4891,"log_dups_size":0,"ondisk_log_size":4891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:21.527979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":4866,"num_write_kb":218628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.577645+0000","last_change":"2024-09-15T20:47:14.475000+0000","last_active":"2024-09-15T20:50:14.577645+0000","last_peered":"2024-09-15T20:50:14.577645+0000","last_clean":"2024-09-15T20:50:14.577645+0000","last_became_active":"2024-09-15T20:47:12.461531+0000","last_became_peered":"2024-09-15T20:47:12.461531+0000","last_unstale":"2024-09-15T20:50:14.577645+0000","last_undegraded":"2024-09-15T20:50:14.577645+0000","last_fullsized":"2024-09-15T20:50:14.577645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:28.018623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022230399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'8341","reported_seq":8401,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:34.363218+0000","last_change":"2024-09-15T20:47:21.026683+0000","last_active":"2024-09-15T20:50:34.363218+0000","last_peered":"2024-09-15T20:50:34.363218+0000","last_clean":"2024-09-15T20:50:34.363218+0000","last_became_active":"2024-09-15T20:47:21.025918+0000","last_became_peered":"2024-09-15T20:47:21.025918+0000","last_unstale":"2024-09-15T20:50:34.363218+0000","last_undegraded":"2024-09-15T20:50:34.363218+0000","last_fullsized":"2024-09-15T20:50:34.363218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":8341,"log_dups_size":0,"ondisk_log_size":8341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:52.672994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135988904,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":174,"num_read_kb":136,"num_write":8413,"num_write_kb":232061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.636018+0000","last_change":"2024-09-15T20:47:14.986335+0000","last_active":"2024-09-15T20:50:14.636018+0000","last_peered":"2024-09-15T20:50:14.636018+0000","last_clean":"2024-09-15T20:50:14.636018+0000","last_became_active":"2024-09-15T20:47:12.468184+0000","last_became_peered":"2024-09-15T20:47:12.468184+0000","last_unstale":"2024-09-15T20:50:14.636018+0000","last_undegraded":"2024-09-15T20:50:14.636018+0000","last_fullsized":"2024-09-15T20:50:14.636018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:30.408559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001176739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'4297","reported_seq":4324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:51:19.808832+0000","last_change":"2024-09-15T20:47:21.018098+0000","last_active":"2024-09-15T20:51:19.808832+0000","last_peered":"2024-09-15T20:51:19.808832+0000","last_clean":"2024-09-15T20:51:19.808832+0000","last_became_active":"2024-09-15T20:47:21.017736+0000","last_became_peered":"2024-09-15T20:47:21.017736+0000","last_unstale":"2024-09-15T20:51:19.808832+0000","last_undegraded":"2024-09-15T20:51:19.808832+0000","last_fullsized":"2024-09-15T20:51:19.808832+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4297,"log_dups_size":0,"ondisk_log_size":4297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:38.019405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78276432,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":24,"num_read_kb":82,"num_write":4316,"num_write_kb":145640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"25'5330","reported_seq":5348,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477548+0000","last_change":"2024-09-15T20:47:21.009225+0000","last_active":"2024-09-15T20:51:30.477548+0000","last_peered":"2024-09-15T20:51:30.477548+0000","last_clean":"2024-09-15T20:51:30.477548+0000","last_became_active":"2024-09-15T20:47:21.008994+0000","last_became_peered":"2024-09-15T20:47:21.008994+0000","last_unstale":"2024-09-15T20:51:30.477548+0000","last_undegraded":"2024-09-15T20:51:30.477548+0000","last_fullsized":"2024-09-15T20:51:30.477548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5330,"log_dups_size":0,"ondisk_log_size":5330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:01.453378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5329,"num_write_kb":197895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.576694+0000","last_change":"2024-09-15T20:47:14.474210+0000","last_active":"2024-09-15T20:50:14.576694+0000","last_peered":"2024-09-15T20:50:14.576694+0000","last_clean":"2024-09-15T20:50:14.576694+0000","last_became_active":"2024-09-15T20:47:12.471091+0000","last_became_peered":"2024-09-15T20:47:12.471091+0000","last_unstale":"2024-09-15T20:50:14.576694+0000","last_undegraded":"2024-09-15T20:50:14.576694+0000","last_fullsized":"2024-09-15T20:50:14.576694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:42.228249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530579999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"26'3415","reported_seq":3542,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.973637+0000","last_change":"2024-09-15T20:47:21.024516+0000","last_active":"2024-09-15T20:50:14.973637+0000","last_peered":"2024-09-15T20:50:14.973637+0000","last_clean":"2024-09-15T20:50:14.973637+0000","last_became_active":"2024-09-15T20:47:21.023619+0000","last_became_peered":"2024-09-15T20:47:21.023619+0000","last_unstale":"2024-09-15T20:50:14.973637+0000","last_undegraded":"2024-09-15T20:50:14.973637+0000","last_fullsized":"2024-09-15T20:50:14.973637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3415,"log_dups_size":0,"ondisk_log_size":3415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:18.323622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371536,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":138,"num_read_kb":254,"num_write":3502,"num_write_kb":132957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.563348+0000","last_change":"2024-09-15T20:47:14.986963+0000","last_active":"2024-09-15T20:50:14.563348+0000","last_peered":"2024-09-15T20:50:14.563348+0000","last_clean":"2024-09-15T20:50:14.563348+0000","last_became_active":"2024-09-15T20:47:12.462360+0000","last_became_peered":"2024-09-15T20:47:12.462360+0000","last_unstale":"2024-09-15T20:50:14.563348+0000","last_undegraded":"2024-09-15T20:50:14.563348+0000","last_fullsized":"2024-09-15T20:50:14.563348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:39.175611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011324970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"26'3755","reported_seq":3771,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.878523+0000","last_change":"2024-09-15T20:47:21.018553+0000","last_active":"2024-09-15T20:50:14.878523+0000","last_peered":"2024-09-15T20:50:14.878523+0000","last_clean":"2024-09-15T20:50:14.878523+0000","last_became_active":"2024-09-15T20:47:21.017058+0000","last_became_peered":"2024-09-15T20:47:21.017058+0000","last_unstale":"2024-09-15T20:50:14.878523+0000","last_undegraded":"2024-09-15T20:50:14.878523+0000","last_fullsized":"2024-09-15T20:50:14.878523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3755,"log_dups_size":0,"ondisk_log_size":3755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:15.985307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3728,"num_write_kb":173059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.576395+0000","last_change":"2024-09-15T20:47:14.473959+0000","last_active":"2024-09-15T20:50:14.576395+0000","last_peered":"2024-09-15T20:50:14.576395+0000","last_clean":"2024-09-15T20:50:14.576395+0000","last_became_active":"2024-09-15T20:47:12.463812+0000","last_became_peered":"2024-09-15T20:47:12.463812+0000","last_unstale":"2024-09-15T20:50:14.576395+0000","last_undegraded":"2024-09-15T20:50:14.576395+0000","last_fullsized":"2024-09-15T20:50:14.576395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:19.954840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001226357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"26'4114","reported_seq":4130,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:30.062153+0000","last_change":"2024-09-15T20:47:21.006238+0000","last_active":"2024-09-15T20:50:30.062153+0000","last_peered":"2024-09-15T20:50:30.062153+0000","last_clean":"2024-09-15T20:50:30.062153+0000","last_became_active":"2024-09-15T20:47:21.005584+0000","last_became_peered":"2024-09-15T20:47:21.005584+0000","last_unstale":"2024-09-15T20:50:30.062153+0000","last_undegraded":"2024-09-15T20:50:30.062153+0000","last_fullsized":"2024-09-15T20:50:30.062153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4114,"log_dups_size":0,"ondisk_log_size":4114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:22.836701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4109,"num_write_kb":152323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.577590+0000","last_change":"2024-09-15T20:47:14.475335+0000","last_active":"2024-09-15T20:50:14.577590+0000","last_peered":"2024-09-15T20:50:14.577590+0000","last_clean":"2024-09-15T20:50:14.577590+0000","last_became_active":"2024-09-15T20:47:12.469021+0000","last_became_peered":"2024-09-15T20:47:12.469021+0000","last_unstale":"2024-09-15T20:50:14.577590+0000","last_undegraded":"2024-09-15T20:50:14.577590+0000","last_fullsized":"2024-09-15T20:50:14.577590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:19.117864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025466540000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445172+0000","last_change":"2024-09-15T20:47:07.291789+0000","last_active":"2024-09-15T20:51:30.445172+0000","last_peered":"2024-09-15T20:51:30.445172+0000","last_clean":"2024-09-15T20:51:30.445172+0000","last_became_active":"2024-09-15T20:47:07.289970+0000","last_became_peered":"2024-09-15T20:47:07.289970+0000","last_unstale":"2024-09-15T20:51:30.445172+0000","last_undegraded":"2024-09-15T20:51:30.445172+0000","last_fullsized":"2024-09-15T20:51:30.445172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:05.400631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:05.400631+0000","last_clean_scrub_stamp":"2024-09-15T20:47:05.400631+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:27.776984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"26'3475","reported_seq":3491,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.987842+0000","last_change":"2024-09-15T20:47:21.018143+0000","last_active":"2024-09-15T20:50:14.987842+0000","last_peered":"2024-09-15T20:50:14.987842+0000","last_clean":"2024-09-15T20:50:14.987842+0000","last_became_active":"2024-09-15T20:47:21.017326+0000","last_became_peered":"2024-09-15T20:47:21.017326+0000","last_unstale":"2024-09-15T20:50:14.987842+0000","last_undegraded":"2024-09-15T20:50:14.987842+0000","last_fullsized":"2024-09-15T20:50:14.987842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3475,"log_dups_size":0,"ondisk_log_size":3475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:39.169392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3405,"num_write_kb":176771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"26'8068","reported_seq":8190,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:33.356575+0000","last_change":"2024-09-15T20:47:21.005970+0000","last_active":"2024-09-15T20:50:33.356575+0000","last_peered":"2024-09-15T20:50:33.356575+0000","last_clean":"2024-09-15T20:50:33.356575+0000","last_became_active":"2024-09-15T20:47:21.005684+0000","last_became_peered":"2024-09-15T20:47:21.005684+0000","last_unstale":"2024-09-15T20:50:33.356575+0000","last_undegraded":"2024-09-15T20:50:33.356575+0000","last_fullsized":"2024-09-15T20:50:33.356575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":8068,"log_dups_size":0,"ondisk_log_size":8068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:57.048864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104858112,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":356,"num_read_kb":316,"num_write":6023,"num_write_kb":166026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"26'6134","reported_seq":6174,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:34.593906+0000","last_change":"2024-09-15T20:47:21.006726+0000","last_active":"2024-09-15T20:50:34.593906+0000","last_peered":"2024-09-15T20:50:34.593906+0000","last_clean":"2024-09-15T20:50:34.593906+0000","last_became_active":"2024-09-15T20:47:21.006304+0000","last_became_peered":"2024-09-15T20:47:21.006304+0000","last_unstale":"2024-09-15T20:50:34.593906+0000","last_undegraded":"2024-09-15T20:50:34.593906+0000","last_fullsized":"2024-09-15T20:50:34.593906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6134,"log_dups_size":0,"ondisk_log_size":6134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:22.106814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138543632,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":97,"num_read_kb":78,"num_write":6159,"num_write_kb":180177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"25'4305","reported_seq":4322,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.563227+0000","last_change":"2024-09-15T20:47:21.026764+0000","last_active":"2024-09-15T20:50:14.563227+0000","last_peered":"2024-09-15T20:50:14.563227+0000","last_clean":"2024-09-15T20:50:14.563227+0000","last_became_active":"2024-09-15T20:47:21.025992+0000","last_became_peered":"2024-09-15T20:47:21.025992+0000","last_unstale":"2024-09-15T20:50:14.563227+0000","last_undegraded":"2024-09-15T20:50:14.563227+0000","last_fullsized":"2024-09-15T20:50:14.563227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4305,"log_dups_size":0,"ondisk_log_size":4305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:34.126386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113312264,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4307,"num_write_kb":192020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"27'2811","reported_seq":2829,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.521390+0000","last_change":"2024-09-15T20:47:21.019750+0000","last_active":"2024-09-15T20:51:30.521390+0000","last_peered":"2024-09-15T20:51:30.521390+0000","last_clean":"2024-09-15T20:51:30.521390+0000","last_became_active":"2024-09-15T20:47:21.019431+0000","last_became_peered":"2024-09-15T20:47:21.019431+0000","last_unstale":"2024-09-15T20:51:30.521390+0000","last_undegraded":"2024-09-15T20:51:30.521390+0000","last_fullsized":"2024-09-15T20:51:30.521390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2811,"log_dups_size":0,"ondisk_log_size":2811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:09.223242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69863248,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2764,"num_write_kb":138455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"26'3208","reported_seq":3226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.866246+0000","last_change":"2024-09-15T20:47:21.002739+0000","last_active":"2024-09-15T20:50:14.866246+0000","last_peered":"2024-09-15T20:50:14.866246+0000","last_clean":"2024-09-15T20:50:14.866246+0000","last_became_active":"2024-09-15T20:47:21.002454+0000","last_became_peered":"2024-09-15T20:47:21.002454+0000","last_unstale":"2024-09-15T20:50:14.866246+0000","last_undegraded":"2024-09-15T20:50:14.866246+0000","last_fullsized":"2024-09-15T20:50:14.866246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3208,"log_dups_size":0,"ondisk_log_size":3208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:03.783169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111936016,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":3190,"num_write_kb":137614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"26'5657","reported_seq":6052,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:15.049278+0000","last_change":"2024-09-15T20:47:21.008704+0000","last_active":"2024-09-15T20:50:15.049278+0000","last_peered":"2024-09-15T20:50:15.049278+0000","last_clean":"2024-09-15T20:50:15.049278+0000","last_became_active":"2024-09-15T20:47:21.007899+0000","last_became_peered":"2024-09-15T20:47:21.007899+0000","last_unstale":"2024-09-15T20:50:15.049278+0000","last_undegraded":"2024-09-15T20:50:15.049278+0000","last_fullsized":"2024-09-15T20:50:15.049278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5657,"log_dups_size":0,"ondisk_log_size":5657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:28.324549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114958864,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1304,"num_read_kb":1127,"num_write":6119,"num_write_kb":191597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'4887","reported_seq":4908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.520257+0000","last_change":"2024-09-15T20:47:21.009343+0000","last_active":"2024-09-15T20:51:30.520257+0000","last_peered":"2024-09-15T20:51:30.520257+0000","last_clean":"2024-09-15T20:51:30.520257+0000","last_became_active":"2024-09-15T20:47:21.008922+0000","last_became_peered":"2024-09-15T20:47:21.008922+0000","last_unstale":"2024-09-15T20:51:30.520257+0000","last_undegraded":"2024-09-15T20:51:30.520257+0000","last_fullsized":"2024-09-15T20:51:30.520257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4887,"log_dups_size":0,"ondisk_log_size":4887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:30.517648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":4843,"num_write_kb":242701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'5581","reported_seq":5599,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445098+0000","last_change":"2024-09-15T20:47:21.028647+0000","last_active":"2024-09-15T20:51:30.445098+0000","last_peered":"2024-09-15T20:51:30.445098+0000","last_clean":"2024-09-15T20:51:30.445098+0000","last_became_active":"2024-09-15T20:47:21.028396+0000","last_became_peered":"2024-09-15T20:47:21.028396+0000","last_unstale":"2024-09-15T20:51:30.445098+0000","last_undegraded":"2024-09-15T20:51:30.445098+0000","last_fullsized":"2024-09-15T20:51:30.445098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5581,"log_dups_size":0,"ondisk_log_size":5581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:45.063111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149618688,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5530,"num_write_kb":231368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"25'3819","reported_seq":3843,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.576279+0000","last_change":"2024-09-15T20:47:21.009991+0000","last_active":"2024-09-15T20:50:14.576279+0000","last_peered":"2024-09-15T20:50:14.576279+0000","last_clean":"2024-09-15T20:50:14.576279+0000","last_became_active":"2024-09-15T20:47:21.009741+0000","last_became_peered":"2024-09-15T20:47:21.009741+0000","last_unstale":"2024-09-15T20:50:14.576279+0000","last_undegraded":"2024-09-15T20:50:14.576279+0000","last_fullsized":"2024-09-15T20:50:14.576279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3819,"log_dups_size":0,"ondisk_log_size":3819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T20:50:34.892506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130680656,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":3826,"num_write_kb":196699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'2664","reported_seq":2704,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:14.967125+0000","last_change":"2024-09-15T20:47:21.015487+0000","last_active":"2024-09-15T20:50:14.967125+0000","last_peered":"2024-09-15T20:50:14.967125+0000","last_clean":"2024-09-15T20:50:14.967125+0000","last_became_active":"2024-09-15T20:47:21.012712+0000","last_became_peered":"2024-09-15T20:47:21.012712+0000","last_unstale":"2024-09-15T20:50:14.967125+0000","last_undegraded":"2024-09-15T20:50:14.967125+0000","last_fullsized":"2024-09-15T20:50:14.967125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2664,"log_dups_size":0,"ondisk_log_size":2664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:01.394914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080896,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":94,"num_read_kb":81,"num_write":2658,"num_write_kb":115655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"26'7923","reported_seq":7940,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T20:50:27.449463+0000","last_change":"2024-09-15T20:47:21.012518+0000","last_active":"2024-09-15T20:50:27.449463+0000","last_peered":"2024-09-15T20:50:27.449463+0000","last_clean":"2024-09-15T20:50:27.449463+0000","last_became_active":"2024-09-15T20:47:21.012087+0000","last_became_peered":"2024-09-15T20:47:21.012087+0000","last_unstale":"2024-09-15T20:50:27.449463+0000","last_undegraded":"2024-09-15T20:50:27.449463+0000","last_fullsized":"2024-09-15T20:50:27.449463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":7923,"log_dups_size":0,"ondisk_log_size":7923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:50.852789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125895176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":7906,"num_write_kb":193612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3573543688,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":0,"num_read":2497,"num_read_kb":2508,"num_write":159628,"num_write_kb":5636241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6849433600,"data_stored":6845163144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161453,"ondisk_log_size":161453,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555500,"kb_used_data":474332,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":93816340,"statfs":{"total":96636764160,"available":96067932160,"internally_reserved":0,"allocated":485715968,"data_stored":485307172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":83098058},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509497,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1212960,"kb_used_data":938896,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93158880,"statfs":{"total":96636764160,"available":95394693120,"internally_reserved":0,"allocated":961429504,"data_stored":960571724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509497,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1182172,"kb_used_data":926156,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93189668,"statfs":{"total":96636764160,"available":95426220032,"internally_reserved":0,"allocated":948383744,"data_stored":947692488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1023460,"kb_used_data":807700,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":93348380,"statfs":{"total":96636764160,"available":95588741120,"internally_reserved":0,"allocated":827084800,"data_stored":826445331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220920262},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1064716,"kb_used_data":821180,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":93307124,"statfs":{"total":96636764160,"available":95546494976,"internally_reserved":0,"allocated":840888320,"data_stored":840202232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":923192,"kb_used_data":721320,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":93448648,"statfs":{"total":96636764160,"available":95691415552,"internally_reserved":0,"allocated":738631680,"data_stored":738005624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206698949},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542199,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1364792,"kb_used_data":1067112,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":93007048,"statfs":{"total":96636764160,"available":95239217152,"internally_reserved":0,"allocated":1092722688,"data_stored":1091855327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":304806343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1227488,"kb_used_data":935376,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93144352,"statfs":{"total":96636764160,"available":95379816448,"internally_reserved":0,"allocated":957825024,"data_stored":956947876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":948101120,"data_stored":947584016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":960626688,"data_stored":959943044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":957554688,"data_stored":956848124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1092448256,"data_stored":1091755556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":738361344,"data_stored":737905872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":840085504,"data_stored":839573552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":826810368,"data_stored":826345560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":485445632,"data_stored":485207420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T20:51:32.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T20:51:32.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb2074b640 1 Processor -- start 2024-09-15T20:51:32.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb2074b640 1 -- start start 2024-09-15T20:51:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb2074b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 0x7ffb18147840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb2074b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffb1813a330 0x7ffb1813a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb2074b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ffb18072d30 0x7ffb180731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb2074b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7ffb18069010 con 0x7ffb18072d30 2024-09-15T20:51:32.233 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb2074b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ffb18147e70 con 0x7ffb1813a330 2024-09-15T20:51:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb2074b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ffb18144e80 con 0x7ffb18068c30 2024-09-15T20:51:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb1e4e7640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 0x7ffb18147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb1e4e7640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 0x7ffb18147840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46648/0 (socket says 172.21.15.52:46648) 2024-09-15T20:51:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb1e4e7640 1 -- 172.21.15.52:0/2111069042 learned_addr learned my addr 172.21.15.52:0/2111069042 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb1ece8640 1 --2- 172.21.15.52:0/2111069042 >> v2:172.21.15.52:3300/0 conn(0x7ffb18072d30 0x7ffb180731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb1dce6640 1 --2- 172.21.15.52:0/2111069042 >> v2:172.21.15.81:3300/0 conn(0x7ffb1813a330 0x7ffb1813a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb1e4e7640 1 -- 172.21.15.52:0/2111069042 >> v2:172.21.15.81:3300/0 conn(0x7ffb1813a330 msgr2=0x7ffb1813a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb1e4e7640 1 --2- 172.21.15.52:0/2111069042 >> v2:172.21.15.81:3300/0 conn(0x7ffb1813a330 0x7ffb1813a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb1e4e7640 1 -- 172.21.15.52:0/2111069042 >> v2:172.21.15.52:3300/0 conn(0x7ffb18072d30 msgr2=0x7ffb180731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb1e4e7640 1 --2- 172.21.15.52:0/2111069042 >> v2:172.21.15.52:3300/0 conn(0x7ffb18072d30 0x7ffb180731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb1e4e7640 1 -- 172.21.15.52:0/2111069042 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb18073e00 con 0x7ffb18068c30 2024-09-15T20:51:32.234 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.229+0000 7ffb1ece8640 1 --2- 172.21.15.52:0/2111069042 >> v2:172.21.15.52:3300/0 conn(0x7ffb18072d30 0x7ffb180731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb1e4e7640 1 --2- 172.21.15.52:0/2111069042 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 0x7ffb18147840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffb18073dd0 tx=0x7ffb1401c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fc7820a273913ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb1d4e5640 1 -- 172.21.15.52:0/2111069042 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb140b1070 con 0x7ffb18068c30 2024-09-15T20:51:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb1d4e5640 1 -- 172.21.15.52:0/2111069042 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb140ac630 con 0x7ffb18068c30 2024-09-15T20:51:32.236 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb1d4e5640 1 -- 172.21.15.52:0/2111069042 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb140a8050 con 0x7ffb18068c30 2024-09-15T20:51:32.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 -- 172.21.15.52:0/2111069042 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 msgr2=0x7ffb18147840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:32.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 --2- 172.21.15.52:0/2111069042 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 0x7ffb18147840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffb18073dd0 tx=0x7ffb1401c500 comp rx=0 tx=0).stop 2024-09-15T20:51:32.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 -- 172.21.15.52:0/2111069042 shutdown_connections 2024-09-15T20:51:32.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 --2- 172.21.15.52:0/2111069042 >> v2:172.21.15.52:3300/0 conn(0x7ffb18072d30 0x7ffb180731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 --2- 172.21.15.52:0/2111069042 >> v2:172.21.15.81:3300/0 conn(0x7ffb1813a330 0x7ffb1813a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.237 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 --2- 172.21.15.52:0/2111069042 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 0x7ffb18147840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 -- 172.21.15.52:0/2111069042 >> 172.21.15.52:0/2111069042 conn(0x7ffb180b3670 msgr2=0x7ffb180b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:32.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 -- 172.21.15.52:0/2111069042 shutdown_connections 2024-09-15T20:51:32.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 -- 172.21.15.52:0/2111069042 wait complete. 2024-09-15T20:51:32.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 Processor -- start 2024-09-15T20:51:32.238 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 -- start start 2024-09-15T20:51:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 0x7ffb180b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb18072d30 0x7ffb180b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.233+0000 7ffb2074b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1813a330 0x7ffb180b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb2074b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18072380 con 0x7ffb1813a330 2024-09-15T20:51:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb2074b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18072200 con 0x7ffb18072d30 2024-09-15T20:51:32.240 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb2074b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ffb18072500 con 0x7ffb18068c30 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1e4e7640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 0x7ffb180b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1e4e7640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 0x7ffb180b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46664/0 (socket says 172.21.15.52:46664) 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1e4e7640 1 -- 172.21.15.52:0/2935895507 learned_addr learned my addr 172.21.15.52:0/2935895507 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1ece8640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1813a330 0x7ffb180b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1dce6640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb18072d30 0x7ffb180b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1ece8640 1 -- 172.21.15.52:0/2935895507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 msgr2=0x7ffb180b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1ece8640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 0x7ffb180b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1ece8640 1 -- 172.21.15.52:0/2935895507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb18072d30 msgr2=0x7ffb180b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1ece8640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb18072d30 0x7ffb180b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1ece8640 1 -- 172.21.15.52:0/2935895507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1814a190 con 0x7ffb1813a330 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1e4e7640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 0x7ffb180b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1ece8640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1813a330 0x7ffb180b07e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000eed0 tx=0x7ffb1000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb0effd640 1 -- 172.21.15.52:0/2935895507 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10018030 con 0x7ffb1813a330 2024-09-15T20:51:32.241 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb0effd640 1 -- 172.21.15.52:0/2935895507 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1000bd20 con 0x7ffb1813a330 2024-09-15T20:51:32.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb0effd640 1 -- 172.21.15.52:0/2935895507 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10003be0 con 0x7ffb1813a330 2024-09-15T20:51:32.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb2074b640 1 -- 172.21.15.52:0/2935895507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb18148b10 con 0x7ffb1813a330 2024-09-15T20:51:32.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb2074b640 1 -- 172.21.15.52:0/2935895507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb181486c0 con 0x7ffb1813a330 2024-09-15T20:51:32.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb2074b640 1 -- 172.21.15.52:0/2935895507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb18148d10 con 0x7ffb1813a330 2024-09-15T20:51:32.242 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb0effd640 1 -- 172.21.15.52:0/2935895507 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7ffb1001b070 con 0x7ffb1813a330 2024-09-15T20:51:32.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb0effd640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ffafc072ec0 0x7ffafc075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:32.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb0effd640 1 -- 172.21.15.52:0/2935895507 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7ffb10094120 con 0x7ffb1813a330 2024-09-15T20:51:32.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.237+0000 7ffb1e4e7640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ffafc072ec0 0x7ffafc075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:32.243 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.241+0000 7ffb1e4e7640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ffafc072ec0 0x7ffafc075380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffb1401c540 tx=0x7ffb14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:32.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.241+0000 7ffb0effd640 1 -- 172.21.15.52:0/2935895507 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7ffb1005f440 con 0x7ffb1813a330 2024-09-15T20:51:32.420 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.417+0000 7ffb2074b640 1 -- 172.21.15.52:0/2935895507 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb180731a0 con 0x7ffb1813a330 2024-09-15T20:51:32.421 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.417+0000 7ffb0effd640 1 -- 172.21.15.52:0/2935895507 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+16674 (secure 0 0 0) 0x7ffb1005ed40 con 0x7ffb1813a330 2024-09-15T20:51:32.422 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:51:32.422 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":27,"fsid":"5b0b6dfd-6a20-4023-acf9-e3c53f9607bc","created":"2024-09-15T20:46:52.315149+0000","modified":"2024-09-15T20:51:30.438872+0000","last_up_change":"2024-09-15T20:47:04.394216+0000","last_in_change":"2024-09-15T20:46:54.803112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T20:47:05.257147+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T20:47:10.855815+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephsqlite","create_time":"2024-09-15T20:47:19.839926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b99fda03-8405-4cd4-aea3-a8cc67bc0fe6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6801","nonce":1039594647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6803","nonce":1039594647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6807","nonce":1039594647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1039594647},{"type":"v1","addr":"172.21.15.52:6805","nonce":1039594647}]},"public_addr":"172.21.15.52:6801/1039594647","cluster_addr":"172.21.15.52:6803/1039594647","heartbeat_back_addr":"172.21.15.52:6807/1039594647","heartbeat_front_addr":"172.21.15.52:6805/1039594647","state":["exists","up"]},{"osd":1,"uuid":"1d555c27-c8c2-4d30-9a50-be7cf9a60db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6817","nonce":1590363289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6819","nonce":1590363289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6823","nonce":1590363289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1590363289},{"type":"v1","addr":"172.21.15.52:6821","nonce":1590363289}]},"public_addr":"172.21.15.52:6817/1590363289","cluster_addr":"172.21.15.52:6819/1590363289","heartbeat_back_addr":"172.21.15.52:6823/1590363289","heartbeat_front_addr":"172.21.15.52:6821/1590363289","state":["exists","up"]},{"osd":2,"uuid":"8d5f33c4-cf45-4c87-b9ea-f0b474dfcada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6825","nonce":4164590883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6827","nonce":4164590883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6831","nonce":4164590883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":4164590883},{"type":"v1","addr":"172.21.15.52:6829","nonce":4164590883}]},"public_addr":"172.21.15.52:6825/4164590883","cluster_addr":"172.21.15.52:6827/4164590883","heartbeat_back_addr":"172.21.15.52:6831/4164590883","heartbeat_front_addr":"172.21.15.52:6829/4164590883","state":["exists","up"]},{"osd":3,"uuid":"d9b51207-4514-4bfd-967c-32040c0b196f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6809","nonce":4053631670}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6811","nonce":4053631670}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6815","nonce":4053631670}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":4053631670},{"type":"v1","addr":"172.21.15.52:6813","nonce":4053631670}]},"public_addr":"172.21.15.52:6809/4053631670","cluster_addr":"172.21.15.52:6811/4053631670","heartbeat_back_addr":"172.21.15.52:6815/4053631670","heartbeat_front_addr":"172.21.15.52:6813/4053631670","state":["exists","up"]},{"osd":4,"uuid":"bb2fcd47-4202-4b5c-ad02-5dfbe865cbde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6817","nonce":1105997015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6819","nonce":1105997015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6823","nonce":1105997015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1105997015},{"type":"v1","addr":"172.21.15.81:6821","nonce":1105997015}]},"public_addr":"172.21.15.81:6817/1105997015","cluster_addr":"172.21.15.81:6819/1105997015","heartbeat_back_addr":"172.21.15.81:6823/1105997015","heartbeat_front_addr":"172.21.15.81:6821/1105997015","state":["exists","up"]},{"osd":5,"uuid":"59599740-63cf-4e26-abb0-fe542c98671a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6809","nonce":1585962119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6811","nonce":1585962119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6815","nonce":1585962119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1585962119},{"type":"v1","addr":"172.21.15.81:6813","nonce":1585962119}]},"public_addr":"172.21.15.81:6809/1585962119","cluster_addr":"172.21.15.81:6811/1585962119","heartbeat_back_addr":"172.21.15.81:6815/1585962119","heartbeat_front_addr":"172.21.15.81:6813/1585962119","state":["exists","up"]},{"osd":6,"uuid":"daebb41e-6be2-4689-b9c4-ba5271f2ce69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6801","nonce":1367983121}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6803","nonce":1367983121}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6807","nonce":1367983121}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1367983121},{"type":"v1","addr":"172.21.15.81:6805","nonce":1367983121}]},"public_addr":"172.21.15.81:6801/1367983121","cluster_addr":"172.21.15.81:6803/1367983121","heartbeat_back_addr":"172.21.15.81:6807/1367983121","heartbeat_front_addr":"172.21.15.81:6805/1367983121","state":["exists","up"]},{"osd":7,"uuid":"ed8914a3-1f7c-4942-bd5e-0453369f009b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6825","nonce":579210364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6827","nonce":579210364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6831","nonce":579210364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":579210364},{"type":"v1","addr":"172.21.15.81:6829","nonce":579210364}]},"public_addr":"172.21.15.81:6825/579210364","cluster_addr":"172.21.15.81:6827/579210364","heartbeat_back_addr":"172.21.15.81:6831/579210364","heartbeat_front_addr":"172.21.15.81:6829/579210364","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.527985+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.518897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.982136+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.494599+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.327079+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.271634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.089410+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T20:47:01.736530+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:0/4173731609":"2024-09-15T21:51:29.841675+0000","172.21.15.52:0/4053716503":"2024-09-15T21:50:13.870258+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T20:51:32.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.421+0000 7ffb2074b640 1 -- 172.21.15.52:0/2935895507 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ffafc072ec0 msgr2=0x7ffafc075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:32.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.421+0000 7ffb2074b640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ffafc072ec0 0x7ffafc075380 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffb1401c540 tx=0x7ffb14009040 comp rx=0 tx=0).stop 2024-09-15T20:51:32.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.421+0000 7ffb2074b640 1 -- 172.21.15.52:0/2935895507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1813a330 msgr2=0x7ffb180b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:32.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.421+0000 7ffb2074b640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1813a330 0x7ffb180b07e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000eed0 tx=0x7ffb1000b480 comp rx=0 tx=0).stop 2024-09-15T20:51:32.424 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.421+0000 7ffb2074b640 1 -- 172.21.15.52:0/2935895507 shutdown_connections 2024-09-15T20:51:32.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.421+0000 7ffb2074b640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ffafc072ec0 0x7ffafc075380 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.421+0000 7ffb2074b640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb1813a330 0x7ffb180b07e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.421+0000 7ffb2074b640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb18072d30 0x7ffb180b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.421+0000 7ffb2074b640 1 --2- 172.21.15.52:0/2935895507 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ffb18068c30 0x7ffb180b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:32.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.421+0000 7ffb2074b640 1 -- 172.21.15.52:0/2935895507 >> 172.21.15.52:0/2935895507 conn(0x7ffb180b3670 msgr2=0x7ffb180b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:32.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.421+0000 7ffb2074b640 1 -- 172.21.15.52:0/2935895507 shutdown_connections 2024-09-15T20:51:32.425 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:32.421+0000 7ffb2074b640 1 -- 172.21.15.52:0/2935895507 wait complete. 2024-09-15T20:51:33.443 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T20:51:33.443 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T20:51:33.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.581+0000 7f97058a8640 1 Processor -- start 2024-09-15T20:51:33.586 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.581+0000 7f97058a8640 1 -- start start 2024-09-15T20:51:33.587 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.581+0000 7f97058a8640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9700070650 0x7f970013b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.581+0000 7f97058a8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f970013baf0 0x7f970014c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.581+0000 7f97058a8640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97000aad30 con 0x7f97000aa950 2024-09-15T20:51:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.581+0000 7f97058a8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f970013bfa0 con 0x7f970013baf0 2024-09-15T20:51:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.581+0000 7f97058a8640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f9700141c20 con 0x7f9700070650 2024-09-15T20:51:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96feffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f97000aa950 0x7f9700142140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57264/0 (socket says 172.21.15.52:57264) 2024-09-15T20:51:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96feffd640 1 -- 172.21.15.52:0/4196887655 learned_addr learned my addr 172.21.15.52:0/4196887655 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96fe7fc640 1 --2- 172.21.15.52:0/4196887655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9700070650 0x7f970013b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96ff7fe640 1 --2- 172.21.15.52:0/4196887655 >> v2:172.21.15.81:3300/0 conn(0x7f970013baf0 0x7f970014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96fdffb640 1 -- 172.21.15.52:0/4196887655 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 81053823 0 0) 0x7f96e8001120 con 0x7f97000aa950 2024-09-15T20:51:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96fdffb640 1 -- 172.21.15.52:0/4196887655 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96ec003530 con 0x7f97000aa950 2024-09-15T20:51:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96fe7fc640 1 -- 172.21.15.52:0/4196887655 >> v2:172.21.15.81:3300/0 conn(0x7f970013baf0 msgr2=0x7f970014c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:33.588 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96fe7fc640 1 --2- 172.21.15.52:0/4196887655 >> v2:172.21.15.81:3300/0 conn(0x7f970013baf0 0x7f970014c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96fe7fc640 1 -- 172.21.15.52:0/4196887655 >> v1:172.21.15.52:6789/0 conn(0x7f97000aa950 legacy=0x7f9700142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.589 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96fe7fc640 1 -- 172.21.15.52:0/4196887655 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97000b2100 con 0x7f9700070650 2024-09-15T20:51:33.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96fe7fc640 1 --2- 172.21.15.52:0/4196887655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9700070650 0x7f970013b5b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009d90 tx=0x7f96f001c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c33ea64b7f3cec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:33.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96fdffb640 1 -- 172.21.15.52:0/4196887655 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f00b2070 con 0x7f9700070650 2024-09-15T20:51:33.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96fdffb640 1 -- 172.21.15.52:0/4196887655 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f00a5830 con 0x7f9700070650 2024-09-15T20:51:33.590 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f96fdffb640 1 -- 172.21.15.52:0/4196887655 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f00a5c00 con 0x7f9700070650 2024-09-15T20:51:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f97058a8640 1 -- 172.21.15.52:0/4196887655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9700070650 msgr2=0x7f970013b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f97058a8640 1 --2- 172.21.15.52:0/4196887655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9700070650 0x7f970013b5b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f96f0009d90 tx=0x7f96f001c860 comp rx=0 tx=0).stop 2024-09-15T20:51:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f97058a8640 1 -- 172.21.15.52:0/4196887655 shutdown_connections 2024-09-15T20:51:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f97058a8640 1 --2- 172.21.15.52:0/4196887655 >> v2:172.21.15.81:3300/0 conn(0x7f970013baf0 0x7f970014c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f97058a8640 1 --2- 172.21.15.52:0/4196887655 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9700070650 0x7f970013b5b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f97058a8640 1 -- 172.21.15.52:0/4196887655 >> 172.21.15.52:0/4196887655 conn(0x7f97000b59a0 msgr2=0x7f97000b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f97058a8640 1 -- 172.21.15.52:0/4196887655 shutdown_connections 2024-09-15T20:51:33.591 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.585+0000 7f97058a8640 1 -- 172.21.15.52:0/4196887655 wait complete. 2024-09-15T20:51:33.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f97058a8640 1 Processor -- start 2024-09-15T20:51:33.592 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f97058a8640 1 -- start start 2024-09-15T20:51:33.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f97058a8640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9700070650 0x7f970013d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:33.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f97058a8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97000aa950 0x7f97001306b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:33.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f97058a8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f970013baf0 0x7f9700130bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:33.593 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f97058a8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9700142850 con 0x7f970013baf0 2024-09-15T20:51:33.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f97058a8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97000b66d0 con 0x7f97000aa950 2024-09-15T20:51:33.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f97058a8640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f97001429d0 con 0x7f9700070650 2024-09-15T20:51:33.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96feffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9700070650 0x7f970013d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:33.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96ff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f970013baf0 0x7f9700130bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:33.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96ff7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f970013baf0 0x7f9700130bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33018/0 (socket says 172.21.15.52:33018) 2024-09-15T20:51:33.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96feffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9700070650 0x7f970013d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46682/0 (socket says 172.21.15.52:46682) 2024-09-15T20:51:33.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96ff7fe640 1 -- 172.21.15.52:0/3614101814 learned_addr learned my addr 172.21.15.52:0/3614101814 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:33.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96fe7fc640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97000aa950 0x7f97001306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:33.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96feffd640 1 -- 172.21.15.52:0/3614101814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97000aa950 msgr2=0x7f97001306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96feffd640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97000aa950 0x7f97001306b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96feffd640 1 -- 172.21.15.52:0/3614101814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f970013baf0 msgr2=0x7f9700130bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96feffd640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f970013baf0 0x7f9700130bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96feffd640 1 -- 172.21.15.52:0/3614101814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970013ee90 con 0x7f9700070650 2024-09-15T20:51:33.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96ff7fe640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f970013baf0 0x7f9700130bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:33.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96feffd640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9700070650 0x7f970013d070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f96e800c730 tx=0x7f96e800cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:33.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96f7fff640 1 -- 172.21.15.52:0/3614101814 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e8017070 con 0x7f9700070650 2024-09-15T20:51:33.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96f7fff640 1 -- 172.21.15.52:0/3614101814 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e80058c0 con 0x7f9700070650 2024-09-15T20:51:33.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96f7fff640 1 -- 172.21.15.52:0/3614101814 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e8005cd0 con 0x7f9700070650 2024-09-15T20:51:33.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f97058a8640 1 -- 172.21.15.52:0/3614101814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970013cb50 con 0x7f9700070650 2024-09-15T20:51:33.595 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f97058a8640 1 -- 172.21.15.52:0/3614101814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f970013c6c0 con 0x7f9700070650 2024-09-15T20:51:33.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f97058a8640 1 -- 172.21.15.52:0/3614101814 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f970013b5b0 con 0x7f9700070650 2024-09-15T20:51:33.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.589+0000 7f96f7fff640 1 -- 172.21.15.52:0/3614101814 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f96e801a070 con 0x7f9700070650 2024-09-15T20:51:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.593+0000 7f96f7fff640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f96e0072ec0 0x7f96e0075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.593+0000 7f96f7fff640 1 -- 172.21.15.52:0/3614101814 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f96e8093750 con 0x7f9700070650 2024-09-15T20:51:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.593+0000 7f96f7fff640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] conn(0x7f96e007a080 0x7f96e007c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.593+0000 7f96f7fff640 1 -- 172.21.15.52:0/3614101814 --> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96e8016ec0 con 0x7f96e007a080 2024-09-15T20:51:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.593+0000 7f96f7fff640 1 -- 172.21.15.52:0/3614101814 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f96e8093b00 con 0x7f9700070650 2024-09-15T20:51:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.593+0000 7f96ff7fe640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] conn(0x7f96e007a080 0x7f96e007c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.593+0000 7f96fe7fc640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f96e0072ec0 0x7f96e0075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.593+0000 7f96ff7fe640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] conn(0x7f96e007a080 0x7f96e007c4a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.593+0000 7f96fe7fc640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f96e0072ec0 0x7f96e0075380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f96f00af000 tx=0x7f96f00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:33.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.593+0000 7f96f7fff640 1 -- 172.21.15.52:0/3614101814 <== osd.0 v2:172.21.15.52:6800/1039594647 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96e8016ec0 con 0x7f96e007a080 2024-09-15T20:51:33.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.605+0000 7f97058a8640 1 -- 172.21.15.52:0/3614101814 --> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9700143270 con 0x7f96e007a080 2024-09-15T20:51:33.611 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.605+0000 7f96f7fff640 1 -- 172.21.15.52:0/3614101814 <== osd.0 v2:172.21.15.52:6800/1039594647 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9700143270 con 0x7f96e007a080 2024-09-15T20:51:33.612 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-15T20:51:33.612 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T20:51:33.612 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-15T20:51:33.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.605+0000 7f97058a8640 1 -- 172.21.15.52:0/3614101814 >> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] conn(0x7f96e007a080 msgr2=0x7f96e007c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.605+0000 7f97058a8640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.52:6800/1039594647,v1:172.21.15.52:6801/1039594647] conn(0x7f96e007a080 0x7f96e007c4a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.605+0000 7f97058a8640 1 -- 172.21.15.52:0/3614101814 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f96e0072ec0 msgr2=0x7f96e0075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.605+0000 7f97058a8640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f96e0072ec0 0x7f96e0075380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f96f00af000 tx=0x7f96f00a7070 comp rx=0 tx=0).stop 2024-09-15T20:51:33.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.605+0000 7f97058a8640 1 -- 172.21.15.52:0/3614101814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9700070650 msgr2=0x7f970013d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.605+0000 7f97058a8640 1 --2- 172.21.15.52:0/3614101814 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f9700070650 0x7f970013d070 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f96e800c730 tx=0x7f96e800cbf0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.605+0000 7f96ff7fe640 1 -- 172.21.15.52:0/3614101814 reap_dead start 2024-09-15T20:51:33.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.605+0000 7f97058a8640 1 -- 172.21.15.52:0/3614101814 shutdown_connections 2024-09-15T20:51:33.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.605+0000 7f97058a8640 1 -- 172.21.15.52:0/3614101814 >> 172.21.15.52:0/3614101814 conn(0x7f97000b59a0 msgr2=0x7f9700139590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:33.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.605+0000 7f97058a8640 1 -- 172.21.15.52:0/3614101814 shutdown_connections 2024-09-15T20:51:33.613 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.609+0000 7f97058a8640 1 -- 172.21.15.52:0/3614101814 wait complete. 2024-09-15T20:51:33.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T20:51:33.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.741+0000 7f4affb0f640 1 Processor -- start 2024-09-15T20:51:33.747 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.741+0000 7f4affb0f640 1 -- start start 2024-09-15T20:51:33.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4affb0f640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4af8144580 0x7f4af813a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:33.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4affb0f640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af8070c90 con 0x7f4af80708b0 2024-09-15T20:51:33.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4affb0f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af80b64c0 con 0x7f4af813a7e0 2024-09-15T20:51:33.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4affb0f640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f4af80737b0 con 0x7f4af8144580 2024-09-15T20:51:33.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4afd0aa640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4af8144580 0x7f4af813a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:33.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4afd8ab640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4af80708b0 0x7f4af8143e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57280/0 (socket says 172.21.15.52:57280) 2024-09-15T20:51:33.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4afd8ab640 1 -- 172.21.15.52:0/3017204429 learned_addr learned my addr 172.21.15.52:0/3017204429 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:33.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4afd0aa640 1 -- 172.21.15.52:0/3017204429 >> v1:172.21.15.81:6789/0 conn(0x7f4af813a7e0 legacy=0x7f4af814b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:33.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4afd0aa640 1 -- 172.21.15.52:0/3017204429 >> v1:172.21.15.52:6789/0 conn(0x7f4af80708b0 legacy=0x7f4af8143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.749 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4afd0aa640 1 -- 172.21.15.52:0/3017204429 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af80ab840 con 0x7f4af8144580 2024-09-15T20:51:33.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4afd0aa640 1 --2- 172.21.15.52:0/3017204429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af8144580 0x7f4af813a2a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4af8073930 tx=0x7f4ae801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6539b42fca0f294 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:33.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4afc8a9640 1 -- 172.21.15.52:0/3017204429 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae80b2070 con 0x7f4af8144580 2024-09-15T20:51:33.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4afc8a9640 1 -- 172.21.15.52:0/3017204429 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae80ad640 con 0x7f4af8144580 2024-09-15T20:51:33.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.745+0000 7f4afc8a9640 1 -- 172.21.15.52:0/3017204429 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae80ada10 con 0x7f4af8144580 2024-09-15T20:51:33.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 -- 172.21.15.52:0/3017204429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af8144580 msgr2=0x7f4af813a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 --2- 172.21.15.52:0/3017204429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af8144580 0x7f4af813a2a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4af8073930 tx=0x7f4ae801c3f0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 -- 172.21.15.52:0/3017204429 shutdown_connections 2024-09-15T20:51:33.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 --2- 172.21.15.52:0/3017204429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af8144580 0x7f4af813a2a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 -- 172.21.15.52:0/3017204429 >> 172.21.15.52:0/3017204429 conn(0x7f4af80b59a0 msgr2=0x7f4af80b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:33.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 -- 172.21.15.52:0/3017204429 shutdown_connections 2024-09-15T20:51:33.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 -- 172.21.15.52:0/3017204429 wait complete. 2024-09-15T20:51:33.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 Processor -- start 2024-09-15T20:51:33.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 -- start start 2024-09-15T20:51:33.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80708b0 0x7f4af8143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:33.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af813a7e0 0x7f4af80ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:33.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4af8144580 0x7f4af80afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:33.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4af80aa8d0 con 0x7f4af80708b0 2024-09-15T20:51:33.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8073c20 con 0x7f4af813a7e0 2024-09-15T20:51:33.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f4af80ad580 con 0x7f4af8144580 2024-09-15T20:51:33.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4afd8ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80708b0 0x7f4af8143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:33.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4afd8ab640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80708b0 0x7f4af8143020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33030/0 (socket says 172.21.15.52:33030) 2024-09-15T20:51:33.755 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4afe0ac640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4af8144580 0x7f4af80afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4afd8ab640 1 -- 172.21.15.52:0/840026275 learned_addr learned my addr 172.21.15.52:0/840026275 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4afd8ab640 1 -- 172.21.15.52:0/840026275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4af8144580 msgr2=0x7f4af80afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4afd0aa640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af813a7e0 0x7f4af80ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4afd8ab640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4af8144580 0x7f4af80afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4afd8ab640 1 -- 172.21.15.52:0/840026275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af813a7e0 msgr2=0x7f4af80ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4afd8ab640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af813a7e0 0x7f4af80ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4afd8ab640 1 -- 172.21.15.52:0/840026275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af80af5f0 con 0x7f4af80708b0 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4afd8ab640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80708b0 0x7f4af8143020 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4af400c480 tx=0x7f4af400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4aee7fc640 1 -- 172.21.15.52:0/840026275 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4017070 con 0x7f4af80708b0 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4aee7fc640 1 -- 172.21.15.52:0/840026275 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af4005d10 con 0x7f4af80708b0 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 -- 172.21.15.52:0/840026275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af8135020 con 0x7f4af80708b0 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4aee7fc640 1 -- 172.21.15.52:0/840026275 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af40072b0 con 0x7f4af80708b0 2024-09-15T20:51:33.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 -- 172.21.15.52:0/840026275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af80adc60 con 0x7f4af80708b0 2024-09-15T20:51:33.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.749+0000 7f4affb0f640 1 -- 172.21.15.52:0/840026275 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af813a2a0 con 0x7f4af80708b0 2024-09-15T20:51:33.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.753+0000 7f4aee7fc640 1 -- 172.21.15.52:0/840026275 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f4af401a070 con 0x7f4af80708b0 2024-09-15T20:51:33.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.753+0000 7f4aee7fc640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4adc072ec0 0x7f4adc075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:33.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.753+0000 7f4aee7fc640 1 -- 172.21.15.52:0/840026275 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f4af4092e30 con 0x7f4af80708b0 2024-09-15T20:51:33.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.753+0000 7f4afd0aa640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4adc072ec0 0x7f4adc075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:33.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.753+0000 7f4afd0aa640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4adc072ec0 0x7f4adc075380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80af000 tx=0x7f4ae8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:33.761 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.757+0000 7f4aee7fc640 1 -- 172.21.15.52:0/840026275 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f4af8070c90 con 0x7f4af80708b0 2024-09-15T20:51:33.932 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.929+0000 7f4affb0f640 1 -- 172.21.15.52:0/840026275 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f4af806d120 con 0x7f4adc072ec0 2024-09-15T20:51:33.933 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.929+0000 7f4aee7fc640 1 -- 172.21.15.52:0/840026275 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4af806d120 con 0x7f4adc072ec0 2024-09-15T20:51:33.933 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T20:51:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.933+0000 7f4affb0f640 1 -- 172.21.15.52:0/840026275 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4adc072ec0 msgr2=0x7f4adc075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.933+0000 7f4affb0f640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4adc072ec0 0x7f4adc075380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80af000 tx=0x7f4ae8008040 comp rx=0 tx=0).stop 2024-09-15T20:51:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.933+0000 7f4affb0f640 1 -- 172.21.15.52:0/840026275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80708b0 msgr2=0x7f4af8143020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.933+0000 7f4affb0f640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80708b0 0x7f4af8143020 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4af400c480 tx=0x7f4af400c940 comp rx=0 tx=0).stop 2024-09-15T20:51:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.933+0000 7f4affb0f640 1 -- 172.21.15.52:0/840026275 shutdown_connections 2024-09-15T20:51:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.933+0000 7f4affb0f640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4adc072ec0 0x7f4adc075380 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.933+0000 7f4affb0f640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f4af8144580 0x7f4af80afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.936 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.933+0000 7f4affb0f640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4af813a7e0 0x7f4af80ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.933+0000 7f4affb0f640 1 --2- 172.21.15.52:0/840026275 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4af80708b0 0x7f4af8143020 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:33.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.933+0000 7f4affb0f640 1 -- 172.21.15.52:0/840026275 >> 172.21.15.52:0/840026275 conn(0x7f4af80b59a0 msgr2=0x7f4af8140880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:33.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.933+0000 7f4affb0f640 1 -- 172.21.15.52:0/840026275 shutdown_connections 2024-09-15T20:51:33.937 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:33.933+0000 7f4affb0f640 1 -- 172.21.15.52:0/840026275 wait complete. 2024-09-15T20:51:33.954 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T20:51:33.954 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T20:51:34.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.081+0000 7fe6ddfca640 1 Processor -- start 2024-09-15T20:51:34.087 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.081+0000 7fe6ddfca640 1 -- start start 2024-09-15T20:51:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6ddfca640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6d8068c90 0x7fe6d8072c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6ddfca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 0x7fe6d81434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6ddfca640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6d8148130 con 0x7fe6d8147590 2024-09-15T20:51:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6ddfca640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe6d8069070 con 0x7fe6d8068c90 2024-09-15T20:51:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6ddfca640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d8073520 con 0x7fe6d8143060 2024-09-15T20:51:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d6ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 0x7fe6d81434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d6ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 0x7fe6d81434b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46702/0 (socket says 172.21.15.52:46702) 2024-09-15T20:51:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d6ffd640 1 -- 172.21.15.52:0/2960426575 learned_addr learned my addr 172.21.15.52:0/2960426575 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d77fe640 1 --2- 172.21.15.52:0/2960426575 >> v2:172.21.15.81:3300/0 conn(0x7fe6d8068c90 0x7fe6d8072c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d6ffd640 1 -- 172.21.15.52:0/2960426575 >> v2:172.21.15.81:3300/0 conn(0x7fe6d8068c90 msgr2=0x7fe6d8072c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:34.089 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d6ffd640 1 --2- 172.21.15.52:0/2960426575 >> v2:172.21.15.81:3300/0 conn(0x7fe6d8068c90 0x7fe6d8072c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d6ffd640 1 -- 172.21.15.52:0/2960426575 >> v1:172.21.15.81:6789/0 conn(0x7fe6d8147590 legacy=0x7fe6d8147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:34.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d6ffd640 1 -- 172.21.15.52:0/2960426575 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d81439f0 con 0x7fe6d8143060 2024-09-15T20:51:34.090 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d77fe640 1 --2- 172.21.15.52:0/2960426575 >> v2:172.21.15.81:3300/0 conn(0x7fe6d8068c90 0x7fe6d8072c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:51:34.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d6ffd640 1 --2- 172.21.15.52:0/2960426575 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 0x7fe6d81434b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009870 tx=0x7fe6c001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b79cdac2574c524 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d67fc640 1 -- 172.21.15.52:0/2960426575 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00b0070 con 0x7fe6d8143060 2024-09-15T20:51:34.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d67fc640 1 -- 172.21.15.52:0/2960426575 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c00ab600 con 0x7fe6d8143060 2024-09-15T20:51:34.091 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.085+0000 7fe6d67fc640 1 -- 172.21.15.52:0/2960426575 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00ab9d0 con 0x7fe6d8143060 2024-09-15T20:51:34.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 -- 172.21.15.52:0/2960426575 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 msgr2=0x7fe6d81434b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 --2- 172.21.15.52:0/2960426575 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 0x7fe6d81434b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009870 tx=0x7fe6c001c420 comp rx=0 tx=0).stop 2024-09-15T20:51:34.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 -- 172.21.15.52:0/2960426575 shutdown_connections 2024-09-15T20:51:34.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 --2- 172.21.15.52:0/2960426575 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 0x7fe6d81434b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 --2- 172.21.15.52:0/2960426575 >> v2:172.21.15.81:3300/0 conn(0x7fe6d8068c90 0x7fe6d8072c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 -- 172.21.15.52:0/2960426575 >> 172.21.15.52:0/2960426575 conn(0x7fe6d80b7730 msgr2=0x7fe6d806e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:34.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 -- 172.21.15.52:0/2960426575 shutdown_connections 2024-09-15T20:51:34.092 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 -- 172.21.15.52:0/2960426575 wait complete. 2024-09-15T20:51:34.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 Processor -- start 2024-09-15T20:51:34.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 -- start start 2024-09-15T20:51:34.097 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6d8068c90 0x7fe6d8139260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 0x7fe6d80b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6d8147590 0x7fe6d8139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d81511f0 con 0x7fe6d8147590 2024-09-15T20:51:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6d8151070 con 0x7fe6d8068c90 2024-09-15T20:51:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fe6d8151370 con 0x7fe6d8143060 2024-09-15T20:51:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6d6ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 0x7fe6d80b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6d6ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 0x7fe6d80b62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46708/0 (socket says 172.21.15.52:46708) 2024-09-15T20:51:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6d6ffd640 1 -- 172.21.15.52:0/3706460478 learned_addr learned my addr 172.21.15.52:0/3706460478 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6d7fff640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6d8147590 0x7fe6d8139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6d77fe640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6d8068c90 0x7fe6d8139260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6d6ffd640 1 -- 172.21.15.52:0/3706460478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6d8068c90 msgr2=0x7fe6d8139260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.098 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6d6ffd640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6d8068c90 0x7fe6d8139260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6d6ffd640 1 -- 172.21.15.52:0/3706460478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6d8147590 msgr2=0x7fe6d8139dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6d6ffd640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6d8147590 0x7fe6d8139dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6d6ffd640 1 -- 172.21.15.52:0/3706460478 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6d813bcc0 con 0x7fe6d8143060 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6d6ffd640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 0x7fe6d80b62d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00ae040 tx=0x7fe6c00191c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6cffff640 1 -- 172.21.15.52:0/3706460478 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00b0040 con 0x7fe6d8143060 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6cffff640 1 -- 172.21.15.52:0/3706460478 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6c00b4640 con 0x7fe6d8143060 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6cffff640 1 -- 172.21.15.52:0/3706460478 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00b4a30 con 0x7fe6d8143060 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 -- 172.21.15.52:0/3706460478 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6d8134460 con 0x7fe6d8143060 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 -- 172.21.15.52:0/3706460478 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6d813c720 con 0x7fe6d8143060 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.089+0000 7fe6ddfca640 1 -- 172.21.15.52:0/3706460478 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe6d8072c50 con 0x7fe6d8143060 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.093+0000 7fe6cffff640 1 -- 172.21.15.52:0/3706460478 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fe6c00ab4c0 con 0x7fe6d8143060 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.093+0000 7fe6cffff640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fe6b8072ec0 0x7fe6b8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.093+0000 7fe6cffff640 1 -- 172.21.15.52:0/3706460478 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7fe6c012e270 con 0x7fe6d8143060 2024-09-15T20:51:34.099 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.093+0000 7fe6cffff640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] conn(0x7fe6b807a080 0x7fe6b807c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.093+0000 7fe6cffff640 1 -- 172.21.15.52:0/3706460478 --> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6c00aee70 con 0x7fe6b807a080 2024-09-15T20:51:34.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.093+0000 7fe6cffff640 1 -- 172.21.15.52:0/3706460478 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe6c012e700 con 0x7fe6d8143060 2024-09-15T20:51:34.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.093+0000 7fe6d7fff640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] conn(0x7fe6b807a080 0x7fe6b807c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.093+0000 7fe6d77fe640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fe6b8072ec0 0x7fe6b8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.093+0000 7fe6d7fff640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] conn(0x7fe6b807a080 0x7fe6b807c4a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.093+0000 7fe6d77fe640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fe6b8072ec0 0x7fe6b8075380 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80075b0 tx=0x7fe6c8007540 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.100 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.093+0000 7fe6cffff640 1 -- 172.21.15.52:0/3706460478 <== osd.1 v2:172.21.15.52:6816/1590363289 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6c00aee70 con 0x7fe6b807a080 2024-09-15T20:51:34.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6ddfca640 1 -- 172.21.15.52:0/3706460478 --> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe6d8140d20 con 0x7fe6b807a080 2024-09-15T20:51:34.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6cffff640 1 -- 172.21.15.52:0/3706460478 <== osd.1 v2:172.21.15.52:6816/1590363289 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe6d8140d20 con 0x7fe6b807a080 2024-09-15T20:51:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-15T20:51:34.112 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T20:51:34.112 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-15T20:51:34.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6ddfca640 1 -- 172.21.15.52:0/3706460478 >> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] conn(0x7fe6b807a080 msgr2=0x7fe6b807c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6ddfca640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.52:6816/1590363289,v1:172.21.15.52:6817/1590363289] conn(0x7fe6b807a080 0x7fe6b807c4a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6ddfca640 1 -- 172.21.15.52:0/3706460478 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fe6b8072ec0 msgr2=0x7fe6b8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6ddfca640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fe6b8072ec0 0x7fe6b8075380 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe6c80075b0 tx=0x7fe6c8007540 comp rx=0 tx=0).stop 2024-09-15T20:51:34.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6ddfca640 1 -- 172.21.15.52:0/3706460478 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 msgr2=0x7fe6d80b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6ddfca640 1 --2- 172.21.15.52:0/3706460478 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fe6d8143060 0x7fe6d80b62d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00ae040 tx=0x7fe6c00191c0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6d7fff640 1 -- 172.21.15.52:0/3706460478 reap_dead start 2024-09-15T20:51:34.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6ddfca640 1 -- 172.21.15.52:0/3706460478 shutdown_connections 2024-09-15T20:51:34.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6ddfca640 1 -- 172.21.15.52:0/3706460478 >> 172.21.15.52:0/3706460478 conn(0x7fe6d80b7730 msgr2=0x7fe6d80b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:34.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6ddfca640 1 -- 172.21.15.52:0/3706460478 shutdown_connections 2024-09-15T20:51:34.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.109+0000 7fe6ddfca640 1 -- 172.21.15.52:0/3706460478 wait complete. 2024-09-15T20:51:34.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T20:51:34.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.241+0000 7f50143d6640 1 Processor -- start 2024-09-15T20:51:34.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.241+0000 7f50143d6640 1 -- start start 2024-09-15T20:51:34.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.241+0000 7f50143d6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f500c0727e0 0x7f500c072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.241+0000 7f50143d6640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f500c13a190 0x7f500c13a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.241+0000 7f50143d6640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500c0b6640 con 0x7f500c070670 2024-09-15T20:51:34.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.241+0000 7f50143d6640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f500c143da0 con 0x7f500c13a190 2024-09-15T20:51:34.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.241+0000 7f50143d6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f500c073c50 con 0x7f500c0727e0 2024-09-15T20:51:34.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5012172640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f500c0727e0 0x7f500c072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.247 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5012973640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f500c13a190 0x7f500c13a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5012172640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f500c0727e0 0x7f500c072bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46710/0 (socket says 172.21.15.52:46710) 2024-09-15T20:51:34.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5012172640 1 -- 172.21.15.52:0/1315887133 learned_addr learned my addr 172.21.15.52:0/1315887133 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:34.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5011170640 1 -- 172.21.15.52:0/1315887133 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865349020 0 0) 0x7f500c0b6640 con 0x7f500c070670 2024-09-15T20:51:34.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5011170640 1 -- 172.21.15.52:0/1315887133 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ff8003530 con 0x7f500c070670 2024-09-15T20:51:34.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5012172640 1 -- 172.21.15.52:0/1315887133 >> v2:172.21.15.52:3300/0 conn(0x7f500c13a190 msgr2=0x7f500c13a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:34.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5012172640 1 --2- 172.21.15.52:0/1315887133 >> v2:172.21.15.52:3300/0 conn(0x7f500c13a190 0x7f500c13a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5012172640 1 -- 172.21.15.52:0/1315887133 >> v1:172.21.15.52:6789/0 conn(0x7f500c070670 legacy=0x7f500c144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5012172640 1 -- 172.21.15.52:0/1315887133 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c073870 con 0x7f500c0727e0 2024-09-15T20:51:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5012172640 1 --2- 172.21.15.52:0/1315887133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f500c0727e0 0x7f500c072bc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5008009e50 tx=0x7f500801c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee8f5c20519a106 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5011170640 1 -- 172.21.15.52:0/1315887133 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50080a64c0 con 0x7f500c0727e0 2024-09-15T20:51:34.250 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5011170640 1 -- 172.21.15.52:0/1315887133 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50080a6660 con 0x7f500c0727e0 2024-09-15T20:51:34.251 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.245+0000 7f5011170640 1 -- 172.21.15.52:0/1315887133 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50080a6a30 con 0x7f500c0727e0 2024-09-15T20:51:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 -- 172.21.15.52:0/1315887133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f500c0727e0 msgr2=0x7f500c072bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 --2- 172.21.15.52:0/1315887133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f500c0727e0 0x7f500c072bc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5008009e50 tx=0x7f500801c980 comp rx=0 tx=0).stop 2024-09-15T20:51:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 -- 172.21.15.52:0/1315887133 shutdown_connections 2024-09-15T20:51:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 --2- 172.21.15.52:0/1315887133 >> v2:172.21.15.52:3300/0 conn(0x7f500c13a190 0x7f500c13a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 --2- 172.21.15.52:0/1315887133 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f500c0727e0 0x7f500c072bc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 -- 172.21.15.52:0/1315887133 >> 172.21.15.52:0/1315887133 conn(0x7f500c0b9f80 msgr2=0x7f500c0ba390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 -- 172.21.15.52:0/1315887133 shutdown_connections 2024-09-15T20:51:34.252 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 -- 172.21.15.52:0/1315887133 wait complete. 2024-09-15T20:51:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 Processor -- start 2024-09-15T20:51:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 -- start start 2024-09-15T20:51:34.253 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f500c070670 0x7f500c13cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.254 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f500c0727e0 0x7f500c13fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f500c13a190 0x7f500c1dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f500c1510a0 con 0x7f500c070670 2024-09-15T20:51:34.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f500c150f20 con 0x7f500c0727e0 2024-09-15T20:51:34.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f50143d6640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f500c151220 con 0x7f500c13a190 2024-09-15T20:51:34.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f5012172640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f500c070670 0x7f500c13cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f5012172640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f500c070670 0x7f500c13cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33064/0 (socket says 172.21.15.52:33064) 2024-09-15T20:51:34.255 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f5012172640 1 -- 172.21.15.52:0/3846368705 learned_addr learned my addr 172.21.15.52:0/3846368705 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f5012973640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f500c13a190 0x7f500c1dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f5011971640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f500c0727e0 0x7f500c13fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f5012172640 1 -- 172.21.15.52:0/3846368705 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f500c13a190 msgr2=0x7f500c1dbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f5012172640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f500c13a190 0x7f500c1dbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f5012172640 1 -- 172.21.15.52:0/3846368705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f500c0727e0 msgr2=0x7f500c13fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f5012172640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f500c0727e0 0x7f500c13fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f5012172640 1 -- 172.21.15.52:0/3846368705 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c140710 con 0x7f500c070670 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.249+0000 7f5012172640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f500c070670 0x7f500c13cb90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f500801c7b0 tx=0x7f5008019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.253+0000 7f5002ffd640 1 -- 172.21.15.52:0/3846368705 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50080bf070 con 0x7f500c070670 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.253+0000 7f5002ffd640 1 -- 172.21.15.52:0/3846368705 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50080a6810 con 0x7f500c070670 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.253+0000 7f50143d6640 1 -- 172.21.15.52:0/3846368705 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500c140190 con 0x7f500c070670 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.253+0000 7f5002ffd640 1 -- 172.21.15.52:0/3846368705 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008009510 con 0x7f500c070670 2024-09-15T20:51:34.256 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.253+0000 7f50143d6640 1 -- 172.21.15.52:0/3846368705 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f500c1dc0c0 con 0x7f500c070670 2024-09-15T20:51:34.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.253+0000 7f50143d6640 1 -- 172.21.15.52:0/3846368705 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500c072bc0 con 0x7f500c070670 2024-09-15T20:51:34.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.253+0000 7f5002ffd640 1 -- 172.21.15.52:0/3846368705 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f50080c2070 con 0x7f500c070670 2024-09-15T20:51:34.257 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.253+0000 7f5002ffd640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4ff0072ec0 0x7f4ff0075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.253+0000 7f5002ffd640 1 -- 172.21.15.52:0/3846368705 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f500812d920 con 0x7f500c070670 2024-09-15T20:51:34.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.253+0000 7f5011971640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4ff0072ec0 0x7f4ff0075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.258 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.253+0000 7f5011971640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4ff0072ec0 0x7f4ff0075380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f500c141350 tx=0x7f4ffc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.263 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.257+0000 7f5002ffd640 1 -- 172.21.15.52:0/3846368705 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f5008016600 con 0x7f500c070670 2024-09-15T20:51:34.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.473+0000 7f50143d6640 1 -- 172.21.15.52:0/3846368705 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f500c141a60 con 0x7f4ff0072ec0 2024-09-15T20:51:34.478 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.473+0000 7f5002ffd640 1 -- 172.21.15.52:0/3846368705 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f500c141a60 con 0x7f4ff0072ec0 2024-09-15T20:51:34.478 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T20:51:34.480 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.477+0000 7f50143d6640 1 -- 172.21.15.52:0/3846368705 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4ff0072ec0 msgr2=0x7f4ff0075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.477+0000 7f50143d6640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4ff0072ec0 0x7f4ff0075380 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f500c141350 tx=0x7f4ffc009040 comp rx=0 tx=0).stop 2024-09-15T20:51:34.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.477+0000 7f50143d6640 1 -- 172.21.15.52:0/3846368705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f500c070670 msgr2=0x7f500c13cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.477+0000 7f50143d6640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f500c070670 0x7f500c13cb90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f500801c7b0 tx=0x7f5008019720 comp rx=0 tx=0).stop 2024-09-15T20:51:34.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.477+0000 7f50143d6640 1 -- 172.21.15.52:0/3846368705 shutdown_connections 2024-09-15T20:51:34.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.477+0000 7f50143d6640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f4ff0072ec0 0x7f4ff0075380 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.477+0000 7f50143d6640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f500c13a190 0x7f500c1dbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.477+0000 7f50143d6640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f500c0727e0 0x7f500c13fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.477+0000 7f50143d6640 1 --2- 172.21.15.52:0/3846368705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f500c070670 0x7f500c13cb90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.477+0000 7f50143d6640 1 -- 172.21.15.52:0/3846368705 >> 172.21.15.52:0/3846368705 conn(0x7f500c0b9f80 msgr2=0x7f500c0b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:34.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.477+0000 7f50143d6640 1 -- 172.21.15.52:0/3846368705 shutdown_connections 2024-09-15T20:51:34.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.477+0000 7f50143d6640 1 -- 172.21.15.52:0/3846368705 wait complete. 2024-09-15T20:51:34.498 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T20:51:34.498 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T20:51:34.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc08b688640 1 Processor -- start 2024-09-15T20:51:34.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc08b688640 1 -- start start 2024-09-15T20:51:34.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc08b688640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc084145db0 0x7fc084138080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc08b688640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0840727d0 0x7fc0841385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc08b688640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0841456f0 con 0x7fc084145310 2024-09-15T20:51:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc08b688640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fc0840acb20 con 0x7fc0840727d0 2024-09-15T20:51:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc08b688640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc0840aa920 con 0x7fc084145db0 2024-09-15T20:51:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc089c25640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0840727d0 0x7fc0841385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc089c25640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc0840727d0 0x7fc0841385c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33080/0 (socket says 172.21.15.52:33080) 2024-09-15T20:51:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc089c25640 1 -- 172.21.15.52:0/2022419963 learned_addr learned my addr 172.21.15.52:0/2022419963 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc088c23640 1 --2- 172.21.15.52:0/2022419963 >> v2:172.21.15.81:3300/0 conn(0x7fc084145db0 0x7fc084138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc089c25640 1 -- 172.21.15.52:0/2022419963 >> v2:172.21.15.81:3300/0 conn(0x7fc084145db0 msgr2=0x7fc084138080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc089c25640 1 --2- 172.21.15.52:0/2022419963 >> v2:172.21.15.81:3300/0 conn(0x7fc084145db0 0x7fc084138080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc089c25640 1 -- 172.21.15.52:0/2022419963 >> v1:172.21.15.81:6789/0 conn(0x7fc084145310 legacy=0x7fc0840aadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.617+0000 7fc089c25640 1 -- 172.21.15.52:0/2022419963 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0840ab8b0 con 0x7fc0840727d0 2024-09-15T20:51:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc089c25640 1 --2- 172.21.15.52:0/2022419963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0840727d0 0x7fc0841385c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc0840ac120 tx=0x7fc07c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759bfa46502a2cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc07bfff640 1 -- 172.21.15.52:0/2022419963 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0a5570 con 0x7fc0840727d0 2024-09-15T20:51:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc07bfff640 1 -- 172.21.15.52:0/2022419963 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07c0a5710 con 0x7fc0840727d0 2024-09-15T20:51:34.623 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc07bfff640 1 -- 172.21.15.52:0/2022419963 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0a5ae0 con 0x7fc0840727d0 2024-09-15T20:51:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 -- 172.21.15.52:0/2022419963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0840727d0 msgr2=0x7fc0841385c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.624 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 --2- 172.21.15.52:0/2022419963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0840727d0 0x7fc0841385c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc0840ac120 tx=0x7fc07c01c8b0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 -- 172.21.15.52:0/2022419963 shutdown_connections 2024-09-15T20:51:34.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 --2- 172.21.15.52:0/2022419963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0840727d0 0x7fc0841385c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 --2- 172.21.15.52:0/2022419963 >> v2:172.21.15.81:3300/0 conn(0x7fc084145db0 0x7fc084138080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.625 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 -- 172.21.15.52:0/2022419963 >> 172.21.15.52:0/2022419963 conn(0x7fc084069560 msgr2=0x7fc0840b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:34.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 -- 172.21.15.52:0/2022419963 shutdown_connections 2024-09-15T20:51:34.626 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 -- 172.21.15.52:0/2022419963 wait complete. 2024-09-15T20:51:34.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 Processor -- start 2024-09-15T20:51:34.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 -- start start 2024-09-15T20:51:34.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0840727d0 0x7fc0840add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.632 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc084145310 0x7fc0840ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc084145db0 0x7fc08406ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc08414ee70 con 0x7fc084145310 2024-09-15T20:51:34.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0840ab6d0 con 0x7fc084145db0 2024-09-15T20:51:34.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc08b688640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fc08414eff0 con 0x7fc0840727d0 2024-09-15T20:51:34.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc088c23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc084145310 0x7fc0840ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc088c23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc084145310 0x7fc0840ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33092/0 (socket says 172.21.15.52:33092) 2024-09-15T20:51:34.633 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc088c23640 1 -- 172.21.15.52:0/3102305637 learned_addr learned my addr 172.21.15.52:0/3102305637 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:34.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc089424640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0840727d0 0x7fc0840add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc089c25640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc084145db0 0x7fc08406ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc088c23640 1 -- 172.21.15.52:0/3102305637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0840727d0 msgr2=0x7fc0840add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc088c23640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fc0840727d0 0x7fc0840add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc088c23640 1 -- 172.21.15.52:0/3102305637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc084145db0 msgr2=0x7fc08406ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc088c23640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc084145db0 0x7fc08406ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc088c23640 1 -- 172.21.15.52:0/3102305637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0840ad990 con 0x7fc084145310 2024-09-15T20:51:34.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc089c25640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc084145db0 0x7fc08406ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T20:51:34.634 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc088c23640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc084145310 0x7fc0840ad450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc07400d800 tx=0x7fc07400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.621+0000 7fc079ffb640 1 -- 172.21.15.52:0/3102305637 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07400b6c0 con 0x7fc084145310 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc079ffb640 1 -- 172.21.15.52:0/3102305637 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc074019070 con 0x7fc084145310 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc08b688640 1 -- 172.21.15.52:0/3102305637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0840ae8f0 con 0x7fc084145310 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc079ffb640 1 -- 172.21.15.52:0/3102305637 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07400ba60 con 0x7fc084145310 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc08b688640 1 -- 172.21.15.52:0/3102305637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc084133400 con 0x7fc084145310 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc08b688640 1 -- 172.21.15.52:0/3102305637 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0840aadb0 con 0x7fc084145310 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc079ffb640 1 -- 172.21.15.52:0/3102305637 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fc07400bc00 con 0x7fc084145310 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc079ffb640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fc068072ec0 0x7fc068075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc079ffb640 1 -- 172.21.15.52:0/3102305637 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7fc074094990 con 0x7fc084145310 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc079ffb640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] conn(0x7fc06807a080 0x7fc06807c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc079ffb640 1 -- 172.21.15.52:0/3102305637 --> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc074022ec0 con 0x7fc06807a080 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc079ffb640 1 -- 172.21.15.52:0/3102305637 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc074094e20 con 0x7fc084145310 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc089c25640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] conn(0x7fc06807a080 0x7fc06807c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.635 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc089424640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fc068072ec0 0x7fc068075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc089c25640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] conn(0x7fc06807a080 0x7fc06807c4a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc089424640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fc068072ec0 0x7fc068075380 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc080007fd0 tx=0x7fc080009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.636 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.625+0000 7fc079ffb640 1 -- 172.21.15.52:0/3102305637 <== osd.2 v2:172.21.15.52:6824/4164590883 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc074022ec0 con 0x7fc06807a080 2024-09-15T20:51:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc08b688640 1 -- 172.21.15.52:0/3102305637 --> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc0840706b0 con 0x7fc06807a080 2024-09-15T20:51:34.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc079ffb640 1 -- 172.21.15.52:0/3102305637 <== osd.2 v2:172.21.15.52:6824/4164590883 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc0840706b0 con 0x7fc06807a080 2024-09-15T20:51:34.644 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-15T20:51:34.644 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T20:51:34.645 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-15T20:51:34.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc08b688640 1 -- 172.21.15.52:0/3102305637 >> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] conn(0x7fc06807a080 msgr2=0x7fc06807c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc08b688640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.52:6824/4164590883,v1:172.21.15.52:6825/4164590883] conn(0x7fc06807a080 0x7fc06807c4a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc08b688640 1 -- 172.21.15.52:0/3102305637 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fc068072ec0 msgr2=0x7fc068075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc08b688640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fc068072ec0 0x7fc068075380 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc080007fd0 tx=0x7fc080009040 comp rx=0 tx=0).stop 2024-09-15T20:51:34.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc08b688640 1 -- 172.21.15.52:0/3102305637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc084145310 msgr2=0x7fc0840ad450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc08b688640 1 --2- 172.21.15.52:0/3102305637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc084145310 0x7fc0840ad450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc07400d800 tx=0x7fc07400dcc0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc089c25640 1 -- 172.21.15.52:0/3102305637 reap_dead start 2024-09-15T20:51:34.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc08b688640 1 -- 172.21.15.52:0/3102305637 shutdown_connections 2024-09-15T20:51:34.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc08b688640 1 -- 172.21.15.52:0/3102305637 >> 172.21.15.52:0/3102305637 conn(0x7fc084069560 msgr2=0x7fc0840b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:34.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc08b688640 1 -- 172.21.15.52:0/3102305637 shutdown_connections 2024-09-15T20:51:34.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.641+0000 7fc08b688640 1 -- 172.21.15.52:0/3102305637 wait complete. 2024-09-15T20:51:34.661 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T20:51:34.775 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff45599c640 1 Processor -- start 2024-09-15T20:51:34.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff45599c640 1 -- start start 2024-09-15T20:51:34.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff45599c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff450144580 0x7ff45013a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff45599c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff45013a7e0 0x7ff45014b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff45599c640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff450070c90 con 0x7ff4500708b0 2024-09-15T20:51:34.776 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff45599c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff4500737b0 con 0x7ff450144580 2024-09-15T20:51:34.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff45599c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ff4500b64c0 con 0x7ff45013a7e0 2024-09-15T20:51:34.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff44effd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff4500708b0 0x7ff450143e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57300/0 (socket says 172.21.15.52:57300) 2024-09-15T20:51:34.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff44effd640 1 -- 172.21.15.52:0/3190161731 learned_addr learned my addr 172.21.15.52:0/3190161731 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:34.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff44f7fe640 1 --2- 172.21.15.52:0/3190161731 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff45013a7e0 0x7ff45014b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.777 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff44f7fe640 1 -- 172.21.15.52:0/3190161731 >> v2:172.21.15.81:3300/0 conn(0x7ff450144580 msgr2=0x7ff45013a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:34.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff4467fc640 1 --2- 172.21.15.52:0/3190161731 >> v2:172.21.15.81:3300/0 conn(0x7ff450144580 0x7ff45013a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff44e7fc640 1 -- 172.21.15.52:0/3190161731 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2888181473 0 0) 0x7ff440001120 con 0x7ff4500708b0 2024-09-15T20:51:34.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff44f7fe640 1 --2- 172.21.15.52:0/3190161731 >> v2:172.21.15.81:3300/0 conn(0x7ff450144580 0x7ff45013a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff44f7fe640 1 -- 172.21.15.52:0/3190161731 >> v1:172.21.15.52:6789/0 conn(0x7ff4500708b0 legacy=0x7ff450143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff44f7fe640 1 -- 172.21.15.52:0/3190161731 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4500ab840 con 0x7ff45013a7e0 2024-09-15T20:51:34.778 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.773+0000 7ff4467fc640 1 --2- 172.21.15.52:0/3190161731 >> v2:172.21.15.81:3300/0 conn(0x7ff450144580 0x7ff45013a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:51:34.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff44f7fe640 1 --2- 172.21.15.52:0/3190161731 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff45013a7e0 0x7ff45014b200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff448009d90 tx=0x7ff44801c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bb0b14eebd11914 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff44e7fc640 1 -- 172.21.15.52:0/3190161731 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4480b2070 con 0x7ff45013a7e0 2024-09-15T20:51:34.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff44e7fc640 1 -- 172.21.15.52:0/3190161731 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4480a58c0 con 0x7ff45013a7e0 2024-09-15T20:51:34.780 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff44e7fc640 1 -- 172.21.15.52:0/3190161731 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4480a5c90 con 0x7ff45013a7e0 2024-09-15T20:51:34.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 -- 172.21.15.52:0/3190161731 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff45013a7e0 msgr2=0x7ff45014b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 --2- 172.21.15.52:0/3190161731 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff45013a7e0 0x7ff45014b200 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff448009d90 tx=0x7ff44801c860 comp rx=0 tx=0).stop 2024-09-15T20:51:34.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 -- 172.21.15.52:0/3190161731 shutdown_connections 2024-09-15T20:51:34.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 --2- 172.21.15.52:0/3190161731 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff45013a7e0 0x7ff45014b200 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 --2- 172.21.15.52:0/3190161731 >> v2:172.21.15.81:3300/0 conn(0x7ff450144580 0x7ff45013a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 -- 172.21.15.52:0/3190161731 >> 172.21.15.52:0/3190161731 conn(0x7ff4500b59a0 msgr2=0x7ff4500b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:34.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 -- 172.21.15.52:0/3190161731 shutdown_connections 2024-09-15T20:51:34.781 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 -- 172.21.15.52:0/3190161731 wait complete. 2024-09-15T20:51:34.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 Processor -- start 2024-09-15T20:51:34.782 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 -- start start 2024-09-15T20:51:34.783 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4500708b0 0x7ff45013f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff45013a7e0 0x7ff4500ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff450144580 0x7ff450135a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff45013ad60 con 0x7ff45013a7e0 2024-09-15T20:51:34.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4500aa8d0 con 0x7ff4500708b0 2024-09-15T20:51:34.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff45599c640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7ff450073c40 con 0x7ff450144580 2024-09-15T20:51:34.784 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff4467fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff45013a7e0 0x7ff4500ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff44f7fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff450144580 0x7ff450135a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff4467fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff45013a7e0 0x7ff4500ad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33098/0 (socket says 172.21.15.52:33098) 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff44f7fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff450144580 0x7ff450135a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46740/0 (socket says 172.21.15.52:46740) 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff4467fc640 1 -- 172.21.15.52:0/2828842990 learned_addr learned my addr 172.21.15.52:0/2828842990 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff44effd640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4500708b0 0x7ff45013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff4467fc640 1 -- 172.21.15.52:0/2828842990 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff450144580 msgr2=0x7ff450135a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff4467fc640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff450144580 0x7ff450135a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff4467fc640 1 -- 172.21.15.52:0/2828842990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4500708b0 msgr2=0x7ff45013f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff4467fc640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4500708b0 0x7ff45013f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff4467fc640 1 -- 172.21.15.52:0/2828842990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4501396d0 con 0x7ff45013a7e0 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.777+0000 7ff44effd640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4500708b0 0x7ff45013f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.781+0000 7ff4467fc640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff45013a7e0 0x7ff4500ad990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c820 tx=0x7ff43800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.781+0000 7ff44cff9640 1 -- 172.21.15.52:0/2828842990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438015070 con 0x7ff45013a7e0 2024-09-15T20:51:34.785 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.781+0000 7ff44cff9640 1 -- 172.21.15.52:0/2828842990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff438007a30 con 0x7ff45013a7e0 2024-09-15T20:51:34.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.781+0000 7ff45599c640 1 -- 172.21.15.52:0/2828842990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4500acf00 con 0x7ff45013a7e0 2024-09-15T20:51:34.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.781+0000 7ff44cff9640 1 -- 172.21.15.52:0/2828842990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438007e40 con 0x7ff45013a7e0 2024-09-15T20:51:34.786 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.781+0000 7ff45599c640 1 -- 172.21.15.52:0/2828842990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4500ad4c0 con 0x7ff45013a7e0 2024-09-15T20:51:34.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.781+0000 7ff45599c640 1 -- 172.21.15.52:0/2828842990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45013a2a0 con 0x7ff45013a7e0 2024-09-15T20:51:34.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.781+0000 7ff44cff9640 1 -- 172.21.15.52:0/2828842990 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7ff438018070 con 0x7ff45013a7e0 2024-09-15T20:51:34.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.781+0000 7ff44cff9640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff430072ec0 0x7ff430075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:34.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.781+0000 7ff44cff9640 1 -- 172.21.15.52:0/2828842990 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7ff438093a20 con 0x7ff45013a7e0 2024-09-15T20:51:34.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.781+0000 7ff44effd640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff430072ec0 0x7ff430075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:34.787 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.781+0000 7ff44effd640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff430072ec0 0x7ff430075380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff440001400 tx=0x7ff440009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:34.789 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.785+0000 7ff44cff9640 1 -- 172.21.15.52:0/2828842990 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7ff43805e6f0 con 0x7ff45013a7e0 2024-09-15T20:51:34.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff45599c640 1 -- 172.21.15.52:0/2828842990 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7ff45006d120 con 0x7ff430072ec0 2024-09-15T20:51:34.964 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff44cff9640 1 -- 172.21.15.52:0/2828842990 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff45006d120 con 0x7ff430072ec0 2024-09-15T20:51:34.965 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T20:51:34.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff45599c640 1 -- 172.21.15.52:0/2828842990 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff430072ec0 msgr2=0x7ff430075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff45599c640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff430072ec0 0x7ff430075380 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff440001400 tx=0x7ff440009040 comp rx=0 tx=0).stop 2024-09-15T20:51:34.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff45599c640 1 -- 172.21.15.52:0/2828842990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff45013a7e0 msgr2=0x7ff4500ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:34.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff45599c640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff45013a7e0 0x7ff4500ad990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c820 tx=0x7ff43800cce0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff45599c640 1 -- 172.21.15.52:0/2828842990 shutdown_connections 2024-09-15T20:51:34.967 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff45599c640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7ff430072ec0 0x7ff430075380 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff45599c640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7ff450144580 0x7ff450135a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff45599c640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff45013a7e0 0x7ff4500ad990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff45599c640 1 --2- 172.21.15.52:0/2828842990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4500708b0 0x7ff45013f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:34.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff45599c640 1 -- 172.21.15.52:0/2828842990 >> 172.21.15.52:0/2828842990 conn(0x7ff4500b59a0 msgr2=0x7ff4500b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:34.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.961+0000 7ff45599c640 1 -- 172.21.15.52:0/2828842990 shutdown_connections 2024-09-15T20:51:34.968 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:34.965+0000 7ff45599c640 1 -- 172.21.15.52:0/2828842990 wait complete. 2024-09-15T20:51:34.985 INFO:tasks.ceph:Scrubbing osd.3 2024-09-15T20:51:34.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-15T20:51:35.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5bb11f3640 1 Processor -- start 2024-09-15T20:51:35.109 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5bb11f3640 1 -- start start 2024-09-15T20:51:35.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5bb11f3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bac0708b0 0x7f5bac13fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5bb11f3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5bac0733d0 0x7f5bac140210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5bb11f3640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5bac143eb0 0x7f5bac144360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5bb11f3640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5bac0ab620 con 0x7f5bac143eb0 2024-09-15T20:51:35.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5bb11f3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5bac070c90 con 0x7f5bac0733d0 2024-09-15T20:51:35.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5bb11f3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f5bac073de0 con 0x7f5bac0708b0 2024-09-15T20:51:35.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5baad9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bac0708b0 0x7f5bac13fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5bab59e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5bac143eb0 0x7f5bac144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5baad9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bac0708b0 0x7f5bac13fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46744/0 (socket says 172.21.15.52:46744) 2024-09-15T20:51:35.111 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5baad9d640 1 -- 172.21.15.52:0/1089555671 learned_addr learned my addr 172.21.15.52:0/1089555671 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:35.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5baa59c640 1 --2- 172.21.15.52:0/1089555671 >> v2:172.21.15.81:3300/0 conn(0x7f5bac0733d0 0x7f5bac140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5baad9d640 1 -- 172.21.15.52:0/1089555671 >> v2:172.21.15.81:3300/0 conn(0x7f5bac0733d0 msgr2=0x7f5bac140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:35.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5baad9d640 1 --2- 172.21.15.52:0/1089555671 >> v2:172.21.15.81:3300/0 conn(0x7f5bac0733d0 0x7f5bac140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5baad9d640 1 -- 172.21.15.52:0/1089555671 >> v2:172.21.15.52:3300/0 conn(0x7f5bac143eb0 msgr2=0x7f5bac144360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:35.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5baad9d640 1 --2- 172.21.15.52:0/1089555671 >> v2:172.21.15.52:3300/0 conn(0x7f5bac143eb0 0x7f5bac144360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5baad9d640 1 -- 172.21.15.52:0/1089555671 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac0aa6d0 con 0x7f5bac0708b0 2024-09-15T20:51:35.112 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.105+0000 7f5bab59e640 1 --2- 172.21.15.52:0/1089555671 >> v2:172.21.15.52:3300/0 conn(0x7f5bac143eb0 0x7f5bac144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:35.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5baad9d640 1 --2- 172.21.15.52:0/1089555671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bac0708b0 0x7f5bac13fcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c009e50 tx=0x7f5b9c01c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ba8e8712dc605ce server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5ba9d9b640 1 -- 172.21.15.52:0/1089555671 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c0090d0 con 0x7f5bac0708b0 2024-09-15T20:51:35.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5ba9d9b640 1 -- 172.21.15.52:0/1089555671 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9c0a5630 con 0x7f5bac0708b0 2024-09-15T20:51:35.113 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5ba9d9b640 1 -- 172.21.15.52:0/1089555671 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c009270 con 0x7f5bac0708b0 2024-09-15T20:51:35.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5bb11f3640 1 -- 172.21.15.52:0/1089555671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bac0708b0 msgr2=0x7f5bac13fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.114 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5bb11f3640 1 --2- 172.21.15.52:0/1089555671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bac0708b0 0x7f5bac13fcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c009e50 tx=0x7f5b9c01c930 comp rx=0 tx=0).stop 2024-09-15T20:51:35.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5bb11f3640 1 -- 172.21.15.52:0/1089555671 shutdown_connections 2024-09-15T20:51:35.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5bb11f3640 1 --2- 172.21.15.52:0/1089555671 >> v2:172.21.15.52:3300/0 conn(0x7f5bac143eb0 0x7f5bac144360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5bb11f3640 1 --2- 172.21.15.52:0/1089555671 >> v2:172.21.15.81:3300/0 conn(0x7f5bac0733d0 0x7f5bac140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5bb11f3640 1 --2- 172.21.15.52:0/1089555671 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bac0708b0 0x7f5bac13fcd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5bb11f3640 1 -- 172.21.15.52:0/1089555671 >> 172.21.15.52:0/1089555671 conn(0x7f5bac0b59a0 msgr2=0x7f5bac0b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:35.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5bb11f3640 1 -- 172.21.15.52:0/1089555671 shutdown_connections 2024-09-15T20:51:35.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.109+0000 7f5bb11f3640 1 -- 172.21.15.52:0/1089555671 wait complete. 2024-09-15T20:51:35.115 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5bb11f3640 1 Processor -- start 2024-09-15T20:51:35.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5bb11f3640 1 -- start start 2024-09-15T20:51:35.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5bb11f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac0708b0 0x7f5bac13e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5bb11f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bac0733d0 0x7f5bac141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5bb11f3640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bac143eb0 0x7f5bac1422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.117 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5bb11f3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac072b90 con 0x7f5bac0733d0 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5bb11f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac072a10 con 0x7f5bac0708b0 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5bb11f3640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f5bac072d10 con 0x7f5bac143eb0 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5baa59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bac0733d0 0x7f5bac141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5baa59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bac0733d0 0x7f5bac141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33112/0 (socket says 172.21.15.52:33112) 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5baa59c640 1 -- 172.21.15.52:0/2699185325 learned_addr learned my addr 172.21.15.52:0/2699185325 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5bab59e640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bac143eb0 0x7f5bac1422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5baad9d640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac0708b0 0x7f5bac13e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5baa59c640 1 -- 172.21.15.52:0/2699185325 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bac143eb0 msgr2=0x7f5bac1422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5baa59c640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bac143eb0 0x7f5bac1422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5baa59c640 1 -- 172.21.15.52:0/2699185325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac0708b0 msgr2=0x7f5bac13e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5baa59c640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac0708b0 0x7f5bac13e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5baa59c640 1 -- 172.21.15.52:0/2699185325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac1437c0 con 0x7f5bac0733d0 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5baa59c640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bac0733d0 0x7f5bac141db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400d7d0 tx=0x7f5b9400dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5ba37fe640 1 -- 172.21.15.52:0/2699185325 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94004030 con 0x7f5bac0733d0 2024-09-15T20:51:35.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5bb11f3640 1 -- 172.21.15.52:0/2699185325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bac1393f0 con 0x7f5bac0733d0 2024-09-15T20:51:35.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5bb11f3640 1 -- 172.21.15.52:0/2699185325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bac0b5650 con 0x7f5bac0733d0 2024-09-15T20:51:35.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5ba37fe640 1 -- 172.21.15.52:0/2699185325 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b940041d0 con 0x7f5bac0733d0 2024-09-15T20:51:35.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5ba37fe640 1 -- 172.21.15.52:0/2699185325 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b940096a0 con 0x7f5bac0733d0 2024-09-15T20:51:35.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.113+0000 7f5bb11f3640 1 -- 172.21.15.52:0/2699185325 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b90000f90 con 0x7f5bac0733d0 2024-09-15T20:51:35.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.117+0000 7f5ba37fe640 1 -- 172.21.15.52:0/2699185325 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f5b94009840 con 0x7f5bac0733d0 2024-09-15T20:51:35.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.117+0000 7f5ba37fe640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5b8c072ec0 0x7f5b8c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.117+0000 7f5ba37fe640 1 -- 172.21.15.52:0/2699185325 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f5b940947f0 con 0x7f5bac0733d0 2024-09-15T20:51:35.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.117+0000 7f5ba37fe640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x7f5b8c07a080 0x7f5b8c07c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.117+0000 7f5ba37fe640 1 -- 172.21.15.52:0/2699185325 --> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b94012e50 con 0x7f5b8c07a080 2024-09-15T20:51:35.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.117+0000 7f5ba37fe640 1 -- 172.21.15.52:0/2699185325 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5b94094c80 con 0x7f5bac0733d0 2024-09-15T20:51:35.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.117+0000 7f5baad9d640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5b8c072ec0 0x7f5b8c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.117+0000 7f5bab59e640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x7f5b8c07a080 0x7f5b8c07c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.117+0000 7f5bab59e640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x7f5b8c07a080 0x7f5b8c07c4a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.117+0000 7f5baad9d640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5b8c072ec0 0x7f5b8c075380 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0ae000 tx=0x7f5b9c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.117+0000 7f5ba37fe640 1 -- 172.21.15.52:0/2699185325 <== osd.3 v2:172.21.15.52:6808/4053631670 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b94012e50 con 0x7f5b8c07a080 2024-09-15T20:51:35.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.129+0000 7f5bb11f3640 1 -- 172.21.15.52:0/2699185325 --> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5b90002ce0 con 0x7f5b8c07a080 2024-09-15T20:51:35.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.129+0000 7f5ba37fe640 1 -- 172.21.15.52:0/2699185325 <== osd.3 v2:172.21.15.52:6808/4053631670 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5b90002ce0 con 0x7f5b8c07a080 2024-09-15T20:51:35.136 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-15T20:51:35.136 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T20:51:35.136 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-15T20:51:35.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.129+0000 7f5bb11f3640 1 -- 172.21.15.52:0/2699185325 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x7f5b8c07a080 msgr2=0x7f5b8c07c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.129+0000 7f5bb11f3640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.52:6808/4053631670,v1:172.21.15.52:6809/4053631670] conn(0x7f5b8c07a080 0x7f5b8c07c4a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.133+0000 7f5bb11f3640 1 -- 172.21.15.52:0/2699185325 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5b8c072ec0 msgr2=0x7f5b8c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.133+0000 7f5bb11f3640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5b8c072ec0 0x7f5b8c075380 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0ae000 tx=0x7f5b9c0a7070 comp rx=0 tx=0).stop 2024-09-15T20:51:35.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.133+0000 7f5bb11f3640 1 -- 172.21.15.52:0/2699185325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bac0733d0 msgr2=0x7f5bac141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.133+0000 7f5bb11f3640 1 --2- 172.21.15.52:0/2699185325 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bac0733d0 0x7f5bac141db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400d7d0 tx=0x7f5b9400dbd0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.133+0000 7f5bab59e640 1 -- 172.21.15.52:0/2699185325 reap_dead start 2024-09-15T20:51:35.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.133+0000 7f5bb11f3640 1 -- 172.21.15.52:0/2699185325 shutdown_connections 2024-09-15T20:51:35.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.133+0000 7f5bb11f3640 1 -- 172.21.15.52:0/2699185325 >> 172.21.15.52:0/2699185325 conn(0x7f5bac0b59a0 msgr2=0x7f5bac13c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:35.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.133+0000 7f5bb11f3640 1 -- 172.21.15.52:0/2699185325 shutdown_connections 2024-09-15T20:51:35.137 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.133+0000 7f5bb11f3640 1 -- 172.21.15.52:0/2699185325 wait complete. 2024-09-15T20:51:35.151 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-15T20:51:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.261+0000 7f89c1a85640 1 Processor -- start 2024-09-15T20:51:35.266 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.261+0000 7f89c1a85640 1 -- start start 2024-09-15T20:51:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.261+0000 7f89c1a85640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc1473e0 0x7f89bc0ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.261+0000 7f89c1a85640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89bc1477c0 con 0x7f89bc142fc0 2024-09-15T20:51:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.261+0000 7f89c1a85640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89bc0b0d90 con 0x7f89bc0b1c00 2024-09-15T20:51:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.261+0000 7f89c1a85640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f89bc0b1480 con 0x7f89bc1473e0 2024-09-15T20:51:35.267 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.261+0000 7f89bbfff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f89bc142fc0 0x7f89bc143470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57312/0 (socket says 172.21.15.52:57312) 2024-09-15T20:51:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.261+0000 7f89bbfff640 1 -- 172.21.15.52:0/610940311 learned_addr learned my addr 172.21.15.52:0/610940311 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.261+0000 7f89bb7fe640 1 --2- 172.21.15.52:0/610940311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc1473e0 0x7f89bc0ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.261+0000 7f89ba7fc640 1 -- 172.21.15.52:0/610940311 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544500480 0 0) 0x7f89ac001120 con 0x7f89bc142fc0 2024-09-15T20:51:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.261+0000 7f89bb7fe640 1 -- 172.21.15.52:0/610940311 >> v1:172.21.15.81:6789/0 conn(0x7f89bc0b1c00 legacy=0x7f89bc147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89bb7fe640 1 -- 172.21.15.52:0/610940311 >> v1:172.21.15.52:6789/0 conn(0x7f89bc142fc0 legacy=0x7f89bc143470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.268 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89bb7fe640 1 -- 172.21.15.52:0/610940311 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89bc0aee30 con 0x7f89bc1473e0 2024-09-15T20:51:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89bb7fe640 1 --2- 172.21.15.52:0/610940311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc1473e0 0x7f89bc0ae8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009dc0 tx=0x7f89b401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c639a2b6caf9451 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89ba7fc640 1 -- 172.21.15.52:0/610940311 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b40b2070 con 0x7f89bc1473e0 2024-09-15T20:51:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89ba7fc640 1 -- 172.21.15.52:0/610940311 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b40a59c0 con 0x7f89bc1473e0 2024-09-15T20:51:35.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89ba7fc640 1 -- 172.21.15.52:0/610940311 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b40a5d90 con 0x7f89bc1473e0 2024-09-15T20:51:35.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89c1a85640 1 -- 172.21.15.52:0/610940311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc1473e0 msgr2=0x7f89bc0ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89c1a85640 1 --2- 172.21.15.52:0/610940311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc1473e0 0x7f89bc0ae8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009dc0 tx=0x7f89b401c8e0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89c1a85640 1 -- 172.21.15.52:0/610940311 shutdown_connections 2024-09-15T20:51:35.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89c1a85640 1 --2- 172.21.15.52:0/610940311 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc1473e0 0x7f89bc0ae8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89c1a85640 1 -- 172.21.15.52:0/610940311 >> 172.21.15.52:0/610940311 conn(0x7f89bc0b59a0 msgr2=0x7f89bc0b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:35.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89c1a85640 1 -- 172.21.15.52:0/610940311 shutdown_connections 2024-09-15T20:51:35.270 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89c1a85640 1 -- 172.21.15.52:0/610940311 wait complete. 2024-09-15T20:51:35.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.265+0000 7f89c1a85640 1 Processor -- start 2024-09-15T20:51:35.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89c1a85640 1 -- start start 2024-09-15T20:51:35.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89c1a85640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc0b1c00 0x7f89bc137350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89c1a85640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc142fc0 0x7f89bc132ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89c1a85640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89bc1473e0 0x7f89bc132ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89c1a85640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc152130 con 0x7f89bc142fc0 2024-09-15T20:51:35.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89c1a85640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc151fb0 con 0x7f89bc1473e0 2024-09-15T20:51:35.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89c1a85640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f89bc1522b0 con 0x7f89bc0b1c00 2024-09-15T20:51:35.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89bb7fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc0b1c00 0x7f89bc137350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89baffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc142fc0 0x7f89bc132ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89bb7fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc0b1c00 0x7f89bc137350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46762/0 (socket says 172.21.15.52:46762) 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89bb7fe640 1 -- 172.21.15.52:0/2150612253 learned_addr learned my addr 172.21.15.52:0/2150612253 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89bbfff640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89bc1473e0 0x7f89bc132ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89baffd640 1 -- 172.21.15.52:0/2150612253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc0b1c00 msgr2=0x7f89bc137350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89baffd640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc0b1c00 0x7f89bc137350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89baffd640 1 -- 172.21.15.52:0/2150612253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89bc1473e0 msgr2=0x7f89bc132ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89baffd640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89bc1473e0 0x7f89bc132ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89baffd640 1 -- 172.21.15.52:0/2150612253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89bc133530 con 0x7f89bc142fc0 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89bb7fe640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc0b1c00 0x7f89bc137350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89baffd640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc142fc0 0x7f89bc132ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0b03f0 tx=0x7f89b000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89a3fff640 1 -- 172.21.15.52:0/2150612253 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b0017070 con 0x7f89bc142fc0 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89a3fff640 1 -- 172.21.15.52:0/2150612253 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89b00052d0 con 0x7f89bc142fc0 2024-09-15T20:51:35.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89c1a85640 1 -- 172.21.15.52:0/2150612253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89bc1395b0 con 0x7f89bc142fc0 2024-09-15T20:51:35.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89a3fff640 1 -- 172.21.15.52:0/2150612253 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b0003800 con 0x7f89bc142fc0 2024-09-15T20:51:35.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89c1a85640 1 -- 172.21.15.52:0/2150612253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89bc073e10 con 0x7f89bc142fc0 2024-09-15T20:51:35.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89c1a85640 1 -- 172.21.15.52:0/2150612253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89bc0ae8f0 con 0x7f89bc142fc0 2024-09-15T20:51:35.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89a3fff640 1 -- 172.21.15.52:0/2150612253 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f89b001a070 con 0x7f89bc142fc0 2024-09-15T20:51:35.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89a3fff640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f89a8072ec0 0x7f89a8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.269+0000 7f89a3fff640 1 -- 172.21.15.52:0/2150612253 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f89b0093510 con 0x7f89bc142fc0 2024-09-15T20:51:35.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.273+0000 7f89bb7fe640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f89a8072ec0 0x7f89a8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.276 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.273+0000 7f89bb7fe640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f89a8072ec0 0x7f89a8075380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f89b4000f90 tx=0x7f89b40a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.273+0000 7f89a3fff640 1 -- 172.21.15.52:0/2150612253 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f89b0005480 con 0x7f89bc142fc0 2024-09-15T20:51:35.446 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.441+0000 7f89c1a85640 1 -- 172.21.15.52:0/2150612253 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f89bc138540 con 0x7f89a8072ec0 2024-09-15T20:51:35.447 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89a3fff640 1 -- 172.21.15.52:0/2150612253 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f89bc138540 con 0x7f89a8072ec0 2024-09-15T20:51:35.447 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 3 to deep-scrub 2024-09-15T20:51:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89c1a85640 1 -- 172.21.15.52:0/2150612253 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f89a8072ec0 msgr2=0x7f89a8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89c1a85640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f89a8072ec0 0x7f89a8075380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f89b4000f90 tx=0x7f89b40a7070 comp rx=0 tx=0).stop 2024-09-15T20:51:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89c1a85640 1 -- 172.21.15.52:0/2150612253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc142fc0 msgr2=0x7f89bc132ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89c1a85640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc142fc0 0x7f89bc132ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0b03f0 tx=0x7f89b000c820 comp rx=0 tx=0).stop 2024-09-15T20:51:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89c1a85640 1 -- 172.21.15.52:0/2150612253 shutdown_connections 2024-09-15T20:51:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89c1a85640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f89a8072ec0 0x7f89a8075380 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89c1a85640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89bc1473e0 0x7f89bc132ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89c1a85640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f89bc142fc0 0x7f89bc132ab0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.450 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89c1a85640 1 --2- 172.21.15.52:0/2150612253 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f89bc0b1c00 0x7f89bc137350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89c1a85640 1 -- 172.21.15.52:0/2150612253 >> 172.21.15.52:0/2150612253 conn(0x7f89bc0b59a0 msgr2=0x7f89bc13f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:35.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89c1a85640 1 -- 172.21.15.52:0/2150612253 shutdown_connections 2024-09-15T20:51:35.451 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.445+0000 7f89c1a85640 1 -- 172.21.15.52:0/2150612253 wait complete. 2024-09-15T20:51:35.467 INFO:tasks.ceph:Scrubbing osd.4 2024-09-15T20:51:35.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-15T20:51:35.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.589+0000 7f0a4c7c8640 1 Processor -- start 2024-09-15T20:51:35.594 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.589+0000 7f0a4c7c8640 1 -- start start 2024-09-15T20:51:35.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0a441441f0 0x7f0a44074190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a44137430 0x7f0a440746d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a441445d0 con 0x7f0a44071740 2024-09-15T20:51:35.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f0a44074c10 con 0x7f0a441441f0 2024-09-15T20:51:35.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0a44137880 con 0x7f0a44137430 2024-09-15T20:51:35.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4a564640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0a441441f0 0x7f0a44074190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.596 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4a564640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0a441441f0 0x7f0a44074190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33132/0 (socket says 172.21.15.52:33132) 2024-09-15T20:51:35.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4a564640 1 -- 172.21.15.52:0/3275224330 learned_addr learned my addr 172.21.15.52:0/3275224330 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:35.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4ad65640 1 --2- 172.21.15.52:0/3275224330 >> v2:172.21.15.81:3300/0 conn(0x7f0a44137430 0x7f0a440746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4a564640 1 -- 172.21.15.52:0/3275224330 >> v2:172.21.15.81:3300/0 conn(0x7f0a44137430 msgr2=0x7f0a440746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:35.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4a564640 1 --2- 172.21.15.52:0/3275224330 >> v2:172.21.15.81:3300/0 conn(0x7f0a44137430 0x7f0a440746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4a564640 1 -- 172.21.15.52:0/3275224330 >> v1:172.21.15.81:6789/0 conn(0x7f0a44071740 legacy=0x7f0a44136d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:35.597 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4a564640 1 -- 172.21.15.52:0/3275224330 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a44073990 con 0x7f0a441441f0 2024-09-15T20:51:35.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4a564640 1 --2- 172.21.15.52:0/3275224330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a441441f0 0x7f0a44074190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0a440736e0 tx=0x7f0a4001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd75a2bd365fb93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a49562640 1 -- 172.21.15.52:0/3275224330 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a400b0070 con 0x7f0a441441f0 2024-09-15T20:51:35.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a49562640 1 -- 172.21.15.52:0/3275224330 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a400ab600 con 0x7f0a441441f0 2024-09-15T20:51:35.598 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a49562640 1 -- 172.21.15.52:0/3275224330 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a400ab9d0 con 0x7f0a441441f0 2024-09-15T20:51:35.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/3275224330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a441441f0 msgr2=0x7f0a44074190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 --2- 172.21.15.52:0/3275224330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a441441f0 0x7f0a44074190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0a440736e0 tx=0x7f0a4001c240 comp rx=0 tx=0).stop 2024-09-15T20:51:35.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/3275224330 shutdown_connections 2024-09-15T20:51:35.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 --2- 172.21.15.52:0/3275224330 >> v2:172.21.15.81:3300/0 conn(0x7f0a44137430 0x7f0a440746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 --2- 172.21.15.52:0/3275224330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a441441f0 0x7f0a44074190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/3275224330 >> 172.21.15.52:0/3275224330 conn(0x7f0a4406ed10 msgr2=0x7f0a440b6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:35.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/3275224330 shutdown_connections 2024-09-15T20:51:35.599 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.593+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/3275224330 wait complete. 2024-09-15T20:51:35.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4c7c8640 1 Processor -- start 2024-09-15T20:51:35.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4c7c8640 1 -- start start 2024-09-15T20:51:35.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4c7c8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a44071740 0x7f0a440b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4c7c8640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a44137430 0x7f0a440b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4c7c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a441441f0 0x7f0a44149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4c7c8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4414dcc0 con 0x7f0a44071740 2024-09-15T20:51:35.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4c7c8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4414db40 con 0x7f0a441441f0 2024-09-15T20:51:35.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4c7c8640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f0a4414de40 con 0x7f0a44137430 2024-09-15T20:51:35.601 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a49d63640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a44137430 0x7f0a440b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a49d63640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a44137430 0x7f0a440b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46774/0 (socket says 172.21.15.52:46774) 2024-09-15T20:51:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a49d63640 1 -- 172.21.15.52:0/146359435 learned_addr learned my addr 172.21.15.52:0/146359435 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4a564640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a44071740 0x7f0a440b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4ad65640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a441441f0 0x7f0a44149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a49d63640 1 -- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a441441f0 msgr2=0x7f0a44149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a49d63640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a441441f0 0x7f0a44149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a49d63640 1 -- 172.21.15.52:0/146359435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a44071740 msgr2=0x7f0a440b64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a49d63640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0a44071740 0x7f0a440b64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a49d63640 1 -- 172.21.15.52:0/146359435 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a441490a0 con 0x7f0a44137430 2024-09-15T20:51:35.602 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a49d63640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a44137430 0x7f0a440b5a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400c450 tx=0x7f0a3400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a3affd640 1 -- 172.21.15.52:0/146359435 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34012830 con 0x7f0a44137430 2024-09-15T20:51:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a3affd640 1 -- 172.21.15.52:0/146359435 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a34017070 con 0x7f0a44137430 2024-09-15T20:51:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a3affd640 1 -- 172.21.15.52:0/146359435 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34012c30 con 0x7f0a44137430 2024-09-15T20:51:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/146359435 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a441dcd80 con 0x7f0a44137430 2024-09-15T20:51:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/146359435 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a4414a2a0 con 0x7f0a44137430 2024-09-15T20:51:35.604 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.597+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/146359435 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a440b5fd0 con 0x7f0a44137430 2024-09-15T20:51:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.601+0000 7f0a3affd640 1 -- 172.21.15.52:0/146359435 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f0a3401c460 con 0x7f0a44137430 2024-09-15T20:51:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.601+0000 7f0a3affd640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0a28072ec0 0x7f0a28075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.601+0000 7f0a3affd640 1 -- 172.21.15.52:0/146359435 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f0a34094260 con 0x7f0a44137430 2024-09-15T20:51:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.601+0000 7f0a3affd640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] conn(0x7f0a2807a080 0x7f0a2807c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.601+0000 7f0a3affd640 1 -- 172.21.15.52:0/146359435 --> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a2807cb50 con 0x7f0a2807a080 2024-09-15T20:51:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.601+0000 7f0a3affd640 1 -- 172.21.15.52:0/146359435 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a340946f0 con 0x7f0a44137430 2024-09-15T20:51:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.601+0000 7f0a4a564640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0a28072ec0 0x7f0a28075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.605 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.601+0000 7f0a4ad65640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] conn(0x7f0a2807a080 0x7f0a2807c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.601+0000 7f0a4a564640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0a28072ec0 0x7f0a28075380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a400ad000 tx=0x7f0a400a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.601+0000 7f0a4ad65640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] conn(0x7f0a2807a080 0x7f0a2807c4a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.606 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.601+0000 7f0a3affd640 1 -- 172.21.15.52:0/146359435 <== osd.4 v2:172.21.15.81:6816/1105997015 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a2807cb50 con 0x7f0a2807a080 2024-09-15T20:51:35.619 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/146359435 --> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0a4414a7e0 con 0x7f0a2807a080 2024-09-15T20:51:35.620 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a3affd640 1 -- 172.21.15.52:0/146359435 <== osd.4 v2:172.21.15.81:6816/1105997015 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0a4414a7e0 con 0x7f0a2807a080 2024-09-15T20:51:35.620 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-15T20:51:35.620 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T20:51:35.620 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-15T20:51:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] conn(0x7f0a2807a080 msgr2=0x7f0a2807c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a4c7c8640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:6816/1105997015,v1:172.21.15.81:6817/1105997015] conn(0x7f0a2807a080 0x7f0a2807c4a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0a28072ec0 msgr2=0x7f0a28075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a4c7c8640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f0a28072ec0 0x7f0a28075380 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a400ad000 tx=0x7f0a400a6000 comp rx=0 tx=0).stop 2024-09-15T20:51:35.621 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/146359435 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a44137430 msgr2=0x7f0a440b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a4c7c8640 1 --2- 172.21.15.52:0/146359435 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f0a44137430 0x7f0a440b5a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400c450 tx=0x7f0a3400c910 comp rx=0 tx=0).stop 2024-09-15T20:51:35.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a4ad65640 1 -- 172.21.15.52:0/146359435 reap_dead start 2024-09-15T20:51:35.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/146359435 shutdown_connections 2024-09-15T20:51:35.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/146359435 >> 172.21.15.52:0/146359435 conn(0x7f0a4406ed10 msgr2=0x7f0a44139a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:35.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/146359435 shutdown_connections 2024-09-15T20:51:35.622 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.617+0000 7f0a4c7c8640 1 -- 172.21.15.52:0/146359435 wait complete. 2024-09-15T20:51:35.637 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-15T20:51:35.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b089eb640 1 Processor -- start 2024-09-15T20:51:35.748 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b089eb640 1 -- start start 2024-09-15T20:51:35.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b089eb640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b04068c30 0x7f3b04147790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b089eb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b0413a230 0x7f3b0413a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b089eb640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b04069010 con 0x7f3b04071800 2024-09-15T20:51:35.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b089eb640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0413abe0 con 0x7f3b04068c30 2024-09-15T20:51:35.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b089eb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3b04144f10 con 0x7f3b0413a230 2024-09-15T20:51:35.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b0259c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b04068c30 0x7f3b04147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b02d9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3b04071800 0x7f3b04071c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57328/0 (socket says 172.21.15.52:57328) 2024-09-15T20:51:35.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b02d9d640 1 -- 172.21.15.52:0/2842156977 learned_addr learned my addr 172.21.15.52:0/2842156977 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:35.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b01d9b640 1 --2- 172.21.15.52:0/2842156977 >> v2:172.21.15.81:3300/0 conn(0x7f3b0413a230 0x7f3b0413a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b0259c640 1 -- 172.21.15.52:0/2842156977 >> v2:172.21.15.81:3300/0 conn(0x7f3b0413a230 msgr2=0x7f3b0413a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:35.750 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b0259c640 1 --2- 172.21.15.52:0/2842156977 >> v2:172.21.15.81:3300/0 conn(0x7f3b0413a230 0x7f3b0413a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b0259c640 1 -- 172.21.15.52:0/2842156977 >> v1:172.21.15.52:6789/0 conn(0x7f3b04071800 legacy=0x7f3b04071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.751 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.745+0000 7f3b0259c640 1 -- 172.21.15.52:0/2842156977 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b040aec70 con 0x7f3b04068c30 2024-09-15T20:51:35.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b0259c640 1 --2- 172.21.15.52:0/2842156977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b04068c30 0x7f3b04147790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3b0413e2a0 tx=0x7f3af401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edab95eb816484c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b0159a640 1 -- 172.21.15.52:0/2842156977 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af40b2070 con 0x7f3b04068c30 2024-09-15T20:51:35.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b0159a640 1 -- 172.21.15.52:0/2842156977 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af40a5930 con 0x7f3b04068c30 2024-09-15T20:51:35.752 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b0159a640 1 -- 172.21.15.52:0/2842156977 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af40a5d00 con 0x7f3b04068c30 2024-09-15T20:51:35.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 -- 172.21.15.52:0/2842156977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b04068c30 msgr2=0x7f3b04147790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 --2- 172.21.15.52:0/2842156977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b04068c30 0x7f3b04147790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3b0413e2a0 tx=0x7f3af401c850 comp rx=0 tx=0).stop 2024-09-15T20:51:35.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 -- 172.21.15.52:0/2842156977 shutdown_connections 2024-09-15T20:51:35.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 --2- 172.21.15.52:0/2842156977 >> v2:172.21.15.81:3300/0 conn(0x7f3b0413a230 0x7f3b0413a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 --2- 172.21.15.52:0/2842156977 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b04068c30 0x7f3b04147790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 -- 172.21.15.52:0/2842156977 >> 172.21.15.52:0/2842156977 conn(0x7f3b040b7760 msgr2=0x7f3b0406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:35.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 -- 172.21.15.52:0/2842156977 shutdown_connections 2024-09-15T20:51:35.753 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 -- 172.21.15.52:0/2842156977 wait complete. 2024-09-15T20:51:35.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 Processor -- start 2024-09-15T20:51:35.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 -- start start 2024-09-15T20:51:35.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b04068c30 0x7f3b040b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b04071800 0x7f3b0413c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0413a230 0x7f3b040b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b04151210 con 0x7f3b0413a230 2024-09-15T20:51:35.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b04151090 con 0x7f3b04071800 2024-09-15T20:51:35.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b089eb640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f3b04151390 con 0x7f3b04068c30 2024-09-15T20:51:35.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b0259c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b04068c30 0x7f3b040b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b02d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0413a230 0x7f3b040b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b0259c640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b04068c30 0x7f3b040b2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46788/0 (socket says 172.21.15.52:46788) 2024-09-15T20:51:35.756 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b0259c640 1 -- 172.21.15.52:0/708047841 learned_addr learned my addr 172.21.15.52:0/708047841 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b01d9b640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b04071800 0x7f3b0413c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b02d9d640 1 -- 172.21.15.52:0/708047841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b04068c30 msgr2=0x7f3b040b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b02d9d640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b04068c30 0x7f3b040b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b02d9d640 1 -- 172.21.15.52:0/708047841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b04071800 msgr2=0x7f3b0413c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.749+0000 7f3b02d9d640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b04071800 0x7f3b0413c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3b02d9d640 1 -- 172.21.15.52:0/708047841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b040b2040 con 0x7f3b0413a230 2024-09-15T20:51:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3b0259c640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b04068c30 0x7f3b040b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:35.757 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3b02d9d640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0413a230 0x7f3b040b09e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00c390 tx=0x7f3afc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3af2ffd640 1 -- 172.21.15.52:0/708047841 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc017070 con 0x7f3b0413a230 2024-09-15T20:51:35.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3af2ffd640 1 -- 172.21.15.52:0/708047841 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3afc005cf0 con 0x7f3b0413a230 2024-09-15T20:51:35.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3b089eb640 1 -- 172.21.15.52:0/708047841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b040b2320 con 0x7f3b0413a230 2024-09-15T20:51:35.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3af2ffd640 1 -- 172.21.15.52:0/708047841 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0072d0 con 0x7f3b0413a230 2024-09-15T20:51:35.758 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3b089eb640 1 -- 172.21.15.52:0/708047841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b040b02b0 con 0x7f3b0413a230 2024-09-15T20:51:35.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3b089eb640 1 -- 172.21.15.52:0/708047841 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b04147790 con 0x7f3b0413a230 2024-09-15T20:51:35.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3af2ffd640 1 -- 172.21.15.52:0/708047841 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f3afc01a070 con 0x7f3b0413a230 2024-09-15T20:51:35.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3af2ffd640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3ae4072ef0 0x7f3ae40753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:35.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3af2ffd640 1 -- 172.21.15.52:0/708047841 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f3afc092cb0 con 0x7f3b0413a230 2024-09-15T20:51:35.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.753+0000 7f3b0259c640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3ae4072ef0 0x7f3ae40753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:35.759 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.757+0000 7f3b0259c640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3ae4072ef0 0x7f3ae40753b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3af401a480 tx=0x7f3af40a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:35.763 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.757+0000 7f3af2ffd640 1 -- 172.21.15.52:0/708047841 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f3b04069010 con 0x7f3b0413a230 2024-09-15T20:51:35.971 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 -- 172.21.15.52:0/708047841 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f3b040b06e0 con 0x7f3ae4072ef0 2024-09-15T20:51:35.972 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3af2ffd640 1 -- 172.21.15.52:0/708047841 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3af40b3040 con 0x7f3ae4072ef0 2024-09-15T20:51:35.972 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 4 to deep-scrub 2024-09-15T20:51:35.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 -- 172.21.15.52:0/708047841 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3ae4072ef0 msgr2=0x7f3ae40753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.974 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3ae4072ef0 0x7f3ae40753b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3af401a480 tx=0x7f3af40a7070 comp rx=0 tx=0).stop 2024-09-15T20:51:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 -- 172.21.15.52:0/708047841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0413a230 msgr2=0x7f3b040b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0413a230 0x7f3b040b09e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00c390 tx=0x7f3afc00c850 comp rx=0 tx=0).stop 2024-09-15T20:51:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 -- 172.21.15.52:0/708047841 shutdown_connections 2024-09-15T20:51:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3ae4072ef0 0x7f3ae40753b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b0413a230 0x7f3b040b09e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b04071800 0x7f3b0413c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 --2- 172.21.15.52:0/708047841 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3b04068c30 0x7f3b040b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 -- 172.21.15.52:0/708047841 >> 172.21.15.52:0/708047841 conn(0x7f3b040b7760 msgr2=0x7f3b04072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 -- 172.21.15.52:0/708047841 shutdown_connections 2024-09-15T20:51:35.975 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:35.969+0000 7f3b089eb640 1 -- 172.21.15.52:0/708047841 wait complete. 2024-09-15T20:51:35.992 INFO:tasks.ceph:Scrubbing osd.5 2024-09-15T20:51:35.993 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-15T20:51:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f681dccf640 1 Processor -- start 2024-09-15T20:51:36.116 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f681dccf640 1 -- start start 2024-09-15T20:51:36.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f681dccf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68180b83a0 0x7f6818072860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f681dccf640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68180b8780 con 0x7f6818147220 2024-09-15T20:51:36.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f681dccf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68180aec00 con 0x7f6818070250 2024-09-15T20:51:36.118 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f681dccf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6818070cb0 con 0x7f68180b83a0 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f6817fff640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6818147220 0x7f68181476b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57336/0 (socket says 172.21.15.52:57336) 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f6817fff640 1 -- 172.21.15.52:0/3198421127 learned_addr learned my addr 172.21.15.52:0/3198421127 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68177fe640 1 --2- 172.21.15.52:0/3198421127 >> v2:172.21.15.81:3300/0 conn(0x7f68180b83a0 0x7f6818072860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 936658721 0 0) 0x7f6810001120 con 0x7f6818147220 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6800003530 con 0x7f6818147220 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4279844196 0 0) 0x7f6800003530 con 0x7f6818147220 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 >> v2:172.21.15.81:3300/0 conn(0x7f68180b83a0 msgr2=0x7f6818072860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 --2- 172.21.15.52:0/3198421127 >> v2:172.21.15.81:3300/0 conn(0x7f68180b83a0 0x7f6818072860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 >> v1:172.21.15.81:6789/0 conn(0x7f6818070250 legacy=0x7f6818072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6818071e80 con 0x7f6818147220 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 282972984 0 0) 0x7f68100018d0 con 0x7f6818147220 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 >> v1:172.21.15.52:6789/0 conn(0x7f6818147220 legacy=0x7f68181476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 --2- 172.21.15.52:0/3198421127 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6800003a60 0x7f6800003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.119 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 --2- 172.21.15.52:0/3198421127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6800004810 0x7f6800004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 --2- 172.21.15.52:0/3198421127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68000052f0 0x7f680000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6818070cb0 con 0x7f68000052f0 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f680000c1f0 con 0x7f6800004810 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f680000c3f0 con 0x7f6800003a60 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68177fe640 1 --2- 172.21.15.52:0/3198421127 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6800003a60 0x7f6800003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f6817fff640 1 --2- 172.21.15.52:0/3198421127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68000052f0 0x7f680000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f6816ffd640 1 --2- 172.21.15.52:0/3198421127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6800004810 0x7f6800004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68177fe640 1 -- 172.21.15.52:0/3198421127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6800004810 msgr2=0x7f6800004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68177fe640 1 --2- 172.21.15.52:0/3198421127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6800004810 0x7f6800004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68177fe640 1 -- 172.21.15.52:0/3198421127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68000052f0 msgr2=0x7f680000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68177fe640 1 --2- 172.21.15.52:0/3198421127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68000052f0 0x7f680000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f68177fe640 1 -- 172.21.15.52:0/3198421127 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6818071e80 con 0x7f6800003a60 2024-09-15T20:51:36.120 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f6817fff640 1 --2- 172.21.15.52:0/3198421127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f68000052f0 0x7f680000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:36.121 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.113+0000 7f6817fff640 1 -- 172.21.15.52:0/3198421127 reap_dead start 2024-09-15T20:51:36.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f68177fe640 1 --2- 172.21.15.52:0/3198421127 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6800003a60 0x7f6800003e80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6808009fc0 tx=0x7f680801cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc70fefd4b283c43 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68080b2070 con 0x7f6800003a60 2024-09-15T20:51:36.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68080a5c70 con 0x7f6800003a60 2024-09-15T20:51:36.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f68167fc640 1 -- 172.21.15.52:0/3198421127 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808009c10 con 0x7f6800003a60 2024-09-15T20:51:36.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f681dccf640 1 -- 172.21.15.52:0/3198421127 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6800003a60 msgr2=0x7f6800003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f681dccf640 1 --2- 172.21.15.52:0/3198421127 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6800003a60 0x7f6800003e80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6808009fc0 tx=0x7f680801cc60 comp rx=0 tx=0).stop 2024-09-15T20:51:36.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f681dccf640 1 -- 172.21.15.52:0/3198421127 shutdown_connections 2024-09-15T20:51:36.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f681dccf640 1 --2- 172.21.15.52:0/3198421127 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f6800003a60 0x7f6800003e80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f681dccf640 1 -- 172.21.15.52:0/3198421127 >> 172.21.15.52:0/3198421127 conn(0x7f68180692f0 msgr2=0x7f68180b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:36.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f681dccf640 1 -- 172.21.15.52:0/3198421127 shutdown_connections 2024-09-15T20:51:36.125 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f681dccf640 1 -- 172.21.15.52:0/3198421127 wait complete. 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f681dccf640 1 Processor -- start 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.117+0000 7f681dccf640 1 -- start start 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f681dccf640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6800003a60 0x7f68180afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f681dccf640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68180b29b0 0x7f68180b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f681dccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818138b40 0x7f6818138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f681dccf640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6818073400 con 0x7f6800003a60 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f681dccf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6818073280 con 0x7f6818138b40 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f681dccf640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f6818073580 con 0x7f68180b29b0 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f68177fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6800003a60 0x7f68180afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f68177fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6800003a60 0x7f68180afce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33178/0 (socket says 172.21.15.52:33178) 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f68177fe640 1 -- 172.21.15.52:0/1917700830 learned_addr learned my addr 172.21.15.52:0/1917700830 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f6816ffd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68180b29b0 0x7f68180b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f6817fff640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818138b40 0x7f6818138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.126 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f68177fe640 1 -- 172.21.15.52:0/1917700830 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68180b29b0 msgr2=0x7f68180b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f68177fe640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f68180b29b0 0x7f68180b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f68177fe640 1 -- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818138b40 msgr2=0x7f6818138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f68177fe640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818138b40 0x7f6818138fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f68177fe640 1 -- 172.21.15.52:0/1917700830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68181dc310 con 0x7f6800003a60 2024-09-15T20:51:36.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f6817fff640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6818138b40 0x7f6818138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:51:36.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f68177fe640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6800003a60 0x7f68180afce0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f680801c6d0 tx=0x7f6808009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f67fffff640 1 -- 172.21.15.52:0/1917700830 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68080b2040 con 0x7f6800003a60 2024-09-15T20:51:36.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f67fffff640 1 -- 172.21.15.52:0/1917700830 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68080a5a70 con 0x7f6800003a60 2024-09-15T20:51:36.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f681dccf640 1 -- 172.21.15.52:0/1917700830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6818139540 con 0x7f6800003a60 2024-09-15T20:51:36.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f67fffff640 1 -- 172.21.15.52:0/1917700830 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68080adc60 con 0x7f6800003a60 2024-09-15T20:51:36.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f681dccf640 1 -- 172.21.15.52:0/1917700830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68181dc810 con 0x7f6800003a60 2024-09-15T20:51:36.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f681dccf640 1 -- 172.21.15.52:0/1917700830 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f681813d240 con 0x7f6800003a60 2024-09-15T20:51:36.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f67fffff640 1 -- 172.21.15.52:0/1917700830 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f68080bf020 con 0x7f6800003a60 2024-09-15T20:51:36.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f67fffff640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f6804072ec0 0x7f6804075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f67fffff640 1 -- 172.21.15.52:0/1917700830 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f680812ea60 con 0x7f6800003a60 2024-09-15T20:51:36.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f67fffff640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] conn(0x7f680407a080 0x7f680407c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f67fffff640 1 -- 172.21.15.52:0/1917700830 --> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68080020c0 con 0x7f680407a080 2024-09-15T20:51:36.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f67fffff640 1 -- 172.21.15.52:0/1917700830 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f680812ee10 con 0x7f6800003a60 2024-09-15T20:51:36.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f6816ffd640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f6804072ec0 0x7f6804075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.121+0000 7f6817fff640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] conn(0x7f680407a080 0x7f680407c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.125+0000 7f6816ffd640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f6804072ec0 0x7f6804075380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6818146630 tx=0x7f680c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.125+0000 7f6817fff640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] conn(0x7f680407a080 0x7f680407c4a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.125+0000 7f67fffff640 1 -- 172.21.15.52:0/1917700830 <== osd.5 v2:172.21.15.81:6808/1585962119 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68080020c0 con 0x7f680407a080 2024-09-15T20:51:36.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.141+0000 7f681dccf640 1 -- 172.21.15.52:0/1917700830 --> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f68180b5b10 con 0x7f680407a080 2024-09-15T20:51:36.146 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.141+0000 7f67fffff640 1 -- 172.21.15.52:0/1917700830 <== osd.5 v2:172.21.15.81:6808/1585962119 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f68180b5b10 con 0x7f680407a080 2024-09-15T20:51:36.147 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-15T20:51:36.147 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T20:51:36.147 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-15T20:51:36.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.141+0000 7f681dccf640 1 -- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] conn(0x7f680407a080 msgr2=0x7f680407c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.141+0000 7f681dccf640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:6808/1585962119,v1:172.21.15.81:6809/1585962119] conn(0x7f680407a080 0x7f680407c4a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.141+0000 7f681dccf640 1 -- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f6804072ec0 msgr2=0x7f6804075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.141+0000 7f681dccf640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f6804072ec0 0x7f6804075380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6818146630 tx=0x7f680c009040 comp rx=0 tx=0).stop 2024-09-15T20:51:36.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.141+0000 7f681dccf640 1 -- 172.21.15.52:0/1917700830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6800003a60 msgr2=0x7f68180afce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.141+0000 7f681dccf640 1 --2- 172.21.15.52:0/1917700830 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6800003a60 0x7f68180afce0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f680801c6d0 tx=0x7f6808009750 comp rx=0 tx=0).stop 2024-09-15T20:51:36.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.141+0000 7f6817fff640 1 -- 172.21.15.52:0/1917700830 reap_dead start 2024-09-15T20:51:36.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.145+0000 7f681dccf640 1 -- 172.21.15.52:0/1917700830 shutdown_connections 2024-09-15T20:51:36.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.145+0000 7f681dccf640 1 -- 172.21.15.52:0/1917700830 >> 172.21.15.52:0/1917700830 conn(0x7f68180692f0 msgr2=0x7f68180b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:36.148 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.145+0000 7f681dccf640 1 -- 172.21.15.52:0/1917700830 shutdown_connections 2024-09-15T20:51:36.149 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.145+0000 7f681dccf640 1 -- 172.21.15.52:0/1917700830 wait complete. 2024-09-15T20:51:36.163 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-15T20:51:36.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f72356a2640 1 Processor -- start 2024-09-15T20:51:36.269 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f72356a2640 1 -- start start 2024-09-15T20:51:36.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f72356a2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72300b1b10 0x7f7230138640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f72356a2640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72300b7700 con 0x7f72301450f0 2024-09-15T20:51:36.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f72356a2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72300aa960 con 0x7f72300b7320 2024-09-15T20:51:36.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f72356a2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f72300b2510 con 0x7f72300b1b10 2024-09-15T20:51:36.271 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722f7fe640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f72301450f0 0x7f7230145540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57348/0 (socket says 172.21.15.52:57348) 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722f7fe640 1 -- 172.21.15.52:0/3947430316 learned_addr learned my addr 172.21.15.52:0/3947430316 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f7227fff640 1 --2- 172.21.15.52:0/3947430316 >> v2:172.21.15.81:3300/0 conn(0x7f72300b1b10 0x7f7230138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130282756 0 0) 0x7f72280014a0 con 0x7f72301450f0 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f721c003530 con 0x7f72301450f0 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3273413467 0 0) 0x7f721c003530 con 0x7f72301450f0 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 >> v2:172.21.15.81:3300/0 conn(0x7f72300b1b10 msgr2=0x7f7230138640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 --2- 172.21.15.52:0/3947430316 >> v2:172.21.15.81:3300/0 conn(0x7f72300b1b10 0x7f7230138640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 >> v1:172.21.15.81:6789/0 conn(0x7f72300b7320 legacy=0x7f7230137f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72300b1ff0 con 0x7f72301450f0 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 282972984 0 0) 0x7f7228001c50 con 0x7f72301450f0 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 >> v1:172.21.15.52:6789/0 conn(0x7f72301450f0 legacy=0x7f7230145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 --2- 172.21.15.52:0/3947430316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c003a90 0x7f721c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 --2- 172.21.15.52:0/3947430316 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f721c004810 0x7f721c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.272 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 --2- 172.21.15.52:0/3947430316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f721c0052f0 0x7f721c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f72300b2510 con 0x7f721c0052f0 2024-09-15T20:51:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f721c00c240 con 0x7f721c003a90 2024-09-15T20:51:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f721c00c440 con 0x7f721c004810 2024-09-15T20:51:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f7227fff640 1 --2- 172.21.15.52:0/3947430316 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f721c004810 0x7f721c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722effd640 1 --2- 172.21.15.52:0/3947430316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c003a90 0x7f721c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.265+0000 7f722f7fe640 1 --2- 172.21.15.52:0/3947430316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f721c0052f0 0x7f721c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f7227fff640 1 -- 172.21.15.52:0/3947430316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c003a90 msgr2=0x7f721c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f7227fff640 1 --2- 172.21.15.52:0/3947430316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f721c003a90 0x7f721c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f7227fff640 1 -- 172.21.15.52:0/3947430316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f721c0052f0 msgr2=0x7f721c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f7227fff640 1 --2- 172.21.15.52:0/3947430316 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f721c0052f0 0x7f721c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f7227fff640 1 -- 172.21.15.52:0/3947430316 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721c003530 con 0x7f721c004810 2024-09-15T20:51:36.273 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f722f7fe640 1 -- 172.21.15.52:0/3947430316 reap_dead start 2024-09-15T20:51:36.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f7227fff640 1 --2- 172.21.15.52:0/3947430316 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f721c004810 0x7f721c004c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f72300b1f20 tx=0x7f721801c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dcaae85d3e77222 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180b2070 con 0x7f721c004810 2024-09-15T20:51:36.274 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72180a55e0 con 0x7f721c004810 2024-09-15T20:51:36.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f722e7fc640 1 -- 172.21.15.52:0/3947430316 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180096b0 con 0x7f721c004810 2024-09-15T20:51:36.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f72356a2640 1 -- 172.21.15.52:0/3947430316 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f721c004810 msgr2=0x7f721c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f72356a2640 1 --2- 172.21.15.52:0/3947430316 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f721c004810 0x7f721c004c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f72300b1f20 tx=0x7f721801c9f0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f72356a2640 1 -- 172.21.15.52:0/3947430316 shutdown_connections 2024-09-15T20:51:36.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f72356a2640 1 --2- 172.21.15.52:0/3947430316 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f721c004810 0x7f721c004c90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f72356a2640 1 -- 172.21.15.52:0/3947430316 >> 172.21.15.52:0/3947430316 conn(0x7f723006eae0 msgr2=0x7f72300b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:36.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f72356a2640 1 -- 172.21.15.52:0/3947430316 shutdown_connections 2024-09-15T20:51:36.275 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.269+0000 7f72356a2640 1 -- 172.21.15.52:0/3947430316 wait complete. 2024-09-15T20:51:36.277 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72356a2640 1 Processor -- start 2024-09-15T20:51:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72356a2640 1 -- start start 2024-09-15T20:51:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72356a2640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f721c004810 0x7f7230139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72356a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7230139870 0x7f7230134a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72356a2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7230134f60 0x7f72301d6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72356a2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7230145540 con 0x7f7230134f60 2024-09-15T20:51:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72356a2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72301456c0 con 0x7f7230139870 2024-09-15T20:51:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72356a2640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f7230145840 con 0x7f721c004810 2024-09-15T20:51:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f722f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7230134f60 0x7f72301d6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f722effd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f721c004810 0x7f7230139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f722f7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7230134f60 0x7f72301d6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33198/0 (socket says 172.21.15.52:33198) 2024-09-15T20:51:36.278 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f722f7fe640 1 -- 172.21.15.52:0/1543566684 learned_addr learned my addr 172.21.15.52:0/1543566684 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f7227fff640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7230139870 0x7f7230134a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f722f7fe640 1 -- 172.21.15.52:0/1543566684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f721c004810 msgr2=0x7f7230139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f722f7fe640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f721c004810 0x7f7230139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f722f7fe640 1 -- 172.21.15.52:0/1543566684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7230139870 msgr2=0x7f7230134a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f722f7fe640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7230139870 0x7f7230134a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f722f7fe640 1 -- 172.21.15.52:0/1543566684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7230138e70 con 0x7f7230134f60 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f7227fff640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7230139870 0x7f7230134a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f722effd640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f721c004810 0x7f7230139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f722f7fe640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7230134f60 0x7f72301d6c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7230146160 tx=0x7f722800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72277fe640 1 -- 172.21.15.52:0/1543566684 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72280077a0 con 0x7f7230134f60 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72277fe640 1 -- 172.21.15.52:0/1543566684 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7228019070 con 0x7f7230134f60 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72277fe640 1 -- 172.21.15.52:0/1543566684 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72280133f0 con 0x7f7230134f60 2024-09-15T20:51:36.279 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72356a2640 1 -- 172.21.15.52:0/1543566684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723013b0c0 con 0x7f7230134f60 2024-09-15T20:51:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72356a2640 1 -- 172.21.15.52:0/1543566684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72301353e0 con 0x7f7230134f60 2024-09-15T20:51:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72356a2640 1 -- 172.21.15.52:0/1543566684 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7230145c70 con 0x7f7230134f60 2024-09-15T20:51:36.280 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.273+0000 7f72277fe640 1 -- 172.21.15.52:0/1543566684 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f7228013590 con 0x7f7230134f60 2024-09-15T20:51:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.277+0000 7f72277fe640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f7210072ef0 0x7f72100753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.277+0000 7f72277fe640 1 -- 172.21.15.52:0/1543566684 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f7228093fa0 con 0x7f7230134f60 2024-09-15T20:51:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.277+0000 7f722effd640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f7210072ef0 0x7f72100753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.277+0000 7f722effd640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f7210072ef0 0x7f72100753b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7220000c10 tx=0x7f7220009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.284 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.281+0000 7f72277fe640 1 -- 172.21.15.52:0/1543566684 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f72300b7700 con 0x7f7230134f60 2024-09-15T20:51:36.500 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.497+0000 7f72356a2640 1 -- 172.21.15.52:0/1543566684 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f723006d120 con 0x7f7210072ef0 2024-09-15T20:51:36.501 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.497+0000 7f72277fe640 1 -- 172.21.15.52:0/1543566684 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f723006d120 con 0x7f7210072ef0 2024-09-15T20:51:36.501 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 5 to deep-scrub 2024-09-15T20:51:36.503 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.501+0000 7f72356a2640 1 -- 172.21.15.52:0/1543566684 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f7210072ef0 msgr2=0x7f72100753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.501+0000 7f72356a2640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f7210072ef0 0x7f72100753b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7220000c10 tx=0x7f7220009040 comp rx=0 tx=0).stop 2024-09-15T20:51:36.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.501+0000 7f72356a2640 1 -- 172.21.15.52:0/1543566684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7230134f60 msgr2=0x7f72301d6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.501+0000 7f72356a2640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7230134f60 0x7f72301d6c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7230146160 tx=0x7f722800aec0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.501+0000 7f72356a2640 1 -- 172.21.15.52:0/1543566684 shutdown_connections 2024-09-15T20:51:36.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.501+0000 7f72356a2640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f7210072ef0 0x7f72100753b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.501+0000 7f72356a2640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7230134f60 0x7f72301d6c80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.501+0000 7f72356a2640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7230139870 0x7f7230134a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.501+0000 7f72356a2640 1 --2- 172.21.15.52:0/1543566684 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f721c004810 0x7f7230139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.501+0000 7f72356a2640 1 -- 172.21.15.52:0/1543566684 >> 172.21.15.52:0/1543566684 conn(0x7f723006eae0 msgr2=0x7f72300b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:36.504 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.501+0000 7f72356a2640 1 -- 172.21.15.52:0/1543566684 shutdown_connections 2024-09-15T20:51:36.505 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.501+0000 7f72356a2640 1 -- 172.21.15.52:0/1543566684 wait complete. 2024-09-15T20:51:36.519 INFO:tasks.ceph:Scrubbing osd.6 2024-09-15T20:51:36.519 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-15T20:51:36.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.633+0000 7fa079c58640 1 Processor -- start 2024-09-15T20:51:36.639 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa079c58640 1 -- start start 2024-09-15T20:51:36.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa079c58640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa074072df0 0x7fa0740731d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa079c58640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa074070ee0 0x7fa07413d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa079c58640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa074071320 con 0x7fa074074180 2024-09-15T20:51:36.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa079c58640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fa0740ab060 con 0x7fa074072df0 2024-09-15T20:51:36.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa079c58640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa0741402f0 con 0x7fa074070ee0 2024-09-15T20:51:36.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa072ffd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa074074180 0x7fa074140810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57356/0 (socket says 172.21.15.52:57356) 2024-09-15T20:51:36.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa072ffd640 1 -- 172.21.15.52:0/1722936182 learned_addr learned my addr 172.21.15.52:0/1722936182 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:36.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa0737fe640 1 --2- 172.21.15.52:0/1722936182 >> v2:172.21.15.52:3300/0 conn(0x7fa074072df0 0x7fa0740731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa073fff640 1 --2- 172.21.15.52:0/1722936182 >> v2:172.21.15.81:3300/0 conn(0x7fa074070ee0 0x7fa07413d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.641 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa0737fe640 1 -- 172.21.15.52:0/1722936182 >> v2:172.21.15.81:3300/0 conn(0x7fa074070ee0 msgr2=0x7fa07413d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:36.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa0737fe640 1 --2- 172.21.15.52:0/1722936182 >> v2:172.21.15.81:3300/0 conn(0x7fa074070ee0 0x7fa07413d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa0737fe640 1 -- 172.21.15.52:0/1722936182 >> v1:172.21.15.52:6789/0 conn(0x7fa074074180 legacy=0x7fa074140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa0737fe640 1 -- 172.21.15.52:0/1722936182 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074140f20 con 0x7fa074072df0 2024-09-15T20:51:36.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa0727fc640 1 -- 172.21.15.52:0/1722936182 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023738540 0 0) 0x7fa074071320 con 0x7fa074074180 2024-09-15T20:51:36.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa073fff640 1 --2- 172.21.15.52:0/1722936182 >> v2:172.21.15.81:3300/0 conn(0x7fa074070ee0 0x7fa07413d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:51:36.642 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa0737fe640 1 --2- 172.21.15.52:0/1722936182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa074072df0 0x7fa0740731d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa0740b36f0 tx=0x7fa06401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3040cf621cdbcd1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa0727fc640 1 -- 172.21.15.52:0/1722936182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0640b0070 con 0x7fa074072df0 2024-09-15T20:51:36.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa0727fc640 1 -- 172.21.15.52:0/1722936182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0640ab600 con 0x7fa074072df0 2024-09-15T20:51:36.643 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.637+0000 7fa0727fc640 1 -- 172.21.15.52:0/1722936182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07413daf0 con 0x7fa074072df0 2024-09-15T20:51:36.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 -- 172.21.15.52:0/1722936182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa074072df0 msgr2=0x7fa0740731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 --2- 172.21.15.52:0/1722936182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa074072df0 0x7fa0740731d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa0740b36f0 tx=0x7fa06401c340 comp rx=0 tx=0).stop 2024-09-15T20:51:36.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 -- 172.21.15.52:0/1722936182 shutdown_connections 2024-09-15T20:51:36.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 --2- 172.21.15.52:0/1722936182 >> v2:172.21.15.81:3300/0 conn(0x7fa074070ee0 0x7fa07413d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 --2- 172.21.15.52:0/1722936182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa074072df0 0x7fa0740731d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 -- 172.21.15.52:0/1722936182 >> 172.21.15.52:0/1722936182 conn(0x7fa0740b59a0 msgr2=0x7fa0740b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:36.644 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 -- 172.21.15.52:0/1722936182 shutdown_connections 2024-09-15T20:51:36.645 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 -- 172.21.15.52:0/1722936182 wait complete. 2024-09-15T20:51:36.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 Processor -- start 2024-09-15T20:51:36.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 -- start start 2024-09-15T20:51:36.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa074070ee0 0x7fa0741439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.646 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa074072df0 0x7fa0741dcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa074074180 0x7fa0741449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa07414d5a0 con 0x7fa074072df0 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa07414d420 con 0x7fa074074180 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fa07414d720 con 0x7fa074070ee0 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa072ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa074072df0 0x7fa0741dcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa0737fe640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa074070ee0 0x7fa0741439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa072ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa074072df0 0x7fa0741dcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33216/0 (socket says 172.21.15.52:33216) 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa072ffd640 1 -- 172.21.15.52:0/3409153015 learned_addr learned my addr 172.21.15.52:0/3409153015 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa073fff640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa074074180 0x7fa0741449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa072ffd640 1 -- 172.21.15.52:0/3409153015 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa074070ee0 msgr2=0x7fa0741439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa072ffd640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa074070ee0 0x7fa0741439d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa072ffd640 1 -- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa074074180 msgr2=0x7fa0741449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.647 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa072ffd640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa074074180 0x7fa0741449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa072ffd640 1 -- 172.21.15.52:0/3409153015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa074145360 con 0x7fa074072df0 2024-09-15T20:51:36.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa0737fe640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fa074070ee0 0x7fa0741439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:36.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa072ffd640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa074072df0 0x7fa0741dcd00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa06800c430 tx=0x7fa06800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa05bfff640 1 -- 172.21.15.52:0/3409153015 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0680074e0 con 0x7fa074072df0 2024-09-15T20:51:36.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa05bfff640 1 -- 172.21.15.52:0/3409153015 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0680047f0 con 0x7fa074072df0 2024-09-15T20:51:36.648 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa05bfff640 1 -- 172.21.15.52:0/3409153015 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa068004be0 con 0x7fa074072df0 2024-09-15T20:51:36.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 -- 172.21.15.52:0/3409153015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0741363b0 con 0x7fa074072df0 2024-09-15T20:51:36.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.641+0000 7fa079c58640 1 -- 172.21.15.52:0/3409153015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0741450d0 con 0x7fa074072df0 2024-09-15T20:51:36.649 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.645+0000 7fa079c58640 1 -- 172.21.15.52:0/3409153015 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa07413d1a0 con 0x7fa074072df0 2024-09-15T20:51:36.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.645+0000 7fa05bfff640 1 -- 172.21.15.52:0/3409153015 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fa068011070 con 0x7fa074072df0 2024-09-15T20:51:36.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.645+0000 7fa05bfff640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa060072ec0 0x7fa060075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.645+0000 7fa05bfff640 1 -- 172.21.15.52:0/3409153015 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7fa068093dd0 con 0x7fa074072df0 2024-09-15T20:51:36.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.645+0000 7fa05bfff640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] conn(0x7fa06007a080 0x7fa06007c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.645+0000 7fa05bfff640 1 -- 172.21.15.52:0/3409153015 --> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa06007cb50 con 0x7fa06007a080 2024-09-15T20:51:36.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.645+0000 7fa05bfff640 1 -- 172.21.15.52:0/3409153015 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa068094260 con 0x7fa074072df0 2024-09-15T20:51:36.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.645+0000 7fa0737fe640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa060072ec0 0x7fa060075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.650 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.645+0000 7fa073fff640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] conn(0x7fa06007a080 0x7fa06007c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.645+0000 7fa0737fe640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa060072ec0 0x7fa060075380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa0640ad000 tx=0x7fa0640a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.645+0000 7fa073fff640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] conn(0x7fa06007a080 0x7fa06007c4a0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.651 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.649+0000 7fa05bfff640 1 -- 172.21.15.52:0/3409153015 <== osd.6 v2:172.21.15.81:6800/1367983121 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa06007cb50 con 0x7fa06007a080 2024-09-15T20:51:36.665 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa079c58640 1 -- 172.21.15.52:0/3409153015 --> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa07406d920 con 0x7fa06007a080 2024-09-15T20:51:36.666 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa05bfff640 1 -- 172.21.15.52:0/3409153015 <== osd.6 v2:172.21.15.81:6800/1367983121 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa07406d920 con 0x7fa06007a080 2024-09-15T20:51:36.666 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-15T20:51:36.666 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T20:51:36.666 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-15T20:51:36.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa079c58640 1 -- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] conn(0x7fa06007a080 msgr2=0x7fa06007c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa079c58640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:6800/1367983121,v1:172.21.15.81:6801/1367983121] conn(0x7fa06007a080 0x7fa06007c4a0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa079c58640 1 -- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa060072ec0 msgr2=0x7fa060075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa079c58640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fa060072ec0 0x7fa060075380 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa0640ad000 tx=0x7fa0640a6000 comp rx=0 tx=0).stop 2024-09-15T20:51:36.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa079c58640 1 -- 172.21.15.52:0/3409153015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa074072df0 msgr2=0x7fa0741dcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa079c58640 1 --2- 172.21.15.52:0/3409153015 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa074072df0 0x7fa0741dcd00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa06800c430 tx=0x7fa06800c8f0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa073fff640 1 -- 172.21.15.52:0/3409153015 reap_dead start 2024-09-15T20:51:36.667 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa079c58640 1 -- 172.21.15.52:0/3409153015 shutdown_connections 2024-09-15T20:51:36.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa079c58640 1 -- 172.21.15.52:0/3409153015 >> 172.21.15.52:0/3409153015 conn(0x7fa0740b59a0 msgr2=0x7fa0740b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:36.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa079c58640 1 -- 172.21.15.52:0/3409153015 shutdown_connections 2024-09-15T20:51:36.668 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.661+0000 7fa079c58640 1 -- 172.21.15.52:0/3409153015 wait complete. 2024-09-15T20:51:36.682 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-15T20:51:36.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.805+0000 7f5e11997640 1 Processor -- start 2024-09-15T20:51:36.810 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.805+0000 7f5e11997640 1 -- start start 2024-09-15T20:51:36.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.805+0000 7f5e11997640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e0c1415c0 0x7f5e0c0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.805+0000 7f5e11997640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e0c074d90 con 0x7f5e0c076390 2024-09-15T20:51:36.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.805+0000 7f5e11997640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e0c0b16f0 con 0x7f5e0c145130 2024-09-15T20:51:36.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.805+0000 7f5e11997640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5e0c0b14d0 con 0x7f5e0c1415c0 2024-09-15T20:51:36.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e0affd640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f5e0c076390 0x7f5e0c140eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57362/0 (socket says 172.21.15.52:57362) 2024-09-15T20:51:36.811 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e0affd640 1 -- 172.21.15.52:0/1048086165 learned_addr learned my addr 172.21.15.52:0/1048086165 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:36.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e0a7fc640 1 --2- 172.21.15.52:0/1048086165 >> v2:172.21.15.81:3300/0 conn(0x7f5e0c1415c0 0x7f5e0c0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 740667734 0 0) 0x7f5e0c074d90 con 0x7f5e0c076390 2024-09-15T20:51:36.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5df4003530 con 0x7f5e0c076390 2024-09-15T20:51:36.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 474688037 0 0) 0x7f5df4003530 con 0x7f5e0c076390 2024-09-15T20:51:36.813 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 >> v2:172.21.15.81:3300/0 conn(0x7f5e0c1415c0 msgr2=0x7f5e0c0b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:36.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 --2- 172.21.15.52:0/1048086165 >> v2:172.21.15.81:3300/0 conn(0x7f5e0c1415c0 0x7f5e0c0b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 >> v1:172.21.15.81:6789/0 conn(0x7f5e0c145130 legacy=0x7f5e0c1455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:36.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c076770 con 0x7f5e0c076390 2024-09-15T20:51:36.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 282972984 0 0) 0x7f5dfc001700 con 0x7f5e0c076390 2024-09-15T20:51:36.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 >> v1:172.21.15.52:6789/0 conn(0x7f5e0c076390 legacy=0x7f5e0c140eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 --2- 172.21.15.52:0/1048086165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5df4003a10 0x7f5df4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 --2- 172.21.15.52:0/1048086165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5df4004810 0x7f5df4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 --2- 172.21.15.52:0/1048086165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 0x7f5df40141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c0b14d0 con 0x7f5df4004810 2024-09-15T20:51:36.814 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5df4014960 con 0x7f5df4003a10 2024-09-15T20:51:36.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f5df4014b60 con 0x7f5df4005220 2024-09-15T20:51:36.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e0b7fe640 1 --2- 172.21.15.52:0/1048086165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 0x7f5df40141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e0a7fc640 1 --2- 172.21.15.52:0/1048086165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5df4004810 0x7f5df4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e0b7fe640 1 -- 172.21.15.52:0/1048086165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5df4003a10 msgr2=0x7f5df4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:36.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e0b7fe640 1 --2- 172.21.15.52:0/1048086165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5df4003a10 0x7f5df4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e0b7fe640 1 -- 172.21.15.52:0/1048086165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5df4004810 msgr2=0x7f5df4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:36.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e0b7fe640 1 --2- 172.21.15.52:0/1048086165 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5df4004810 0x7f5df4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.815 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.809+0000 7f5e0b7fe640 1 -- 172.21.15.52:0/1048086165 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df4003530 con 0x7f5df4005220 2024-09-15T20:51:36.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e0b7fe640 1 -- 172.21.15.52:0/1048086165 reap_dead start 2024-09-15T20:51:36.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e0b7fe640 1 --2- 172.21.15.52:0/1048086165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 0x7f5df40141e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5e040044d0 tx=0x7f5e0401c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9665a1057b100d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e040040d0 con 0x7f5df4005220 2024-09-15T20:51:36.816 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e040a9480 con 0x7f5df4005220 2024-09-15T20:51:36.818 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e09ffb640 1 -- 172.21.15.52:0/1048086165 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e040a9870 con 0x7f5df4005220 2024-09-15T20:51:36.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e11997640 1 -- 172.21.15.52:0/1048086165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 msgr2=0x7f5df40141e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e11997640 1 --2- 172.21.15.52:0/1048086165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 0x7f5df40141e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5e040044d0 tx=0x7f5e0401c680 comp rx=0 tx=0).stop 2024-09-15T20:51:36.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e11997640 1 -- 172.21.15.52:0/1048086165 shutdown_connections 2024-09-15T20:51:36.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e11997640 1 --2- 172.21.15.52:0/1048086165 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 0x7f5df40141e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.819 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e11997640 1 -- 172.21.15.52:0/1048086165 >> 172.21.15.52:0/1048086165 conn(0x7f5e0c0b60c0 msgr2=0x7f5e0c0b64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:36.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e11997640 1 -- 172.21.15.52:0/1048086165 shutdown_connections 2024-09-15T20:51:36.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e11997640 1 -- 172.21.15.52:0/1048086165 wait complete. 2024-09-15T20:51:36.820 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.813+0000 7f5e11997640 1 Processor -- start 2024-09-15T20:51:36.821 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e11997640 1 -- start start 2024-09-15T20:51:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e11997640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 0x7f5e0c13dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.822 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e11997640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c13d070 0x7f5e0c1db130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e11997640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0c1db670 0x7f5e0c1dbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e11997640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c0b1320 con 0x7f5e0c13d070 2024-09-15T20:51:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e11997640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c0b11a0 con 0x7f5e0c1db670 2024-09-15T20:51:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e11997640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f5e0c140eb0 con 0x7f5df4005220 2024-09-15T20:51:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e0affd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 0x7f5e0c13dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e0affd640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 0x7f5e0c13dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3301/0 says I am v2:172.21.15.52:46854/0 (socket says 172.21.15.52:46854) 2024-09-15T20:51:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e0affd640 1 -- 172.21.15.52:0/3662439743 learned_addr learned my addr 172.21.15.52:0/3662439743 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e0a7fc640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c13d070 0x7f5e0c1db130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e0b7fe640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0c1db670 0x7f5e0c1dbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.823 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e0affd640 1 -- 172.21.15.52:0/3662439743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0c1db670 msgr2=0x7f5e0c1dbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e0affd640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0c1db670 0x7f5e0c1dbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e0affd640 1 -- 172.21.15.52:0/3662439743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c13d070 msgr2=0x7f5e0c1db130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e0affd640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c13d070 0x7f5e0c1db130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e0affd640 1 -- 172.21.15.52:0/3662439743 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c13c360 con 0x7f5df4005220 2024-09-15T20:51:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e0a7fc640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c13d070 0x7f5e0c1db130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T20:51:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e0affd640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 0x7f5e0c13dfb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c780 tx=0x7f5dfc00cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5df3fff640 1 -- 172.21.15.52:0/3662439743 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc0072d0 con 0x7f5df4005220 2024-09-15T20:51:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5df3fff640 1 -- 172.21.15.52:0/3662439743 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dfc007470 con 0x7f5df4005220 2024-09-15T20:51:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5df3fff640 1 -- 172.21.15.52:0/3662439743 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc0047f0 con 0x7f5df4005220 2024-09-15T20:51:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e11997640 1 -- 172.21.15.52:0/3662439743 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0c13c640 con 0x7f5df4005220 2024-09-15T20:51:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e11997640 1 -- 172.21.15.52:0/3662439743 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0c133e00 con 0x7f5df4005220 2024-09-15T20:51:36.824 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.817+0000 7f5e11997640 1 -- 172.21.15.52:0/3662439743 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e0c141240 con 0x7f5df4005220 2024-09-15T20:51:36.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.821+0000 7f5df3fff640 1 -- 172.21.15.52:0/3662439743 <== mon.2 v2:172.21.15.52:3301/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f5dfc011070 con 0x7f5df4005220 2024-09-15T20:51:36.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.821+0000 7f5df3fff640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5df8072ef0 0x7f5df80753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:36.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.821+0000 7f5df3fff640 1 -- 172.21.15.52:0/3662439743 <== mon.2 v2:172.21.15.52:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f5dfc093790 con 0x7f5df4005220 2024-09-15T20:51:36.825 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.821+0000 7f5e0a7fc640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5df8072ef0 0x7f5df80753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:36.826 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.821+0000 7f5e0a7fc640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5df8072ef0 0x7f5df80753b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c145070 tx=0x7f5e00011040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:36.830 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:36.825+0000 7f5df3fff640 1 -- 172.21.15.52:0/3662439743 <== mon.2 v2:172.21.15.52:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f5dfc05ea20 con 0x7f5df4005220 2024-09-15T20:51:37.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 -- 172.21.15.52:0/3662439743 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f5e0c0b0010 con 0x7f5df8072ef0 2024-09-15T20:51:37.076 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5df3fff640 1 -- 172.21.15.52:0/3662439743 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5e0c0b0010 con 0x7f5df8072ef0 2024-09-15T20:51:37.077 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 6 to deep-scrub 2024-09-15T20:51:37.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 -- 172.21.15.52:0/3662439743 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5df8072ef0 msgr2=0x7f5df80753b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5df8072ef0 0x7f5df80753b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c145070 tx=0x7f5e00011040 comp rx=0 tx=0).stop 2024-09-15T20:51:37.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 -- 172.21.15.52:0/3662439743 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 msgr2=0x7f5e0c13dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 0x7f5e0c13dfb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c780 tx=0x7f5dfc00cb80 comp rx=0 tx=0).stop 2024-09-15T20:51:37.079 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 -- 172.21.15.52:0/3662439743 shutdown_connections 2024-09-15T20:51:37.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5df8072ef0 0x7f5df80753b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0c1db670 0x7f5e0c1dbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5e0c13d070 0x7f5e0c1db130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 --2- 172.21.15.52:0/3662439743 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5df4005220 0x7f5e0c13dfb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 -- 172.21.15.52:0/3662439743 >> 172.21.15.52:0/3662439743 conn(0x7f5e0c0b60c0 msgr2=0x7f5e0c13eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:37.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 -- 172.21.15.52:0/3662439743 shutdown_connections 2024-09-15T20:51:37.080 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.073+0000 7f5e11997640 1 -- 172.21.15.52:0/3662439743 wait complete. 2024-09-15T20:51:37.095 INFO:tasks.ceph:Scrubbing osd.7 2024-09-15T20:51:37.095 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-15T20:51:37.220 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.217+0000 7fd2dca5b640 1 Processor -- start 2024-09-15T20:51:37.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.217+0000 7fd2dca5b640 1 -- start start 2024-09-15T20:51:37.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.217+0000 7fd2dca5b640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd2d8068c30 0x7fd2d80aad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.217+0000 7fd2dca5b640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d80aba20 con 0x7fd2d813bc10 2024-09-15T20:51:37.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.217+0000 7fd2dca5b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d80ab370 con 0x7fd2d8069010 2024-09-15T20:51:37.221 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.217+0000 7fd2dca5b640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d80b3240 con 0x7fd2d8068c30 2024-09-15T20:51:37.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.217+0000 7fd2d659c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd2d8068c30 0x7fd2d80aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.217+0000 7fd2d6d9d640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd2d813bc10 0x7fd2d8145100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:57366/0 (socket says 172.21.15.52:57366) 2024-09-15T20:51:37.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.217+0000 7fd2d6d9d640 1 -- 172.21.15.52:0/3038639601 learned_addr learned my addr 172.21.15.52:0/3038639601 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:37.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.217+0000 7fd2d659c640 1 -- 172.21.15.52:0/3038639601 >> v1:172.21.15.81:6789/0 conn(0x7fd2d8069010 legacy=0x7fd2d813b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:37.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.217+0000 7fd2d659c640 1 -- 172.21.15.52:0/3038639601 >> v1:172.21.15.52:6789/0 conn(0x7fd2d813bc10 legacy=0x7fd2d8145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.222 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.217+0000 7fd2d659c640 1 -- 172.21.15.52:0/3038639601 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d8145810 con 0x7fd2d8068c30 2024-09-15T20:51:37.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2d659c640 1 --2- 172.21.15.52:0/3038639601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2d8068c30 0x7fd2d80aad50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009d90 tx=0x7fd2d001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b79c741c24ea3c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:37.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2d559a640 1 -- 172.21.15.52:0/3038639601 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00b2070 con 0x7fd2d8068c30 2024-09-15T20:51:37.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2d559a640 1 -- 172.21.15.52:0/3038639601 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d00a5890 con 0x7fd2d8068c30 2024-09-15T20:51:37.224 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2d559a640 1 -- 172.21.15.52:0/3038639601 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00a5c60 con 0x7fd2d8068c30 2024-09-15T20:51:37.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 -- 172.21.15.52:0/3038639601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2d8068c30 msgr2=0x7fd2d80aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 --2- 172.21.15.52:0/3038639601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2d8068c30 0x7fd2d80aad50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009d90 tx=0x7fd2d001c8c0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 -- 172.21.15.52:0/3038639601 shutdown_connections 2024-09-15T20:51:37.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 --2- 172.21.15.52:0/3038639601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2d8068c30 0x7fd2d80aad50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 -- 172.21.15.52:0/3038639601 >> 172.21.15.52:0/3038639601 conn(0x7fd2d806eda0 msgr2=0x7fd2d80b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:37.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 -- 172.21.15.52:0/3038639601 shutdown_connections 2024-09-15T20:51:37.225 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 -- 172.21.15.52:0/3038639601 wait complete. 2024-09-15T20:51:37.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 Processor -- start 2024-09-15T20:51:37.226 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 -- start start 2024-09-15T20:51:37.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d8068c30 0x7fd2d8133740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2d8069010 0x7fd2d8136800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2d813bc10 0x7fd2d813f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d8150110 con 0x7fd2d8069010 2024-09-15T20:51:37.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d814ff90 con 0x7fd2d8068c30 2024-09-15T20:51:37.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2dca5b640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d8150290 con 0x7fd2d813bc10 2024-09-15T20:51:37.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2d5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2d8069010 0x7fd2d8136800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2d5d9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2d8069010 0x7fd2d8136800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33254/0 (socket says 172.21.15.52:33254) 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2d6d9d640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2d813bc10 0x7fd2d813f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2d5d9b640 1 -- 172.21.15.52:0/1115365930 learned_addr learned my addr 172.21.15.52:0/1115365930 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2d659c640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d8068c30 0x7fd2d8133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.221+0000 7fd2d5d9b640 1 -- 172.21.15.52:0/1115365930 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2d813bc10 msgr2=0x7fd2d813f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2d5d9b640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7fd2d813bc10 0x7fd2d813f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2d5d9b640 1 -- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d8068c30 msgr2=0x7fd2d8133740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2d5d9b640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d8068c30 0x7fd2d8133740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2d5d9b640 1 -- 172.21.15.52:0/1115365930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d8140d60 con 0x7fd2d8069010 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2d659c640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d8068c30 0x7fd2d8133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2d5d9b640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2d8069010 0x7fd2d8136800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000c490 tx=0x7fd2c0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2ceffd640 1 -- 172.21.15.52:0/1115365930 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0017070 con 0x7fd2d8069010 2024-09-15T20:51:37.229 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2ceffd640 1 -- 172.21.15.52:0/1115365930 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c0003600 con 0x7fd2d8069010 2024-09-15T20:51:37.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2dca5b640 1 -- 172.21.15.52:0/1115365930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d813c6e0 con 0x7fd2d8069010 2024-09-15T20:51:37.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2ceffd640 1 -- 172.21.15.52:0/1115365930 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0003a30 con 0x7fd2d8069010 2024-09-15T20:51:37.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2dca5b640 1 -- 172.21.15.52:0/1115365930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d813f450 con 0x7fd2d8069010 2024-09-15T20:51:37.230 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2dca5b640 1 -- 172.21.15.52:0/1115365930 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd2d80aac40 con 0x7fd2d8069010 2024-09-15T20:51:37.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2ceffd640 1 -- 172.21.15.52:0/1115365930 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7fd2c001a070 con 0x7fd2d8069010 2024-09-15T20:51:37.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2ceffd640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fd2b8072ec0 0x7fd2b8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2ceffd640 1 -- 172.21.15.52:0/1115365930 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7fd2c0092ea0 con 0x7fd2d8069010 2024-09-15T20:51:37.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2ceffd640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] conn(0x7fd2b807a080 0x7fd2b807c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2ceffd640 1 -- 172.21.15.52:0/1115365930 --> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2b807cb50 con 0x7fd2b807a080 2024-09-15T20:51:37.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2ceffd640 1 -- 172.21.15.52:0/1115365930 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd2c00955a0 con 0x7fd2d8069010 2024-09-15T20:51:37.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2d659c640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fd2b8072ec0 0x7fd2b8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.231 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2d6d9d640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] conn(0x7fd2b807a080 0x7fd2b807c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2d6d9d640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] conn(0x7fd2b807a080 0x7fd2b807c4a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:37.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.225+0000 7fd2d659c640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fd2b8072ec0 0x7fd2b8075380 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00af000 tx=0x7fd2d00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:37.232 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.229+0000 7fd2ceffd640 1 -- 172.21.15.52:0/1115365930 <== osd.7 v2:172.21.15.81:6824/579210364 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2b807cb50 con 0x7fd2b807a080 2024-09-15T20:51:37.245 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2dca5b640 1 -- 172.21.15.52:0/1115365930 --> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd2d813a390 con 0x7fd2b807a080 2024-09-15T20:51:37.246 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2ceffd640 1 -- 172.21.15.52:0/1115365930 <== osd.7 v2:172.21.15.81:6824/579210364 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd2d813a390 con 0x7fd2b807a080 2024-09-15T20:51:37.247 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-15T20:51:37.247 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T20:51:37.247 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-15T20:51:37.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2dca5b640 1 -- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] conn(0x7fd2b807a080 msgr2=0x7fd2b807c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2dca5b640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:6824/579210364,v1:172.21.15.81:6825/579210364] conn(0x7fd2b807a080 0x7fd2b807c4a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2dca5b640 1 -- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fd2b8072ec0 msgr2=0x7fd2b8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.248 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2dca5b640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7fd2b8072ec0 0x7fd2b8075380 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00af000 tx=0x7fd2d00a7070 comp rx=0 tx=0).stop 2024-09-15T20:51:37.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2dca5b640 1 -- 172.21.15.52:0/1115365930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2d8069010 msgr2=0x7fd2d8136800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2dca5b640 1 --2- 172.21.15.52:0/1115365930 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2d8069010 0x7fd2d8136800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000c490 tx=0x7fd2c0001e80 comp rx=0 tx=0).stop 2024-09-15T20:51:37.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2d6d9d640 1 -- 172.21.15.52:0/1115365930 reap_dead start 2024-09-15T20:51:37.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2dca5b640 1 -- 172.21.15.52:0/1115365930 shutdown_connections 2024-09-15T20:51:37.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2dca5b640 1 -- 172.21.15.52:0/1115365930 >> 172.21.15.52:0/1115365930 conn(0x7fd2d806eda0 msgr2=0x7fd2d806d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:37.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2dca5b640 1 -- 172.21.15.52:0/1115365930 shutdown_connections 2024-09-15T20:51:37.249 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.241+0000 7fd2dca5b640 1 -- 172.21.15.52:0/1115365930 wait complete. 2024-09-15T20:51:37.262 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-15T20:51:37.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.373+0000 7f5be1207640 1 Processor -- start 2024-09-15T20:51:37.378 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.373+0000 7f5be1207640 1 -- start start 2024-09-15T20:51:37.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.373+0000 7f5be1207640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5bdc072b30 0x7f5bdc13a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.379 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.373+0000 7f5be1207640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bdc1441d0 0x7f5bdc144680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.373+0000 7f5be1207640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bdc073c20 con 0x7f5bdc072750 2024-09-15T20:51:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.373+0000 7f5be1207640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f5bdc144bc0 con 0x7f5bdc072b30 2024-09-15T20:51:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.373+0000 7f5be1207640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f5bdc074840 con 0x7f5bdc1441d0 2024-09-15T20:51:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.373+0000 7f5bda59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5bdc072b30 0x7f5bdc13a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.373+0000 7f5bda59c640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5bdc072b30 0x7f5bdc13a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33264/0 (socket says 172.21.15.52:33264) 2024-09-15T20:51:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.373+0000 7f5bda59c640 1 -- 172.21.15.52:0/1801881451 learned_addr learned my addr 172.21.15.52:0/1801881451 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.373+0000 7f5bdb59e640 1 --2- 172.21.15.52:0/1801881451 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bdc1441d0 0x7f5bdc144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5bda59c640 1 -- 172.21.15.52:0/1801881451 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bdc1441d0 msgr2=0x7f5bdc144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5bda59c640 1 --2- 172.21.15.52:0/1801881451 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bdc1441d0 0x7f5bdc144680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5bda59c640 1 -- 172.21.15.52:0/1801881451 >> v1:172.21.15.81:6789/0 conn(0x7f5bdc072750 legacy=0x7f5bdc13a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5bda59c640 1 -- 172.21.15.52:0/1801881451 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bdc0705c0 con 0x7f5bdc072b30 2024-09-15T20:51:37.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5bda59c640 1 --2- 172.21.15.52:0/1801881451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bdc072b30 0x7f5bdc13a8c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009870 tx=0x7f5bd001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268bc9b62ca11b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:37.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5bd9d9b640 1 -- 172.21.15.52:0/1801881451 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00ab650 con 0x7f5bdc072b30 2024-09-15T20:51:37.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5bd9d9b640 1 -- 172.21.15.52:0/1801881451 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd00b0070 con 0x7f5bdc072b30 2024-09-15T20:51:37.381 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5bd9d9b640 1 -- 172.21.15.52:0/1801881451 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00aba10 con 0x7f5bdc072b30 2024-09-15T20:51:37.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5be1207640 1 -- 172.21.15.52:0/1801881451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bdc072b30 msgr2=0x7f5bdc13a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5be1207640 1 --2- 172.21.15.52:0/1801881451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bdc072b30 0x7f5bdc13a8c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009870 tx=0x7f5bd001c4b0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5be1207640 1 -- 172.21.15.52:0/1801881451 shutdown_connections 2024-09-15T20:51:37.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5be1207640 1 --2- 172.21.15.52:0/1801881451 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bdc1441d0 0x7f5bdc144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5be1207640 1 --2- 172.21.15.52:0/1801881451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bdc072b30 0x7f5bdc13a8c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5be1207640 1 -- 172.21.15.52:0/1801881451 >> 172.21.15.52:0/1801881451 conn(0x7f5bdc0b9d40 msgr2=0x7f5bdc0ba150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:37.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5be1207640 1 -- 172.21.15.52:0/1801881451 shutdown_connections 2024-09-15T20:51:37.382 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5be1207640 1 -- 172.21.15.52:0/1801881451 wait complete. 2024-09-15T20:51:37.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5be1207640 1 Processor -- start 2024-09-15T20:51:37.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.377+0000 7f5be1207640 1 -- start start 2024-09-15T20:51:37.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5be1207640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bdc072750 0x7f5bdc147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5be1207640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bdc072b30 0x7f5bdc12ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.384 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5be1207640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bdc1441d0 0x7f5bdc130520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5be1207640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc1510c0 con 0x7f5bdc072b30 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5be1207640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bdc0b6650 con 0x7f5bdc072750 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5be1207640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f5bdc151240 con 0x7f5bdc1441d0 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bda59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bdc072b30 0x7f5bdc12ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bda59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bdc072b30 0x7f5bdc12ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33266/0 (socket says 172.21.15.52:33266) 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bda59c640 1 -- 172.21.15.52:0/718890846 learned_addr learned my addr 172.21.15.52:0/718890846 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bdb59e640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bdc1441d0 0x7f5bdc130520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bdad9d640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bdc072750 0x7f5bdc147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bda59c640 1 -- 172.21.15.52:0/718890846 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bdc1441d0 msgr2=0x7f5bdc130520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bda59c640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bdc1441d0 0x7f5bdc130520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bda59c640 1 -- 172.21.15.52:0/718890846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bdc072750 msgr2=0x7f5bdc147c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bda59c640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bdc072750 0x7f5bdc147c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bda59c640 1 -- 172.21.15.52:0/718890846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bdc1457c0 con 0x7f5bdc072b30 2024-09-15T20:51:37.385 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bda59c640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bdc072b30 0x7f5bdc12ffe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00ad040 tx=0x7f5bd001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:37.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bc37fe640 1 -- 172.21.15.52:0/718890846 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00b4800 con 0x7f5bdc072b30 2024-09-15T20:51:37.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bc37fe640 1 -- 172.21.15.52:0/718890846 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd00b49c0 con 0x7f5bdc072b30 2024-09-15T20:51:37.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5be1207640 1 -- 172.21.15.52:0/718890846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bdc137940 con 0x7f5bdc072b30 2024-09-15T20:51:37.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bc37fe640 1 -- 172.21.15.52:0/718890846 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00b4db0 con 0x7f5bdc072b30 2024-09-15T20:51:37.386 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5be1207640 1 -- 172.21.15.52:0/718890846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bdc14d600 con 0x7f5bdc072b30 2024-09-15T20:51:37.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5be1207640 1 -- 172.21.15.52:0/718890846 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bdc1452f0 con 0x7f5bdc072b30 2024-09-15T20:51:37.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bc37fe640 1 -- 172.21.15.52:0/718890846 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f5bd00c7440 con 0x7f5bdc072b30 2024-09-15T20:51:37.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bc37fe640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5bc8072ec0 0x7f5bc8075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bc37fe640 1 -- 172.21.15.52:0/718890846 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f5bd012e590 con 0x7f5bdc072b30 2024-09-15T20:51:37.387 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.381+0000 7f5bdad9d640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5bc8072ec0 0x7f5bc8075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.388 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.385+0000 7f5bdad9d640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5bc8072ec0 0x7f5bc8075380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4004450 tx=0x7f5bd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:37.390 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.385+0000 7f5bc37fe640 1 -- 172.21.15.52:0/718890846 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f5bd0016130 con 0x7f5bdc072b30 2024-09-15T20:51:37.569 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.565+0000 7f5be1207640 1 -- 172.21.15.52:0/718890846 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f5bdc144680 con 0x7f5bc8072ec0 2024-09-15T20:51:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.565+0000 7f5bc37fe640 1 -- 172.21.15.52:0/718890846 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5bdc144680 con 0x7f5bc8072ec0 2024-09-15T20:51:37.570 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 7 to deep-scrub 2024-09-15T20:51:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.569+0000 7f5be1207640 1 -- 172.21.15.52:0/718890846 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5bc8072ec0 msgr2=0x7f5bc8075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.569+0000 7f5be1207640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5bc8072ec0 0x7f5bc8075380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4004450 tx=0x7f5bd4009040 comp rx=0 tx=0).stop 2024-09-15T20:51:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.569+0000 7f5be1207640 1 -- 172.21.15.52:0/718890846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bdc072b30 msgr2=0x7f5bdc12ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.569+0000 7f5be1207640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bdc072b30 0x7f5bdc12ffe0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00ad040 tx=0x7f5bd001acf0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.569+0000 7f5be1207640 1 -- 172.21.15.52:0/718890846 shutdown_connections 2024-09-15T20:51:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.569+0000 7f5be1207640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f5bc8072ec0 0x7f5bc8075380 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.573 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.569+0000 7f5be1207640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f5bdc1441d0 0x7f5bdc130520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.569+0000 7f5be1207640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5bdc072b30 0x7f5bdc12ffe0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.569+0000 7f5be1207640 1 --2- 172.21.15.52:0/718890846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bdc072750 0x7f5bdc147c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.569+0000 7f5be1207640 1 -- 172.21.15.52:0/718890846 >> 172.21.15.52:0/718890846 conn(0x7f5bdc0b9d40 msgr2=0x7f5bdc070970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.569+0000 7f5be1207640 1 -- 172.21.15.52:0/718890846 shutdown_connections 2024-09-15T20:51:37.574 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.569+0000 7f5be1207640 1 -- 172.21.15.52:0/718890846 wait complete. 2024-09-15T20:51:37.591 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T20:51:37.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f378ed6e640 1 Processor -- start 2024-09-15T20:51:37.712 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f378ed6e640 1 -- start start 2024-09-15T20:51:37.713 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f378ed6e640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f378813a940 0x7f3788147440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f378ed6e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f37880707d0 0x7f3788147980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f378ed6e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3788071f30 con 0x7f37880b8480 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f378ed6e640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f3788070e10 con 0x7f378813a940 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f378ed6e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f37880b8860 con 0x7f37880707d0 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f3787fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f378813a940 0x7f3788147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f3787fff640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f378813a940 0x7f3788147440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33282/0 (socket says 172.21.15.52:33282) 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f3787fff640 1 -- 172.21.15.52:0/4135445116 learned_addr learned my addr 172.21.15.52:0/4135445116 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f378d30b640 1 --2- 172.21.15.52:0/4135445116 >> v2:172.21.15.81:3300/0 conn(0x7f37880707d0 0x7f3788147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f3787fff640 1 -- 172.21.15.52:0/4135445116 >> v2:172.21.15.81:3300/0 conn(0x7f37880707d0 msgr2=0x7f3788147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f3787fff640 1 --2- 172.21.15.52:0/4135445116 >> v2:172.21.15.81:3300/0 conn(0x7f37880707d0 0x7f3788147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f3787fff640 1 -- 172.21.15.52:0/4135445116 >> v1:172.21.15.81:6789/0 conn(0x7f37880b8480 legacy=0x7f378813a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f3787fff640 1 -- 172.21.15.52:0/4135445116 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3788071280 con 0x7f378813a940 2024-09-15T20:51:37.714 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.709+0000 7f378d30b640 1 --2- 172.21.15.52:0/4135445116 >> v2:172.21.15.81:3300/0 conn(0x7f37880707d0 0x7f3788147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T20:51:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.713+0000 7f3787fff640 1 --2- 172.21.15.52:0/4135445116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f378813a940 0x7f3788147440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f378813ae20 tx=0x7f377c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacc3263fcd289b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.713+0000 7f37877fe640 1 -- 172.21.15.52:0/4135445116 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c0b2070 con 0x7f378813a940 2024-09-15T20:51:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.713+0000 7f37877fe640 1 -- 172.21.15.52:0/4135445116 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c0ad680 con 0x7f378813a940 2024-09-15T20:51:37.717 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.713+0000 7f37877fe640 1 -- 172.21.15.52:0/4135445116 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c0ada50 con 0x7f378813a940 2024-09-15T20:51:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.713+0000 7f378ed6e640 1 -- 172.21.15.52:0/4135445116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f378813a940 msgr2=0x7f3788147440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.713+0000 7f378ed6e640 1 --2- 172.21.15.52:0/4135445116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f378813a940 0x7f3788147440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f378813ae20 tx=0x7f377c01c470 comp rx=0 tx=0).stop 2024-09-15T20:51:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.713+0000 7f378ed6e640 1 -- 172.21.15.52:0/4135445116 shutdown_connections 2024-09-15T20:51:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.713+0000 7f378ed6e640 1 --2- 172.21.15.52:0/4135445116 >> v2:172.21.15.81:3300/0 conn(0x7f37880707d0 0x7f3788147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.713+0000 7f378ed6e640 1 --2- 172.21.15.52:0/4135445116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f378813a940 0x7f3788147440 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.713+0000 7f378ed6e640 1 -- 172.21.15.52:0/4135445116 >> 172.21.15.52:0/4135445116 conn(0x7f3788069210 msgr2=0x7f37880b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.713+0000 7f378ed6e640 1 -- 172.21.15.52:0/4135445116 shutdown_connections 2024-09-15T20:51:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.713+0000 7f378ed6e640 1 -- 172.21.15.52:0/4135445116 wait complete. 2024-09-15T20:51:37.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378ed6e640 1 Processor -- start 2024-09-15T20:51:37.719 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378ed6e640 1 -- start start 2024-09-15T20:51:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378ed6e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37880707d0 0x7f3788149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378ed6e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37880b8480 0x7f3788143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378ed6e640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f378813a940 0x7f378814a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378ed6e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f37881512f0 con 0x7f37880b8480 2024-09-15T20:51:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378ed6e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3788151170 con 0x7f37880707d0 2024-09-15T20:51:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378ed6e640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f3788151470 con 0x7f378813a940 2024-09-15T20:51:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f3787fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37880b8480 0x7f3788143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f3787fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37880b8480 0x7f3788143a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:33292/0 (socket says 172.21.15.52:33292) 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378d30b640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f378813a940 0x7f378814a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f3787fff640 1 -- 172.21.15.52:0/2512797663 learned_addr learned my addr 172.21.15.52:0/2512797663 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378cb0a640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37880707d0 0x7f3788149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f3787fff640 1 -- 172.21.15.52:0/2512797663 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f378813a940 msgr2=0x7f378814a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f3787fff640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f378813a940 0x7f378814a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f3787fff640 1 -- 172.21.15.52:0/2512797663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37880707d0 msgr2=0x7f3788149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f3787fff640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37880707d0 0x7f3788149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f3787fff640 1 -- 172.21.15.52:0/2512797663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37881366d0 con 0x7f37880b8480 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378cb0a640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37880707d0 0x7f3788149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f3787fff640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37880b8480 0x7f3788143a60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f377c01a0a0 tx=0x7f377c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f37857fa640 1 -- 172.21.15.52:0/2512797663 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c0bd070 con 0x7f37880b8480 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f37857fa640 1 -- 172.21.15.52:0/2512797663 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c0b8430 con 0x7f37880b8480 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378ed6e640 1 -- 172.21.15.52:0/2512797663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378814c640 con 0x7f37880b8480 2024-09-15T20:51:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f37857fa640 1 -- 172.21.15.52:0/2512797663 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c0b2040 con 0x7f37880b8480 2024-09-15T20:51:37.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378ed6e640 1 -- 172.21.15.52:0/2512797663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3788136350 con 0x7f37880b8480 2024-09-15T20:51:37.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f378ed6e640 1 -- 172.21.15.52:0/2512797663 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f378813a230 con 0x7f37880b8480 2024-09-15T20:51:37.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f37857fa640 1 -- 172.21.15.52:0/2512797663 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f377c0c0070 con 0x7f37880b8480 2024-09-15T20:51:37.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.717+0000 7f37857fa640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3774072ec0 0x7f3774075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:37.723 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.721+0000 7f37857fa640 1 -- 172.21.15.52:0/2512797663 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f377c12d4a0 con 0x7f37880b8480 2024-09-15T20:51:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.721+0000 7f378cb0a640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3774072ec0 0x7f3774075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:37.724 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.721+0000 7f378cb0a640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3774072ec0 0x7f3774075380 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3778001750 tx=0x7f3778009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:37.727 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.725+0000 7f37857fa640 1 -- 172.21.15.52:0/2512797663 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f377c0160f0 con 0x7f37880b8480 2024-09-15T20:51:37.951 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.945+0000 7f378ed6e640 1 -- 172.21.15.52:0/2512797663 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f37880b67d0 con 0x7f3774072ec0 2024-09-15T20:51:37.954 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.949+0000 7f37857fa640 1 -- 172.21.15.52:0/2512797663 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117499 (secure 0 0 0) 0x7f37880b67d0 con 0x7f3774072ec0 2024-09-15T20:51:37.955 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:51:37.955 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-15T20:51:37.957 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.953+0000 7f378ed6e640 1 -- 172.21.15.52:0/2512797663 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3774072ec0 msgr2=0x7f3774075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.953+0000 7f378ed6e640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3774072ec0 0x7f3774075380 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3778001750 tx=0x7f3778009040 comp rx=0 tx=0).stop 2024-09-15T20:51:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.953+0000 7f378ed6e640 1 -- 172.21.15.52:0/2512797663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37880b8480 msgr2=0x7f3788143a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.953+0000 7f378ed6e640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37880b8480 0x7f3788143a60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f377c01a0a0 tx=0x7f377c019210 comp rx=0 tx=0).stop 2024-09-15T20:51:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.953+0000 7f378ed6e640 1 -- 172.21.15.52:0/2512797663 shutdown_connections 2024-09-15T20:51:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.953+0000 7f378ed6e640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3774072ec0 0x7f3774075380 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.958 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.953+0000 7f378ed6e640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f378813a940 0x7f378814a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.953+0000 7f378ed6e640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f37880b8480 0x7f3788143a60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.953+0000 7f378ed6e640 1 --2- 172.21.15.52:0/2512797663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37880707d0 0x7f3788149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.953+0000 7f378ed6e640 1 -- 172.21.15.52:0/2512797663 >> 172.21.15.52:0/2512797663 conn(0x7f3788069210 msgr2=0x7f37880b5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.953+0000 7f378ed6e640 1 -- 172.21.15.52:0/2512797663 shutdown_connections 2024-09-15T20:51:37.959 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:37.953+0000 7f378ed6e640 1 -- 172.21.15.52:0/2512797663 wait complete. 2024-09-15T20:51:37.981 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-15T20:51:37.294466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3574125355,"num_objects":883,"num_object_clones":0,"num_object_copies":1766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":883,"num_whiteouts":0,"num_read":2629,"num_read_kb":2634,"num_write":159748,"num_write_kb":5637879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161620,"ondisk_log_size":161620,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8554380,"kb_used_data":6692144,"kb_used_omap":12,"kb_used_meta":1862067,"kb_avail":746420340,"statfs":{"total":773094113280,"available":764334428160,"internally_reserved":0,"allocated":6852755456,"data_stored":6847057438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1906757168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8720,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":66,"num_read_kb":71,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003103"},"pg_stats":[{"pgid":"3.1f","version":"25'2778","reported_seq":2802,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477036+0000","last_change":"2024-09-15T20:47:21.015285+0000","last_active":"2024-09-15T20:51:30.477036+0000","last_peered":"2024-09-15T20:51:30.477036+0000","last_clean":"2024-09-15T20:51:30.477036+0000","last_became_active":"2024-09-15T20:47:21.011783+0000","last_became_peered":"2024-09-15T20:47:21.011783+0000","last_unstale":"2024-09-15T20:51:30.477036+0000","last_undegraded":"2024-09-15T20:51:30.477036+0000","last_fullsized":"2024-09-15T20:51:30.477036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2778,"log_dups_size":0,"ondisk_log_size":2778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:05.541594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63045632,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":2788,"num_write_kb":119877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5177","reported_seq":5196,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477114+0000","last_change":"2024-09-15T20:47:21.015253+0000","last_active":"2024-09-15T20:51:30.477114+0000","last_peered":"2024-09-15T20:51:30.477114+0000","last_clean":"2024-09-15T20:51:30.477114+0000","last_became_active":"2024-09-15T20:47:21.012740+0000","last_became_peered":"2024-09-15T20:47:21.012740+0000","last_unstale":"2024-09-15T20:51:30.477114+0000","last_undegraded":"2024-09-15T20:51:30.477114+0000","last_fullsized":"2024-09-15T20:51:30.477114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5177,"log_dups_size":0,"ondisk_log_size":5177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:00:44.351671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5153,"num_write_kb":141699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"27'6013","reported_seq":6031,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.447357+0000","last_change":"2024-09-15T20:47:21.009274+0000","last_active":"2024-09-15T20:51:30.447357+0000","last_peered":"2024-09-15T20:51:30.447357+0000","last_clean":"2024-09-15T20:51:30.447357+0000","last_became_active":"2024-09-15T20:47:21.008254+0000","last_became_peered":"2024-09-15T20:47:21.008254+0000","last_unstale":"2024-09-15T20:51:30.447357+0000","last_undegraded":"2024-09-15T20:51:30.447357+0000","last_fullsized":"2024-09-15T20:51:30.447357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6013,"log_dups_size":0,"ondisk_log_size":6013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:25.171093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5984,"num_write_kb":200879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"25'3552","reported_seq":3575,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445935+0000","last_change":"2024-09-15T20:47:21.007102+0000","last_active":"2024-09-15T20:51:30.445935+0000","last_peered":"2024-09-15T20:51:30.445935+0000","last_clean":"2024-09-15T20:51:30.445935+0000","last_became_active":"2024-09-15T20:47:21.006831+0000","last_became_peered":"2024-09-15T20:47:21.006831+0000","last_unstale":"2024-09-15T20:51:30.445935+0000","last_undegraded":"2024-09-15T20:51:30.445935+0000","last_fullsized":"2024-09-15T20:51:30.445935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3552,"log_dups_size":0,"ondisk_log_size":3552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:43.612856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3557,"num_write_kb":160908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2772","reported_seq":2794,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.524062+0000","last_change":"2024-09-15T20:47:21.010908+0000","last_active":"2024-09-15T20:51:30.524062+0000","last_peered":"2024-09-15T20:51:30.524062+0000","last_clean":"2024-09-15T20:51:30.524062+0000","last_became_active":"2024-09-15T20:47:21.009995+0000","last_became_peered":"2024-09-15T20:47:21.009995+0000","last_unstale":"2024-09-15T20:51:30.524062+0000","last_undegraded":"2024-09-15T20:51:30.524062+0000","last_fullsized":"2024-09-15T20:51:30.524062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2772,"log_dups_size":0,"ondisk_log_size":2772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:16.024768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79700496,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":15,"num_read_kb":11,"num_write":2741,"num_write_kb":123666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7926","reported_seq":7959,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.445674+0000","last_change":"2024-09-15T20:47:21.023842+0000","last_active":"2024-09-15T20:51:30.445674+0000","last_peered":"2024-09-15T20:51:30.445674+0000","last_clean":"2024-09-15T20:51:30.445674+0000","last_became_active":"2024-09-15T20:47:21.023610+0000","last_became_peered":"2024-09-15T20:47:21.023610+0000","last_unstale":"2024-09-15T20:51:30.445674+0000","last_undegraded":"2024-09-15T20:51:30.445674+0000","last_fullsized":"2024-09-15T20:51:30.445674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":7926,"log_dups_size":0,"ondisk_log_size":7926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:29:25.867670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146120704,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":56,"num_read_kb":171,"num_write":7933,"num_write_kb":198258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"27'5270","reported_seq":5299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.516164+0000","last_change":"2024-09-15T20:47:21.007395+0000","last_active":"2024-09-15T20:51:30.516164+0000","last_peered":"2024-09-15T20:51:30.516164+0000","last_clean":"2024-09-15T20:51:30.516164+0000","last_became_active":"2024-09-15T20:47:21.005632+0000","last_became_peered":"2024-09-15T20:47:21.005632+0000","last_unstale":"2024-09-15T20:51:30.516164+0000","last_undegraded":"2024-09-15T20:51:30.516164+0000","last_fullsized":"2024-09-15T20:51:30.516164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5270,"log_dups_size":0,"ondisk_log_size":5270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:11.496243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":5236,"num_write_kb":197894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"26'6364","reported_seq":6385,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477175+0000","last_change":"2024-09-15T20:47:21.023466+0000","last_active":"2024-09-15T20:51:30.477175+0000","last_peered":"2024-09-15T20:51:30.477175+0000","last_clean":"2024-09-15T20:51:30.477175+0000","last_became_active":"2024-09-15T20:47:21.016879+0000","last_became_peered":"2024-09-15T20:47:21.016879+0000","last_unstale":"2024-09-15T20:51:30.477175+0000","last_undegraded":"2024-09-15T20:51:30.477175+0000","last_fullsized":"2024-09-15T20:51:30.477175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6364,"log_dups_size":0,"ondisk_log_size":6364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:17.404898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":6371,"num_write_kb":181001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"26'6415","reported_seq":6433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477062+0000","last_change":"2024-09-15T20:47:21.018582+0000","last_active":"2024-09-15T20:51:30.477062+0000","last_peered":"2024-09-15T20:51:30.477062+0000","last_clean":"2024-09-15T20:51:30.477062+0000","last_became_active":"2024-09-15T20:47:21.016813+0000","last_became_peered":"2024-09-15T20:47:21.016813+0000","last_unstale":"2024-09-15T20:51:30.477062+0000","last_undegraded":"2024-09-15T20:51:30.477062+0000","last_fullsized":"2024-09-15T20:51:30.477062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6415,"log_dups_size":0,"ondisk_log_size":6415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T21:41:01.610631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6412,"num_write_kb":184897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"27'3752","reported_seq":3770,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.464939+0000","last_change":"2024-09-15T20:47:21.010645+0000","last_active":"2024-09-15T20:51:30.464939+0000","last_peered":"2024-09-15T20:51:30.464939+0000","last_clean":"2024-09-15T20:51:30.464939+0000","last_became_active":"2024-09-15T20:47:21.010350+0000","last_became_peered":"2024-09-15T20:47:21.010350+0000","last_unstale":"2024-09-15T20:51:30.464939+0000","last_undegraded":"2024-09-15T20:51:30.464939+0000","last_fullsized":"2024-09-15T20:51:30.464939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3752,"log_dups_size":0,"ondisk_log_size":3752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T21:26:17.071795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3727,"num_write_kb":156934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"26'5784","reported_seq":5808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477618+0000","last_change":"2024-09-15T20:47:21.017244+0000","last_active":"2024-09-15T20:51:30.477618+0000","last_peered":"2024-09-15T20:51:30.477618+0000","last_clean":"2024-09-15T20:51:30.477618+0000","last_became_active":"2024-09-15T20:47:21.016999+0000","last_became_peered":"2024-09-15T20:47:21.016999+0000","last_unstale":"2024-09-15T20:51:30.477618+0000","last_undegraded":"2024-09-15T20:51:30.477618+0000","last_fullsized":"2024-09-15T20:51:30.477618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5784,"log_dups_size":0,"ondisk_log_size":5784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:18.918849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":5791,"num_write_kb":176448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"27'6375","reported_seq":6405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.519903+0000","last_change":"2024-09-15T20:47:21.010964+0000","last_active":"2024-09-15T20:51:30.519903+0000","last_peered":"2024-09-15T20:51:30.519903+0000","last_clean":"2024-09-15T20:51:30.519903+0000","last_became_active":"2024-09-15T20:47:21.010694+0000","last_became_peered":"2024-09-15T20:47:21.010694+0000","last_unstale":"2024-09-15T20:51:30.519903+0000","last_undegraded":"2024-09-15T20:51:30.519903+0000","last_fullsized":"2024-09-15T20:51:30.519903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6375,"log_dups_size":0,"ondisk_log_size":6375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:44.740081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":6347,"num_write_kb":171391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.448568+0000","last_change":"2024-09-15T20:47:14.474673+0000","last_active":"2024-09-15T20:51:30.448568+0000","last_peered":"2024-09-15T20:51:30.448568+0000","last_clean":"2024-09-15T20:51:30.448568+0000","last_became_active":"2024-09-15T20:47:12.471373+0000","last_became_peered":"2024-09-15T20:47:12.471373+0000","last_unstale":"2024-09-15T20:51:30.448568+0000","last_undegraded":"2024-09-15T20:51:30.448568+0000","last_fullsized":"2024-09-15T20:51:30.448568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:47.666907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018866289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'6611","reported_seq":6631,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.453085+0000","last_change":"2024-09-15T20:47:21.019817+0000","last_active":"2024-09-15T20:51:30.453085+0000","last_peered":"2024-09-15T20:51:30.453085+0000","last_clean":"2024-09-15T20:51:30.453085+0000","last_became_active":"2024-09-15T20:47:21.019020+0000","last_became_peered":"2024-09-15T20:47:21.019020+0000","last_unstale":"2024-09-15T20:51:30.453085+0000","last_undegraded":"2024-09-15T20:51:30.453085+0000","last_fullsized":"2024-09-15T20:51:30.453085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6611,"log_dups_size":0,"ondisk_log_size":6611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:33.686995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137986560,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6595,"num_write_kb":207131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.453854+0000","last_change":"2024-09-15T20:47:14.472821+0000","last_active":"2024-09-15T20:51:30.453854+0000","last_peered":"2024-09-15T20:51:30.453854+0000","last_clean":"2024-09-15T20:51:30.453854+0000","last_became_active":"2024-09-15T20:47:12.468530+0000","last_became_peered":"2024-09-15T20:47:12.468530+0000","last_unstale":"2024-09-15T20:51:30.453854+0000","last_undegraded":"2024-09-15T20:51:30.453854+0000","last_fullsized":"2024-09-15T20:51:30.453854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:33.831606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000891339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4893","reported_seq":4922,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.522882+0000","last_change":"2024-09-15T20:47:21.021835+0000","last_active":"2024-09-15T20:51:30.522882+0000","last_peered":"2024-09-15T20:51:30.522882+0000","last_clean":"2024-09-15T20:51:30.522882+0000","last_became_active":"2024-09-15T20:47:21.021031+0000","last_became_peered":"2024-09-15T20:47:21.021031+0000","last_unstale":"2024-09-15T20:51:30.522882+0000","last_undegraded":"2024-09-15T20:51:30.522882+0000","last_fullsized":"2024-09-15T20:51:30.522882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4893,"log_dups_size":0,"ondisk_log_size":4893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:21.527979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":4866,"num_write_kb":218628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.448666+0000","last_change":"2024-09-15T20:47:14.475000+0000","last_active":"2024-09-15T20:51:30.448666+0000","last_peered":"2024-09-15T20:51:30.448666+0000","last_clean":"2024-09-15T20:51:30.448666+0000","last_became_active":"2024-09-15T20:47:12.461531+0000","last_became_peered":"2024-09-15T20:47:12.461531+0000","last_unstale":"2024-09-15T20:51:30.448666+0000","last_undegraded":"2024-09-15T20:51:30.448666+0000","last_fullsized":"2024-09-15T20:51:30.448666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:28.018623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022230399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'8341","reported_seq":8404,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.444813+0000","last_change":"2024-09-15T20:47:21.026683+0000","last_active":"2024-09-15T20:51:30.444813+0000","last_peered":"2024-09-15T20:51:30.444813+0000","last_clean":"2024-09-15T20:51:30.444813+0000","last_became_active":"2024-09-15T20:47:21.025918+0000","last_became_peered":"2024-09-15T20:47:21.025918+0000","last_unstale":"2024-09-15T20:51:30.444813+0000","last_undegraded":"2024-09-15T20:51:30.444813+0000","last_fullsized":"2024-09-15T20:51:30.444813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":8341,"log_dups_size":0,"ondisk_log_size":8341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:52.672994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135988904,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":174,"num_read_kb":136,"num_write":8413,"num_write_kb":232061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.476872+0000","last_change":"2024-09-15T20:47:14.986335+0000","last_active":"2024-09-15T20:51:30.476872+0000","last_peered":"2024-09-15T20:51:30.476872+0000","last_clean":"2024-09-15T20:51:30.476872+0000","last_became_active":"2024-09-15T20:47:12.468184+0000","last_became_peered":"2024-09-15T20:47:12.468184+0000","last_unstale":"2024-09-15T20:51:30.476872+0000","last_undegraded":"2024-09-15T20:51:30.476872+0000","last_fullsized":"2024-09-15T20:51:30.476872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:30.408559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001176739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"26'4297","reported_seq":4327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.464921+0000","last_change":"2024-09-15T20:47:21.018098+0000","last_active":"2024-09-15T20:51:30.464921+0000","last_peered":"2024-09-15T20:51:30.464921+0000","last_clean":"2024-09-15T20:51:30.464921+0000","last_became_active":"2024-09-15T20:47:21.017736+0000","last_became_peered":"2024-09-15T20:47:21.017736+0000","last_unstale":"2024-09-15T20:51:30.464921+0000","last_undegraded":"2024-09-15T20:51:30.464921+0000","last_fullsized":"2024-09-15T20:51:30.464921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4297,"log_dups_size":0,"ondisk_log_size":4297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:38.019405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78276432,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":24,"num_read_kb":82,"num_write":4316,"num_write_kb":145640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"27'5363","reported_seq":5392,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:34.459912+0000","last_change":"2024-09-15T20:51:34.459862+0000","last_active":"2024-09-15T20:51:34.459912+0000","last_peered":"2024-09-15T20:51:34.459912+0000","last_clean":"2024-09-15T20:51:34.459912+0000","last_became_active":"2024-09-15T20:47:21.008994+0000","last_became_peered":"2024-09-15T20:47:21.008994+0000","last_unstale":"2024-09-15T20:51:34.459912+0000","last_undegraded":"2024-09-15T20:51:34.459912+0000","last_fullsized":"2024-09-15T20:51:34.459912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5363","last_scrub_stamp":"2024-09-15T20:51:34.459792+0000","last_deep_scrub":"27'5363","last_deep_scrub_stamp":"2024-09-15T20:51:34.459792+0000","last_clean_scrub_stamp":"2024-09-15T20:51:34.459792+0000","objects_scrubbed":33,"log_size":5363,"log_dups_size":0,"ondisk_log_size":5363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:42:48.699333+0000","scrub_duration":223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5329,"num_write_kb":197895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.447125+0000","last_change":"2024-09-15T20:47:14.474210+0000","last_active":"2024-09-15T20:51:30.447125+0000","last_peered":"2024-09-15T20:51:30.447125+0000","last_clean":"2024-09-15T20:51:30.447125+0000","last_became_active":"2024-09-15T20:47:12.471091+0000","last_became_peered":"2024-09-15T20:47:12.471091+0000","last_unstale":"2024-09-15T20:51:30.447125+0000","last_undegraded":"2024-09-15T20:51:30.447125+0000","last_fullsized":"2024-09-15T20:51:30.447125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:42.228249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014530579999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"27'3417","reported_seq":3546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.525081+0000","last_change":"2024-09-15T20:47:21.024516+0000","last_active":"2024-09-15T20:51:30.525081+0000","last_peered":"2024-09-15T20:51:30.525081+0000","last_clean":"2024-09-15T20:51:30.525081+0000","last_became_active":"2024-09-15T20:47:21.023619+0000","last_became_peered":"2024-09-15T20:47:21.023619+0000","last_unstale":"2024-09-15T20:51:30.525081+0000","last_undegraded":"2024-09-15T20:51:30.525081+0000","last_fullsized":"2024-09-15T20:51:30.525081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3417,"log_dups_size":0,"ondisk_log_size":3417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:18.323622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371536,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":138,"num_read_kb":254,"num_write":3502,"num_write_kb":132957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477926+0000","last_change":"2024-09-15T20:47:14.986963+0000","last_active":"2024-09-15T20:51:30.477926+0000","last_peered":"2024-09-15T20:51:30.477926+0000","last_clean":"2024-09-15T20:51:30.477926+0000","last_became_active":"2024-09-15T20:47:12.462360+0000","last_became_peered":"2024-09-15T20:47:12.462360+0000","last_unstale":"2024-09-15T20:51:30.477926+0000","last_undegraded":"2024-09-15T20:51:30.477926+0000","last_fullsized":"2024-09-15T20:51:30.477926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:39.175611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011324970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'3756","reported_seq":3775,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.525457+0000","last_change":"2024-09-15T20:47:21.018553+0000","last_active":"2024-09-15T20:51:30.525457+0000","last_peered":"2024-09-15T20:51:30.525457+0000","last_clean":"2024-09-15T20:51:30.525457+0000","last_became_active":"2024-09-15T20:47:21.017058+0000","last_became_peered":"2024-09-15T20:47:21.017058+0000","last_unstale":"2024-09-15T20:51:30.525457+0000","last_undegraded":"2024-09-15T20:51:30.525457+0000","last_fullsized":"2024-09-15T20:51:30.525457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3756,"log_dups_size":0,"ondisk_log_size":3756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:15.985307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3728,"num_write_kb":173059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.446681+0000","last_change":"2024-09-15T20:47:14.473959+0000","last_active":"2024-09-15T20:51:30.446681+0000","last_peered":"2024-09-15T20:51:30.446681+0000","last_clean":"2024-09-15T20:51:30.446681+0000","last_became_active":"2024-09-15T20:47:12.463812+0000","last_became_peered":"2024-09-15T20:47:12.463812+0000","last_unstale":"2024-09-15T20:51:30.446681+0000","last_undegraded":"2024-09-15T20:51:30.446681+0000","last_fullsized":"2024-09-15T20:51:30.446681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:19.954840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001226357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"26'4114","reported_seq":4133,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.453004+0000","last_change":"2024-09-15T20:47:21.006238+0000","last_active":"2024-09-15T20:51:30.453004+0000","last_peered":"2024-09-15T20:51:30.453004+0000","last_clean":"2024-09-15T20:51:30.453004+0000","last_became_active":"2024-09-15T20:47:21.005584+0000","last_became_peered":"2024-09-15T20:47:21.005584+0000","last_unstale":"2024-09-15T20:51:30.453004+0000","last_undegraded":"2024-09-15T20:51:30.453004+0000","last_fullsized":"2024-09-15T20:51:30.453004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4114,"log_dups_size":0,"ondisk_log_size":4114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:22.836701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4109,"num_write_kb":152323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.448340+0000","last_change":"2024-09-15T20:47:14.475335+0000","last_active":"2024-09-15T20:51:30.448340+0000","last_peered":"2024-09-15T20:51:30.448340+0000","last_clean":"2024-09-15T20:51:30.448340+0000","last_became_active":"2024-09-15T20:47:12.469021+0000","last_became_peered":"2024-09-15T20:47:12.469021+0000","last_unstale":"2024-09-15T20:51:30.448340+0000","last_undegraded":"2024-09-15T20:51:30.448340+0000","last_fullsized":"2024-09-15T20:51:30.448340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:11.438181+0000","last_clean_scrub_stamp":"2024-09-15T20:47:11.438181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:19.117864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025466540000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":133,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:34.800303+0000","last_change":"2024-09-15T20:51:34.800303+0000","last_active":"2024-09-15T20:51:34.800303+0000","last_peered":"2024-09-15T20:51:34.800303+0000","last_clean":"2024-09-15T20:51:34.800303+0000","last_became_active":"2024-09-15T20:47:07.289970+0000","last_became_peered":"2024-09-15T20:47:07.289970+0000","last_unstale":"2024-09-15T20:51:34.800303+0000","last_undegraded":"2024-09-15T20:51:34.800303+0000","last_fullsized":"2024-09-15T20:51:34.800303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-09-15T20:51:34.800239+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-09-15T20:51:34.800239+0000","last_clean_scrub_stamp":"2024-09-15T20:51:34.800239+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:39.550027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'3478","reported_seq":3496,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.525928+0000","last_change":"2024-09-15T20:47:21.018143+0000","last_active":"2024-09-15T20:51:30.525928+0000","last_peered":"2024-09-15T20:51:30.525928+0000","last_clean":"2024-09-15T20:51:30.525928+0000","last_became_active":"2024-09-15T20:47:21.017326+0000","last_became_peered":"2024-09-15T20:47:21.017326+0000","last_unstale":"2024-09-15T20:51:30.525928+0000","last_undegraded":"2024-09-15T20:51:30.525928+0000","last_fullsized":"2024-09-15T20:51:30.525928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3478,"log_dups_size":0,"ondisk_log_size":3478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:11:39.169392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3405,"num_write_kb":176771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"27'8078","reported_seq":8211,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.558320+0000","last_change":"2024-09-15T20:47:21.005970+0000","last_active":"2024-09-15T20:51:30.558320+0000","last_peered":"2024-09-15T20:51:30.558320+0000","last_clean":"2024-09-15T20:51:30.558320+0000","last_became_active":"2024-09-15T20:47:21.005684+0000","last_became_peered":"2024-09-15T20:47:21.005684+0000","last_unstale":"2024-09-15T20:51:30.558320+0000","last_undegraded":"2024-09-15T20:51:30.558320+0000","last_fullsized":"2024-09-15T20:51:30.558320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":8078,"log_dups_size":0,"ondisk_log_size":8078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:57.048864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104858112,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":381,"num_read_kb":346,"num_write":6033,"num_write_kb":166034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'6135","reported_seq":6177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.447150+0000","last_change":"2024-09-15T20:47:21.006726+0000","last_active":"2024-09-15T20:51:30.447150+0000","last_peered":"2024-09-15T20:51:30.447150+0000","last_clean":"2024-09-15T20:51:30.447150+0000","last_became_active":"2024-09-15T20:47:21.006304+0000","last_became_peered":"2024-09-15T20:47:21.006304+0000","last_unstale":"2024-09-15T20:51:30.447150+0000","last_undegraded":"2024-09-15T20:51:30.447150+0000","last_fullsized":"2024-09-15T20:51:30.447150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":6135,"log_dups_size":0,"ondisk_log_size":6135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:22.106814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138543632,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":97,"num_read_kb":78,"num_write":6159,"num_write_kb":180177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"25'4305","reported_seq":4324,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.477949+0000","last_change":"2024-09-15T20:47:21.026764+0000","last_active":"2024-09-15T20:51:30.477949+0000","last_peered":"2024-09-15T20:51:30.477949+0000","last_clean":"2024-09-15T20:51:30.477949+0000","last_became_active":"2024-09-15T20:47:21.025992+0000","last_became_peered":"2024-09-15T20:47:21.025992+0000","last_unstale":"2024-09-15T20:51:30.477949+0000","last_undegraded":"2024-09-15T20:51:30.477949+0000","last_fullsized":"2024-09-15T20:51:30.477949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4305,"log_dups_size":0,"ondisk_log_size":4305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:34.126386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113312264,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4307,"num_write_kb":192020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"27'2828","reported_seq":2855,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:35.495445+0000","last_change":"2024-09-15T20:51:35.495445+0000","last_active":"2024-09-15T20:51:35.495445+0000","last_peered":"2024-09-15T20:51:35.495445+0000","last_clean":"2024-09-15T20:51:35.495445+0000","last_became_active":"2024-09-15T20:47:21.019431+0000","last_became_peered":"2024-09-15T20:47:21.019431+0000","last_unstale":"2024-09-15T20:51:35.495445+0000","last_undegraded":"2024-09-15T20:51:35.495445+0000","last_fullsized":"2024-09-15T20:51:35.495445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2828","last_scrub_stamp":"2024-09-15T20:51:35.495369+0000","last_deep_scrub":"27'2828","last_deep_scrub_stamp":"2024-09-15T20:51:35.495369+0000","last_clean_scrub_stamp":"2024-09-15T20:51:35.495369+0000","objects_scrubbed":17,"log_size":2828,"log_dups_size":0,"ondisk_log_size":2828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:04.922644+0000","scrub_duration":215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69863248,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2764,"num_write_kb":138455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"27'3209","reported_seq":3229,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.448234+0000","last_change":"2024-09-15T20:47:21.002739+0000","last_active":"2024-09-15T20:51:30.448234+0000","last_peered":"2024-09-15T20:51:30.448234+0000","last_clean":"2024-09-15T20:51:30.448234+0000","last_became_active":"2024-09-15T20:47:21.002454+0000","last_became_peered":"2024-09-15T20:47:21.002454+0000","last_unstale":"2024-09-15T20:51:30.448234+0000","last_undegraded":"2024-09-15T20:51:30.448234+0000","last_fullsized":"2024-09-15T20:51:30.448234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3209,"log_dups_size":0,"ondisk_log_size":3209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:03.783169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111936016,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":3190,"num_write_kb":137614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5661","reported_seq":6082,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.536551+0000","last_change":"2024-09-15T20:47:21.008704+0000","last_active":"2024-09-15T20:51:30.536551+0000","last_peered":"2024-09-15T20:51:30.536551+0000","last_clean":"2024-09-15T20:51:30.536551+0000","last_became_active":"2024-09-15T20:47:21.007899+0000","last_became_peered":"2024-09-15T20:47:21.007899+0000","last_unstale":"2024-09-15T20:51:30.536551+0000","last_undegraded":"2024-09-15T20:51:30.536551+0000","last_fullsized":"2024-09-15T20:51:30.536551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5661,"log_dups_size":0,"ondisk_log_size":5661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:28.324549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114950144,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1345,"num_read_kb":1168,"num_write":6126,"num_write_kb":191597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'4887","reported_seq":4908,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.520257+0000","last_change":"2024-09-15T20:47:21.009343+0000","last_active":"2024-09-15T20:51:30.520257+0000","last_peered":"2024-09-15T20:51:30.520257+0000","last_clean":"2024-09-15T20:51:30.520257+0000","last_became_active":"2024-09-15T20:47:21.008922+0000","last_became_peered":"2024-09-15T20:47:21.008922+0000","last_unstale":"2024-09-15T20:51:30.520257+0000","last_undegraded":"2024-09-15T20:51:30.520257+0000","last_fullsized":"2024-09-15T20:51:30.520257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":4887,"log_dups_size":0,"ondisk_log_size":4887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:30.517648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":4843,"num_write_kb":242701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'5583","reported_seq":5601,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.530591+0000","last_change":"2024-09-15T20:47:21.028647+0000","last_active":"2024-09-15T20:51:30.530591+0000","last_peered":"2024-09-15T20:51:30.530591+0000","last_clean":"2024-09-15T20:51:30.530591+0000","last_became_active":"2024-09-15T20:47:21.028396+0000","last_became_peered":"2024-09-15T20:47:21.028396+0000","last_unstale":"2024-09-15T20:51:30.530591+0000","last_undegraded":"2024-09-15T20:51:30.530591+0000","last_fullsized":"2024-09-15T20:51:30.530591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":5583,"log_dups_size":0,"ondisk_log_size":5583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:45.063111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149618688,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5530,"num_write_kb":231368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"25'3819","reported_seq":3845,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.446685+0000","last_change":"2024-09-15T20:47:21.009991+0000","last_active":"2024-09-15T20:51:30.446685+0000","last_peered":"2024-09-15T20:51:30.446685+0000","last_clean":"2024-09-15T20:51:30.446685+0000","last_became_active":"2024-09-15T20:47:21.009741+0000","last_became_peered":"2024-09-15T20:47:21.009741+0000","last_unstale":"2024-09-15T20:51:30.446685+0000","last_undegraded":"2024-09-15T20:51:30.446685+0000","last_fullsized":"2024-09-15T20:51:30.446685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":3819,"log_dups_size":0,"ondisk_log_size":3819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T20:50:34.892506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130680656,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":3826,"num_write_kb":196699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2666","reported_seq":2708,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.525503+0000","last_change":"2024-09-15T20:47:21.015487+0000","last_active":"2024-09-15T20:51:30.525503+0000","last_peered":"2024-09-15T20:51:30.525503+0000","last_clean":"2024-09-15T20:51:30.525503+0000","last_became_active":"2024-09-15T20:47:21.012712+0000","last_became_peered":"2024-09-15T20:47:21.012712+0000","last_unstale":"2024-09-15T20:51:30.525503+0000","last_undegraded":"2024-09-15T20:51:30.525503+0000","last_fullsized":"2024-09-15T20:51:30.525503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":2666,"log_dups_size":0,"ondisk_log_size":2666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:01.394914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080896,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":94,"num_read_kb":81,"num_write":2658,"num_write_kb":115655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"27'7924","reported_seq":7943,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:30.448020+0000","last_change":"2024-09-15T20:47:21.012518+0000","last_active":"2024-09-15T20:51:30.448020+0000","last_peered":"2024-09-15T20:51:30.448020+0000","last_clean":"2024-09-15T20:51:30.448020+0000","last_became_active":"2024-09-15T20:47:21.012087+0000","last_became_peered":"2024-09-15T20:47:21.012087+0000","last_unstale":"2024-09-15T20:51:30.448020+0000","last_undegraded":"2024-09-15T20:51:30.448020+0000","last_fullsized":"2024-09-15T20:51:30.448020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:47:20.532929+0000","last_clean_scrub_stamp":"2024-09-15T20:47:20.532929+0000","objects_scrubbed":0,"log_size":7924,"log_dups_size":0,"ondisk_log_size":7924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:50.852789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125895176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":7906,"num_write_kb":193612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3573534968,"num_objects":879,"num_object_clones":0,"num_object_copies":1758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":879,"num_whiteouts":0,"num_read":2563,"num_read_kb":2579,"num_write":159645,"num_write_kb":5636249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6849421312,"data_stored":6845154424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161543,"ondisk_log_size":161543,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555516,"kb_used_data":474344,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":93816324,"statfs":{"total":96636764160,"available":96067915776,"internally_reserved":0,"allocated":485728256,"data_stored":485313060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":83098058},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1212976,"kb_used_data":938908,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93158864,"statfs":{"total":96636764160,"available":95394676736,"internally_reserved":0,"allocated":961441792,"data_stored":960577612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509498,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1182172,"kb_used_data":926156,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93189668,"statfs":{"total":96636764160,"available":95426220032,"internally_reserved":0,"allocated":948383744,"data_stored":947689656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1023476,"kb_used_data":807712,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":93348364,"statfs":{"total":96636764160,"available":95588724736,"internally_reserved":0,"allocated":827097088,"data_stored":826451219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220920262},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1064732,"kb_used_data":821192,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":93307108,"statfs":{"total":96636764160,"available":95546478592,"internally_reserved":0,"allocated":840900608,"data_stored":840208120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":923208,"kb_used_data":721332,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":93448632,"statfs":{"total":96636764160,"available":95691399168,"internally_reserved":0,"allocated":738643968,"data_stored":738011512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":206698949},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1364808,"kb_used_data":1067124,"kb_used_omap":1,"kb_used_meta":297662,"kb_avail":93007032,"statfs":{"total":96636764160,"available":95239200768,"internally_reserved":0,"allocated":1092734976,"data_stored":1091861215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":304806343},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1227492,"kb_used_data":935376,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93144348,"statfs":{"total":96636764160,"available":95379812352,"internally_reserved":0,"allocated":957825024,"data_stored":956945044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":948101120,"data_stored":947584016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":960626688,"data_stored":959943044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":957542400,"data_stored":956839404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1092448256,"data_stored":1091755556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":738361344,"data_stored":737905872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":840085504,"data_stored":839573552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":826810368,"data_stored":826345560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":485445632,"data_stored":485207420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T20:51:37.986 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.987 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.987 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.987 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.987 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.987 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.987 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.987 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.987 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.988 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.988 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.988 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.988 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-15T20:47:11.438181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=11, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.988 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.988 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-15T20:47:11.438181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=11, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.988 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.988 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-15T20:47:11.438181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=11, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.988 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.989 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-15T20:47:11.438181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=11, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.989 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.989 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-15T20:47:11.438181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=11, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.989 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.989 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-15T20:47:11.438181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=11, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.989 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.989 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-15T20:47:11.438181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=11, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.989 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.989 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-15T20:47:11.438181+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=11, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.990 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.990 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.990 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.990 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.990 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.990 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.990 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.990 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.990 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.991 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.991 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-15T20:47:20.532929+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=47, tm_sec=20, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=20, tm_min=51, tm_sec=32, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T20:51:37.991 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T20:51:57.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T20:51:58.127 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81bba43640 1 Processor -- start 2024-09-15T20:51:58.128 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81bba43640 1 -- start start 2024-09-15T20:51:58.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81bba43640 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f81b4076390 0x7f81b4140d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:58.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81bba43640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81b40ab6e0 0x7f81b41412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:58.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81bba43640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b4076770 con 0x7f81b4145030 2024-09-15T20:51:58.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81bba43640 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 -- 0x7f81b40ac7a0 con 0x7f81b4076390 2024-09-15T20:51:58.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81bba43640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f81b40ab440 con 0x7f81b40ab6e0 2024-09-15T20:51:58.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81b9fe0640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f81b4145030 0x7f81b4145480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54824/0 (socket says 172.21.15.52:54824) 2024-09-15T20:51:58.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81b9fe0640 1 -- 172.21.15.52:0/349401988 learned_addr learned my addr 172.21.15.52:0/349401988 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:58.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81b97df640 1 --2- 172.21.15.52:0/349401988 >> v2:172.21.15.52:3300/0 conn(0x7f81b4076390 0x7f81b4140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:58.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81b8fde640 1 --2- 172.21.15.52:0/349401988 >> v2:172.21.15.81:3300/0 conn(0x7f81b40ab6e0 0x7f81b41412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:58.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81abfff640 1 -- 172.21.15.52:0/349401988 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707360277 0 0) 0x7f81ac001120 con 0x7f81b4145030 2024-09-15T20:51:58.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81abfff640 1 -- 172.21.15.52:0/349401988 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81a0003530 con 0x7f81b4145030 2024-09-15T20:51:58.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81b97df640 1 -- 172.21.15.52:0/349401988 >> v2:172.21.15.81:3300/0 conn(0x7f81b40ab6e0 msgr2=0x7f81b41412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T20:51:58.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81b97df640 1 --2- 172.21.15.52:0/349401988 >> v2:172.21.15.81:3300/0 conn(0x7f81b40ab6e0 0x7f81b41412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81b97df640 1 -- 172.21.15.52:0/349401988 >> v1:172.21.15.52:6789/0 conn(0x7f81b4145030 legacy=0x7f81b4145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.130 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.124+0000 7f81b97df640 1 -- 172.21.15.52:0/349401988 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b4141810 con 0x7f81b4076390 2024-09-15T20:51:58.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81b97df640 1 --2- 172.21.15.52:0/349401988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81b4076390 0x7f81b4140d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f81b40b2330 tx=0x7f81b001c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b79161f8753337f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:58.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81abfff640 1 -- 172.21.15.52:0/349401988 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b00b2070 con 0x7f81b4076390 2024-09-15T20:51:58.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81abfff640 1 -- 172.21.15.52:0/349401988 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b00a58a0 con 0x7f81b4076390 2024-09-15T20:51:58.133 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81abfff640 1 -- 172.21.15.52:0/349401988 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b00a5c50 con 0x7f81b4076390 2024-09-15T20:51:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81bba43640 1 -- 172.21.15.52:0/349401988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81b4076390 msgr2=0x7f81b4140d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81bba43640 1 --2- 172.21.15.52:0/349401988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81b4076390 0x7f81b4140d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f81b40b2330 tx=0x7f81b001c7c0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81bba43640 1 -- 172.21.15.52:0/349401988 shutdown_connections 2024-09-15T20:51:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81bba43640 1 --2- 172.21.15.52:0/349401988 >> v2:172.21.15.81:3300/0 conn(0x7f81b40ab6e0 0x7f81b41412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81bba43640 1 --2- 172.21.15.52:0/349401988 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81b4076390 0x7f81b4140d90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81bba43640 1 -- 172.21.15.52:0/349401988 >> 172.21.15.52:0/349401988 conn(0x7f81b40b6300 msgr2=0x7f81b40b6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81bba43640 1 -- 172.21.15.52:0/349401988 shutdown_connections 2024-09-15T20:51:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81bba43640 1 -- 172.21.15.52:0/349401988 wait complete. 2024-09-15T20:51:58.135 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.128+0000 7f81bba43640 1 Processor -- start 2024-09-15T20:51:58.136 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81bba43640 1 -- start start 2024-09-15T20:51:58.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81bba43640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81b4076390 0x7f81b413d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:58.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81bba43640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b40ab6e0 0x7f81b414a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:58.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81bba43640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81b4145030 0x7f81b4147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:58.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81bba43640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f81b414ebe0 con 0x7f81b4076390 2024-09-15T20:51:58.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81bba43640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f81b40aac90 con 0x7f81b40ab6e0 2024-09-15T20:51:58.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81bba43640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f81b414ed60 con 0x7f81b4145030 2024-09-15T20:51:58.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81b97df640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81b4076390 0x7f81b413d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:58.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81b97df640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81b4076390 0x7f81b413d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52762/0 (socket says 172.21.15.52:52762) 2024-09-15T20:51:58.138 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81b97df640 1 -- 172.21.15.52:0/1922977004 learned_addr learned my addr 172.21.15.52:0/1922977004 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:58.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81b9fe0640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81b4145030 0x7f81b4147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:58.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81b8fde640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b40ab6e0 0x7f81b414a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:58.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81b97df640 1 -- 172.21.15.52:0/1922977004 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81b4145030 msgr2=0x7f81b4147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81b97df640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81b4145030 0x7f81b4147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81b97df640 1 -- 172.21.15.52:0/1922977004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b40ab6e0 msgr2=0x7f81b414a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81b97df640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b40ab6e0 0x7f81b414a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81b97df640 1 -- 172.21.15.52:0/1922977004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b4147ed0 con 0x7f81b4076390 2024-09-15T20:51:58.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81b8fde640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b40ab6e0 0x7f81b414a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:51:58.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81b97df640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81b4076390 0x7f81b413d5c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f81b00b0040 tx=0x7f81b0019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:58.139 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81a9ffb640 1 -- 172.21.15.52:0/1922977004 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b00bd070 con 0x7f81b4076390 2024-09-15T20:51:58.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81a9ffb640 1 -- 172.21.15.52:0/1922977004 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b00b3040 con 0x7f81b4076390 2024-09-15T20:51:58.140 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81bba43640 1 -- 172.21.15.52:0/1922977004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b4148140 con 0x7f81b4076390 2024-09-15T20:51:58.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81a9ffb640 1 -- 172.21.15.52:0/1922977004 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b00b2050 con 0x7f81b4076390 2024-09-15T20:51:58.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81bba43640 1 -- 172.21.15.52:0/1922977004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b4148680 con 0x7f81b4076390 2024-09-15T20:51:58.141 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81bba43640 1 -- 172.21.15.52:0/1922977004 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b4145480 con 0x7f81b4076390 2024-09-15T20:51:58.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.132+0000 7f81a9ffb640 1 -- 172.21.15.52:0/1922977004 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f81b0003ba0 con 0x7f81b4076390 2024-09-15T20:51:58.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.136+0000 7f81a9ffb640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f8198072ec0 0x7f8198075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:58.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.136+0000 7f81a9ffb640 1 -- 172.21.15.52:0/1922977004 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f81b012e230 con 0x7f81b4076390 2024-09-15T20:51:58.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.136+0000 7f81b8fde640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f8198072ec0 0x7f8198075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:58.142 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.136+0000 7f81b8fde640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f8198072ec0 0x7f8198075380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f81b413dc10 tx=0x7f81a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:58.143 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.136+0000 7f81a9ffb640 1 -- 172.21.15.52:0/1922977004 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f81b00c6020 con 0x7f81b4076390 2024-09-15T20:51:58.313 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.308+0000 7f81bba43640 1 -- 172.21.15.52:0/1922977004 --> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81b4142960 con 0x7f8198072ec0 2024-09-15T20:51:58.319 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.312+0000 7f81a9ffb640 1 -- 172.21.15.52:0/1922977004 <== mgr.4105 v2:172.21.15.81:6832/3693261179 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117747 (secure 0 0 0) 0x7f81b4142960 con 0x7f8198072ec0 2024-09-15T20:51:58.320 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-15T20:51:58.321 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-09-15T20:51:58.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.316+0000 7f81bba43640 1 -- 172.21.15.52:0/1922977004 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f8198072ec0 msgr2=0x7f8198075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.322 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.316+0000 7f81bba43640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f8198072ec0 0x7f8198075380 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f81b413dc10 tx=0x7f81a4008040 comp rx=0 tx=0).stop 2024-09-15T20:51:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.316+0000 7f81bba43640 1 -- 172.21.15.52:0/1922977004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81b4076390 msgr2=0x7f81b413d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.316+0000 7f81bba43640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81b4076390 0x7f81b413d5c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f81b00b0040 tx=0x7f81b0019560 comp rx=0 tx=0).stop 2024-09-15T20:51:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.316+0000 7f81bba43640 1 -- 172.21.15.52:0/1922977004 shutdown_connections 2024-09-15T20:51:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.316+0000 7f81bba43640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f8198072ec0 0x7f8198075380 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.316+0000 7f81bba43640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f81b4145030 0x7f81b4147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.316+0000 7f81bba43640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b40ab6e0 0x7f81b414a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.316+0000 7f81bba43640 1 --2- 172.21.15.52:0/1922977004 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81b4076390 0x7f81b413d5c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.316+0000 7f81bba43640 1 -- 172.21.15.52:0/1922977004 >> 172.21.15.52:0/1922977004 conn(0x7f81b40b6300 msgr2=0x7f81b40b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.316+0000 7f81bba43640 1 -- 172.21.15.52:0/1922977004 shutdown_connections 2024-09-15T20:51:58.323 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.316+0000 7f81bba43640 1 -- 172.21.15.52:0/1922977004 wait complete. 2024-09-15T20:51:58.339 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-09-15T20:51:57.301124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3574125355,"num_objects":883,"num_object_clones":0,"num_object_copies":1766,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":883,"num_whiteouts":0,"num_read":2629,"num_read_kb":2634,"num_write":159748,"num_write_kb":5637879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162448,"ondisk_log_size":162448,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8554352,"kb_used_data":6692144,"kb_used_omap":12,"kb_used_meta":1862067,"kb_avail":746420368,"statfs":{"total":773094113280,"available":764334456832,"internally_reserved":0,"allocated":6852755456,"data_stored":6847057438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1906757168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003840"},"pg_stats":[{"pgid":"3.1f","version":"27'2794","reported_seq":2827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:42.426303+0000","last_change":"2024-09-15T20:51:42.426303+0000","last_active":"2024-09-15T20:51:42.426303+0000","last_peered":"2024-09-15T20:51:42.426303+0000","last_clean":"2024-09-15T20:51:42.426303+0000","last_became_active":"2024-09-15T20:47:21.011783+0000","last_became_peered":"2024-09-15T20:47:21.011783+0000","last_unstale":"2024-09-15T20:51:42.426303+0000","last_undegraded":"2024-09-15T20:51:42.426303+0000","last_fullsized":"2024-09-15T20:51:42.426303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2794","last_scrub_stamp":"2024-09-15T20:51:42.426134+0000","last_deep_scrub":"27'2794","last_deep_scrub_stamp":"2024-09-15T20:51:42.426134+0000","last_clean_scrub_stamp":"2024-09-15T20:51:42.426134+0000","objects_scrubbed":16,"log_size":2794,"log_dups_size":0,"ondisk_log_size":2794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:05.210792+0000","scrub_duration":207,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63045632,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":2788,"num_write_kb":119877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5202","reported_seq":5230,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:41.610138+0000","last_change":"2024-09-15T20:51:41.610138+0000","last_active":"2024-09-15T20:51:41.610138+0000","last_peered":"2024-09-15T20:51:41.610138+0000","last_clean":"2024-09-15T20:51:41.610138+0000","last_became_active":"2024-09-15T20:47:21.012740+0000","last_became_peered":"2024-09-15T20:47:21.012740+0000","last_unstale":"2024-09-15T20:51:41.610138+0000","last_undegraded":"2024-09-15T20:51:41.610138+0000","last_fullsized":"2024-09-15T20:51:41.610138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5202","last_scrub_stamp":"2024-09-15T20:51:41.609946+0000","last_deep_scrub":"27'5202","last_deep_scrub_stamp":"2024-09-15T20:51:41.609946+0000","last_clean_scrub_stamp":"2024-09-15T20:51:41.609946+0000","objects_scrubbed":25,"log_size":5202,"log_dups_size":0,"ondisk_log_size":5202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:21.240810+0000","scrub_duration":375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102105088,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5153,"num_write_kb":141699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"27'6034","reported_seq":6061,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:46.277184+0000","last_change":"2024-09-15T20:51:46.277184+0000","last_active":"2024-09-15T20:51:46.277184+0000","last_peered":"2024-09-15T20:51:46.277184+0000","last_clean":"2024-09-15T20:51:46.277184+0000","last_became_active":"2024-09-15T20:47:21.008254+0000","last_became_peered":"2024-09-15T20:47:21.008254+0000","last_unstale":"2024-09-15T20:51:46.277184+0000","last_undegraded":"2024-09-15T20:51:46.277184+0000","last_fullsized":"2024-09-15T20:51:46.277184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6034","last_scrub_stamp":"2024-09-15T20:51:46.277029+0000","last_deep_scrub":"27'6034","last_deep_scrub_stamp":"2024-09-15T20:51:46.277029+0000","last_clean_scrub_stamp":"2024-09-15T20:51:46.277029+0000","objects_scrubbed":21,"log_size":6034,"log_dups_size":0,"ondisk_log_size":6034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:31:59.382143+0000","scrub_duration":271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5984,"num_write_kb":200879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"27'3583","reported_seq":3616,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:37.046446+0000","last_change":"2024-09-15T20:51:37.046446+0000","last_active":"2024-09-15T20:51:37.046446+0000","last_peered":"2024-09-15T20:51:37.046446+0000","last_clean":"2024-09-15T20:51:37.046446+0000","last_became_active":"2024-09-15T20:47:21.006831+0000","last_became_peered":"2024-09-15T20:47:21.006831+0000","last_unstale":"2024-09-15T20:51:37.046446+0000","last_undegraded":"2024-09-15T20:51:37.046446+0000","last_fullsized":"2024-09-15T20:51:37.046446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3583","last_scrub_stamp":"2024-09-15T20:51:37.046385+0000","last_deep_scrub":"27'3583","last_deep_scrub_stamp":"2024-09-15T20:51:37.046385+0000","last_clean_scrub_stamp":"2024-09-15T20:51:37.046385+0000","objects_scrubbed":31,"log_size":3583,"log_dups_size":0,"ondisk_log_size":3583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:00.100144+0000","scrub_duration":251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3557,"num_write_kb":160908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"27'2792","reported_seq":2823,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:42.917663+0000","last_change":"2024-09-15T20:51:42.917663+0000","last_active":"2024-09-15T20:51:42.917663+0000","last_peered":"2024-09-15T20:51:42.917663+0000","last_clean":"2024-09-15T20:51:42.917663+0000","last_became_active":"2024-09-15T20:47:21.009995+0000","last_became_peered":"2024-09-15T20:47:21.009995+0000","last_unstale":"2024-09-15T20:51:42.917663+0000","last_undegraded":"2024-09-15T20:51:42.917663+0000","last_fullsized":"2024-09-15T20:51:42.917663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2792","last_scrub_stamp":"2024-09-15T20:51:42.917449+0000","last_deep_scrub":"27'2792","last_deep_scrub_stamp":"2024-09-15T20:51:42.917449+0000","last_clean_scrub_stamp":"2024-09-15T20:51:42.917449+0000","objects_scrubbed":20,"log_size":2792,"log_dups_size":0,"ondisk_log_size":2792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:15.851455+0000","scrub_duration":283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79700496,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":15,"num_read_kb":11,"num_write":2741,"num_write_kb":123666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7961","reported_seq":8004,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:36.405097+0000","last_change":"2024-09-15T20:51:36.405097+0000","last_active":"2024-09-15T20:51:36.405097+0000","last_peered":"2024-09-15T20:51:36.405097+0000","last_clean":"2024-09-15T20:51:36.405097+0000","last_became_active":"2024-09-15T20:47:21.023610+0000","last_became_peered":"2024-09-15T20:47:21.023610+0000","last_unstale":"2024-09-15T20:51:36.405097+0000","last_undegraded":"2024-09-15T20:51:36.405097+0000","last_fullsized":"2024-09-15T20:51:36.405097+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7961","last_scrub_stamp":"2024-09-15T20:51:36.404980+0000","last_deep_scrub":"27'7961","last_deep_scrub_stamp":"2024-09-15T20:51:36.404980+0000","last_clean_scrub_stamp":"2024-09-15T20:51:36.404980+0000","objects_scrubbed":35,"log_size":7961,"log_dups_size":0,"ondisk_log_size":7961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:57.051418+0000","scrub_duration":587,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146120704,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":56,"num_read_kb":171,"num_write":7933,"num_write_kb":198258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"27'5293","reported_seq":5331,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:41.013590+0000","last_change":"2024-09-15T20:51:41.013590+0000","last_active":"2024-09-15T20:51:41.013590+0000","last_peered":"2024-09-15T20:51:41.013590+0000","last_clean":"2024-09-15T20:51:41.013590+0000","last_became_active":"2024-09-15T20:47:21.005632+0000","last_became_peered":"2024-09-15T20:47:21.005632+0000","last_unstale":"2024-09-15T20:51:41.013590+0000","last_undegraded":"2024-09-15T20:51:41.013590+0000","last_fullsized":"2024-09-15T20:51:41.013590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5293","last_scrub_stamp":"2024-09-15T20:51:41.013311+0000","last_deep_scrub":"27'5293","last_deep_scrub_stamp":"2024-09-15T20:51:41.013311+0000","last_clean_scrub_stamp":"2024-09-15T20:51:41.013311+0000","objects_scrubbed":23,"log_size":5293,"log_dups_size":0,"ondisk_log_size":5293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:34.698350+0000","scrub_duration":363,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":42,"num_read_kb":34,"num_write":5236,"num_write_kb":197894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"27'6392","reported_seq":6422,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:40.704154+0000","last_change":"2024-09-15T20:51:40.704154+0000","last_active":"2024-09-15T20:51:40.704154+0000","last_peered":"2024-09-15T20:51:40.704154+0000","last_clean":"2024-09-15T20:51:40.704154+0000","last_became_active":"2024-09-15T20:47:21.016879+0000","last_became_peered":"2024-09-15T20:47:21.016879+0000","last_unstale":"2024-09-15T20:51:40.704154+0000","last_undegraded":"2024-09-15T20:51:40.704154+0000","last_fullsized":"2024-09-15T20:51:40.704154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6392","last_scrub_stamp":"2024-09-15T20:51:40.703928+0000","last_deep_scrub":"27'6392","last_deep_scrub_stamp":"2024-09-15T20:51:40.703928+0000","last_clean_scrub_stamp":"2024-09-15T20:51:40.703928+0000","objects_scrubbed":28,"log_size":6392,"log_dups_size":0,"ondisk_log_size":6392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:25.051841+0000","scrub_duration":459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":6371,"num_write_kb":181001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"27'6442","reported_seq":6470,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:39.669551+0000","last_change":"2024-09-15T20:51:39.669551+0000","last_active":"2024-09-15T20:51:39.669551+0000","last_peered":"2024-09-15T20:51:39.669551+0000","last_clean":"2024-09-15T20:51:39.669551+0000","last_became_active":"2024-09-15T20:47:21.016813+0000","last_became_peered":"2024-09-15T20:47:21.016813+0000","last_unstale":"2024-09-15T20:51:39.669551+0000","last_undegraded":"2024-09-15T20:51:39.669551+0000","last_fullsized":"2024-09-15T20:51:39.669551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6442","last_scrub_stamp":"2024-09-15T20:51:39.669418+0000","last_deep_scrub":"27'6442","last_deep_scrub_stamp":"2024-09-15T20:51:39.669418+0000","last_clean_scrub_stamp":"2024-09-15T20:51:39.669418+0000","objects_scrubbed":27,"log_size":6442,"log_dups_size":0,"ondisk_log_size":6442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:37.045607+0000","scrub_duration":423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6412,"num_write_kb":184897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"27'3779","reported_seq":3806,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:37.978741+0000","last_change":"2024-09-15T20:51:37.978741+0000","last_active":"2024-09-15T20:51:37.978741+0000","last_peered":"2024-09-15T20:51:37.978741+0000","last_clean":"2024-09-15T20:51:37.978741+0000","last_became_active":"2024-09-15T20:47:21.010350+0000","last_became_peered":"2024-09-15T20:47:21.010350+0000","last_unstale":"2024-09-15T20:51:37.978741+0000","last_undegraded":"2024-09-15T20:51:37.978741+0000","last_fullsized":"2024-09-15T20:51:37.978741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3779","last_scrub_stamp":"2024-09-15T20:51:37.978523+0000","last_deep_scrub":"27'3779","last_deep_scrub_stamp":"2024-09-15T20:51:37.978523+0000","last_clean_scrub_stamp":"2024-09-15T20:51:37.978523+0000","objects_scrubbed":27,"log_size":3779,"log_dups_size":0,"ondisk_log_size":3779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:05.231199+0000","scrub_duration":203,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3727,"num_write_kb":156934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"27'5813","reported_seq":5846,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:37.750410+0000","last_change":"2024-09-15T20:51:37.750410+0000","last_active":"2024-09-15T20:51:37.750410+0000","last_peered":"2024-09-15T20:51:37.750410+0000","last_clean":"2024-09-15T20:51:37.750410+0000","last_became_active":"2024-09-15T20:47:21.016999+0000","last_became_peered":"2024-09-15T20:47:21.016999+0000","last_unstale":"2024-09-15T20:51:37.750410+0000","last_undegraded":"2024-09-15T20:51:37.750410+0000","last_fullsized":"2024-09-15T20:51:37.750410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5813","last_scrub_stamp":"2024-09-15T20:51:37.750306+0000","last_deep_scrub":"27'5813","last_deep_scrub_stamp":"2024-09-15T20:51:37.750306+0000","last_clean_scrub_stamp":"2024-09-15T20:51:37.750306+0000","objects_scrubbed":29,"log_size":5813,"log_dups_size":0,"ondisk_log_size":5813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:09.719079+0000","scrub_duration":427,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":23,"num_read_kb":80,"num_write":5791,"num_write_kb":176448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"27'6406","reported_seq":6446,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:47.457778+0000","last_change":"2024-09-15T20:51:47.457778+0000","last_active":"2024-09-15T20:51:47.457778+0000","last_peered":"2024-09-15T20:51:47.457778+0000","last_clean":"2024-09-15T20:51:47.457778+0000","last_became_active":"2024-09-15T20:47:21.010694+0000","last_became_peered":"2024-09-15T20:47:21.010694+0000","last_unstale":"2024-09-15T20:51:47.457778+0000","last_undegraded":"2024-09-15T20:51:47.457778+0000","last_fullsized":"2024-09-15T20:51:47.457778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6406","last_scrub_stamp":"2024-09-15T20:51:47.457595+0000","last_deep_scrub":"27'6406","last_deep_scrub_stamp":"2024-09-15T20:51:47.457595+0000","last_clean_scrub_stamp":"2024-09-15T20:51:47.457595+0000","objects_scrubbed":31,"log_size":6406,"log_dups_size":0,"ondisk_log_size":6406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:22:40.301688+0000","scrub_duration":399,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125960192,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":6347,"num_write_kb":171391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:40.044551+0000","last_change":"2024-09-15T20:51:40.044551+0000","last_active":"2024-09-15T20:51:40.044551+0000","last_peered":"2024-09-15T20:51:40.044551+0000","last_clean":"2024-09-15T20:51:40.044551+0000","last_became_active":"2024-09-15T20:47:12.471373+0000","last_became_peered":"2024-09-15T20:47:12.471373+0000","last_unstale":"2024-09-15T20:51:40.044551+0000","last_undegraded":"2024-09-15T20:51:40.044551+0000","last_fullsized":"2024-09-15T20:51:40.044551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:51:40.044383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:51:40.044383+0000","last_clean_scrub_stamp":"2024-09-15T20:51:40.044383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:12.907369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0018866289999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'6644","reported_seq":6675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:38.168350+0000","last_change":"2024-09-15T20:51:38.168257+0000","last_active":"2024-09-15T20:51:38.168350+0000","last_peered":"2024-09-15T20:51:38.168350+0000","last_clean":"2024-09-15T20:51:38.168350+0000","last_became_active":"2024-09-15T20:47:21.019020+0000","last_became_peered":"2024-09-15T20:47:21.019020+0000","last_unstale":"2024-09-15T20:51:38.168350+0000","last_undegraded":"2024-09-15T20:51:38.168350+0000","last_fullsized":"2024-09-15T20:51:38.168350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6644","last_scrub_stamp":"2024-09-15T20:51:38.168137+0000","last_deep_scrub":"27'6644","last_deep_scrub_stamp":"2024-09-15T20:51:38.168137+0000","last_clean_scrub_stamp":"2024-09-15T20:51:38.168137+0000","objects_scrubbed":34,"log_size":6644,"log_dups_size":0,"ondisk_log_size":6644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:53.119013+0000","scrub_duration":491,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137986560,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":6595,"num_write_kb":207131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:41.612868+0000","last_change":"2024-09-15T20:51:41.612868+0000","last_active":"2024-09-15T20:51:41.612868+0000","last_peered":"2024-09-15T20:51:41.612868+0000","last_clean":"2024-09-15T20:51:41.612868+0000","last_became_active":"2024-09-15T20:47:12.468530+0000","last_became_peered":"2024-09-15T20:47:12.468530+0000","last_unstale":"2024-09-15T20:51:41.612868+0000","last_undegraded":"2024-09-15T20:51:41.612868+0000","last_fullsized":"2024-09-15T20:51:41.612868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:51:41.612700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:51:41.612700+0000","last_clean_scrub_stamp":"2024-09-15T20:51:41.612700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:12.221457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000891339,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'4925","reported_seq":4965,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:39.094423+0000","last_change":"2024-09-15T20:51:39.094321+0000","last_active":"2024-09-15T20:51:39.094423+0000","last_peered":"2024-09-15T20:51:39.094423+0000","last_clean":"2024-09-15T20:51:39.094423+0000","last_became_active":"2024-09-15T20:47:21.021031+0000","last_became_peered":"2024-09-15T20:47:21.021031+0000","last_unstale":"2024-09-15T20:51:39.094423+0000","last_undegraded":"2024-09-15T20:51:39.094423+0000","last_fullsized":"2024-09-15T20:51:39.094423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4925","last_scrub_stamp":"2024-09-15T20:51:39.094168+0000","last_deep_scrub":"27'4925","last_deep_scrub_stamp":"2024-09-15T20:51:39.094168+0000","last_clean_scrub_stamp":"2024-09-15T20:51:39.094168+0000","objects_scrubbed":32,"log_size":4925,"log_dups_size":0,"ondisk_log_size":4925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:09.924710+0000","scrub_duration":439,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134217728,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":4866,"num_write_kb":218628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:39.078033+0000","last_change":"2024-09-15T20:51:39.078033+0000","last_active":"2024-09-15T20:51:39.078033+0000","last_peered":"2024-09-15T20:51:39.078033+0000","last_clean":"2024-09-15T20:51:39.078033+0000","last_became_active":"2024-09-15T20:47:12.461531+0000","last_became_peered":"2024-09-15T20:47:12.461531+0000","last_unstale":"2024-09-15T20:51:39.078033+0000","last_undegraded":"2024-09-15T20:51:39.078033+0000","last_fullsized":"2024-09-15T20:51:39.078033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:51:39.077867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:51:39.077867+0000","last_clean_scrub_stamp":"2024-09-15T20:51:39.077867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:59:25.671712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022230399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"27'8378","reported_seq":8451,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:37.981787+0000","last_change":"2024-09-15T20:51:37.981787+0000","last_active":"2024-09-15T20:51:37.981787+0000","last_peered":"2024-09-15T20:51:37.981787+0000","last_clean":"2024-09-15T20:51:37.981787+0000","last_became_active":"2024-09-15T20:47:21.025918+0000","last_became_peered":"2024-09-15T20:47:21.025918+0000","last_unstale":"2024-09-15T20:51:37.981787+0000","last_undegraded":"2024-09-15T20:51:37.981787+0000","last_fullsized":"2024-09-15T20:51:37.981787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8378","last_scrub_stamp":"2024-09-15T20:51:37.981670+0000","last_deep_scrub":"27'8378","last_deep_scrub_stamp":"2024-09-15T20:51:37.981670+0000","last_clean_scrub_stamp":"2024-09-15T20:51:37.981670+0000","objects_scrubbed":37,"log_size":8378,"log_dups_size":0,"ondisk_log_size":8378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:55.914804+0000","scrub_duration":539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135988904,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":174,"num_read_kb":136,"num_write":8413,"num_write_kb":232061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:37.249588+0000","last_change":"2024-09-15T20:51:37.249588+0000","last_active":"2024-09-15T20:51:37.249588+0000","last_peered":"2024-09-15T20:51:37.249588+0000","last_clean":"2024-09-15T20:51:37.249588+0000","last_became_active":"2024-09-15T20:47:12.468184+0000","last_became_peered":"2024-09-15T20:47:12.468184+0000","last_unstale":"2024-09-15T20:51:37.249588+0000","last_undegraded":"2024-09-15T20:51:37.249588+0000","last_fullsized":"2024-09-15T20:51:37.249588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:51:37.249435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:51:37.249435+0000","last_clean_scrub_stamp":"2024-09-15T20:51:37.249435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T20:59:29.573347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001176739,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"27'4317","reported_seq":4356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:36.030505+0000","last_change":"2024-09-15T20:51:36.030505+0000","last_active":"2024-09-15T20:51:36.030505+0000","last_peered":"2024-09-15T20:51:36.030505+0000","last_clean":"2024-09-15T20:51:36.030505+0000","last_became_active":"2024-09-15T20:47:21.017736+0000","last_became_peered":"2024-09-15T20:47:21.017736+0000","last_unstale":"2024-09-15T20:51:36.030505+0000","last_undegraded":"2024-09-15T20:51:36.030505+0000","last_fullsized":"2024-09-15T20:51:36.030505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4317","last_scrub_stamp":"2024-09-15T20:51:36.030401+0000","last_deep_scrub":"27'4317","last_deep_scrub_stamp":"2024-09-15T20:51:36.030401+0000","last_clean_scrub_stamp":"2024-09-15T20:51:36.030401+0000","objects_scrubbed":21,"log_size":4317,"log_dups_size":0,"ondisk_log_size":4317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:39:38.372894+0000","scrub_duration":303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78276432,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":24,"num_read_kb":82,"num_write":4316,"num_write_kb":145640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"27'5363","reported_seq":5392,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:34.459912+0000","last_change":"2024-09-15T20:51:34.459862+0000","last_active":"2024-09-15T20:51:34.459912+0000","last_peered":"2024-09-15T20:51:34.459912+0000","last_clean":"2024-09-15T20:51:34.459912+0000","last_became_active":"2024-09-15T20:47:21.008994+0000","last_became_peered":"2024-09-15T20:47:21.008994+0000","last_unstale":"2024-09-15T20:51:34.459912+0000","last_undegraded":"2024-09-15T20:51:34.459912+0000","last_fullsized":"2024-09-15T20:51:34.459912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5363","last_scrub_stamp":"2024-09-15T20:51:34.459792+0000","last_deep_scrub":"27'5363","last_deep_scrub_stamp":"2024-09-15T20:51:34.459792+0000","last_clean_scrub_stamp":"2024-09-15T20:51:34.459792+0000","objects_scrubbed":33,"log_size":5363,"log_dups_size":0,"ondisk_log_size":5363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:42:48.699333+0000","scrub_duration":223,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5329,"num_write_kb":197895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'3","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:37.138720+0000","last_change":"2024-09-15T20:51:37.138720+0000","last_active":"2024-09-15T20:51:37.138720+0000","last_peered":"2024-09-15T20:51:37.138720+0000","last_clean":"2024-09-15T20:51:37.138720+0000","last_became_active":"2024-09-15T20:47:12.471091+0000","last_became_peered":"2024-09-15T20:47:12.471091+0000","last_unstale":"2024-09-15T20:51:37.138720+0000","last_undegraded":"2024-09-15T20:51:37.138720+0000","last_fullsized":"2024-09-15T20:51:37.138720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-09-15T20:51:37.138662+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-09-15T20:51:37.138662+0000","last_clean_scrub_stamp":"2024-09-15T20:51:37.138662+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:27.503641+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0014530579999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"27'3435","reported_seq":3573,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:38.532791+0000","last_change":"2024-09-15T20:51:38.532791+0000","last_active":"2024-09-15T20:51:38.532791+0000","last_peered":"2024-09-15T20:51:38.532791+0000","last_clean":"2024-09-15T20:51:38.532791+0000","last_became_active":"2024-09-15T20:47:21.023619+0000","last_became_peered":"2024-09-15T20:47:21.023619+0000","last_unstale":"2024-09-15T20:51:38.532791+0000","last_undegraded":"2024-09-15T20:51:38.532791+0000","last_fullsized":"2024-09-15T20:51:38.532791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3435","last_scrub_stamp":"2024-09-15T20:51:38.532555+0000","last_deep_scrub":"27'3435","last_deep_scrub_stamp":"2024-09-15T20:51:38.532555+0000","last_clean_scrub_stamp":"2024-09-15T20:51:38.532555+0000","objects_scrubbed":18,"log_size":3435,"log_dups_size":0,"ondisk_log_size":3435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:31.519452+0000","scrub_duration":259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371536,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":138,"num_read_kb":254,"num_write":3502,"num_write_kb":132957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:39.579749+0000","last_change":"2024-09-15T20:51:39.579749+0000","last_active":"2024-09-15T20:51:39.579749+0000","last_peered":"2024-09-15T20:51:39.579749+0000","last_clean":"2024-09-15T20:51:39.579749+0000","last_became_active":"2024-09-15T20:47:12.462360+0000","last_became_peered":"2024-09-15T20:47:12.462360+0000","last_unstale":"2024-09-15T20:51:39.579749+0000","last_undegraded":"2024-09-15T20:51:39.579749+0000","last_fullsized":"2024-09-15T20:51:39.579749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:51:39.579586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:51:39.579586+0000","last_clean_scrub_stamp":"2024-09-15T20:51:39.579586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:26:19.660930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011324970000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"27'3780","reported_seq":3808,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:38.753588+0000","last_change":"2024-09-15T20:51:38.753588+0000","last_active":"2024-09-15T20:51:38.753588+0000","last_peered":"2024-09-15T20:51:38.753588+0000","last_clean":"2024-09-15T20:51:38.753588+0000","last_became_active":"2024-09-15T20:47:21.017058+0000","last_became_peered":"2024-09-15T20:47:21.017058+0000","last_unstale":"2024-09-15T20:51:38.753588+0000","last_undegraded":"2024-09-15T20:51:38.753588+0000","last_fullsized":"2024-09-15T20:51:38.753588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3780","last_scrub_stamp":"2024-09-15T20:51:38.753455+0000","last_deep_scrub":"27'3780","last_deep_scrub_stamp":"2024-09-15T20:51:38.753455+0000","last_clean_scrub_stamp":"2024-09-15T20:51:38.753455+0000","objects_scrubbed":24,"log_size":3780,"log_dups_size":0,"ondisk_log_size":3780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:25.209212+0000","scrub_duration":343,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3728,"num_write_kb":173059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:36.165725+0000","last_change":"2024-09-15T20:51:36.165725+0000","last_active":"2024-09-15T20:51:36.165725+0000","last_peered":"2024-09-15T20:51:36.165725+0000","last_clean":"2024-09-15T20:51:36.165725+0000","last_became_active":"2024-09-15T20:47:12.463812+0000","last_became_peered":"2024-09-15T20:47:12.463812+0000","last_unstale":"2024-09-15T20:51:36.165725+0000","last_undegraded":"2024-09-15T20:51:36.165725+0000","last_fullsized":"2024-09-15T20:51:36.165725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T20:51:36.165618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T20:51:36.165618+0000","last_clean_scrub_stamp":"2024-09-15T20:51:36.165618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:57.909874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001226357,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'4136","reported_seq":4164,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:37.000222+0000","last_change":"2024-09-15T20:51:37.000222+0000","last_active":"2024-09-15T20:51:37.000222+0000","last_peered":"2024-09-15T20:51:37.000222+0000","last_clean":"2024-09-15T20:51:37.000222+0000","last_became_active":"2024-09-15T20:47:21.005584+0000","last_became_peered":"2024-09-15T20:47:21.005584+0000","last_unstale":"2024-09-15T20:51:37.000222+0000","last_undegraded":"2024-09-15T20:51:37.000222+0000","last_fullsized":"2024-09-15T20:51:37.000222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4136","last_scrub_stamp":"2024-09-15T20:51:37.000047+0000","last_deep_scrub":"27'4136","last_deep_scrub_stamp":"2024-09-15T20:51:37.000047+0000","last_clean_scrub_stamp":"2024-09-15T20:51:37.000047+0000","objects_scrubbed":22,"log_size":4136,"log_dups_size":0,"ondisk_log_size":4136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:13.452183+0000","scrub_duration":287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4109,"num_write_kb":152323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:38.110216+0000","last_change":"2024-09-15T20:51:38.110216+0000","last_active":"2024-09-15T20:51:38.110216+0000","last_peered":"2024-09-15T20:51:38.110216+0000","last_clean":"2024-09-15T20:51:38.110216+0000","last_became_active":"2024-09-15T20:47:12.469021+0000","last_became_peered":"2024-09-15T20:47:12.469021+0000","last_unstale":"2024-09-15T20:51:38.110216+0000","last_undegraded":"2024-09-15T20:51:38.110216+0000","last_fullsized":"2024-09-15T20:51:38.110216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-09-15T20:51:38.110019+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-09-15T20:51:38.110019+0000","last_clean_scrub_stamp":"2024-09-15T20:51:38.110019+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:34.702146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0025466540000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":133,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:34.800303+0000","last_change":"2024-09-15T20:51:34.800303+0000","last_active":"2024-09-15T20:51:34.800303+0000","last_peered":"2024-09-15T20:51:34.800303+0000","last_clean":"2024-09-15T20:51:34.800303+0000","last_became_active":"2024-09-15T20:47:07.289970+0000","last_became_peered":"2024-09-15T20:47:07.289970+0000","last_unstale":"2024-09-15T20:51:34.800303+0000","last_undegraded":"2024-09-15T20:51:34.800303+0000","last_fullsized":"2024-09-15T20:51:34.800303+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-09-15T20:51:34.800239+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-09-15T20:51:34.800239+0000","last_clean_scrub_stamp":"2024-09-15T20:51:34.800239+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:39.550027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"27'3504","reported_seq":3532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:40.030794+0000","last_change":"2024-09-15T20:51:40.030640+0000","last_active":"2024-09-15T20:51:40.030794+0000","last_peered":"2024-09-15T20:51:40.030794+0000","last_clean":"2024-09-15T20:51:40.030794+0000","last_became_active":"2024-09-15T20:47:21.017326+0000","last_became_peered":"2024-09-15T20:47:21.017326+0000","last_unstale":"2024-09-15T20:51:40.030794+0000","last_undegraded":"2024-09-15T20:51:40.030794+0000","last_fullsized":"2024-09-15T20:51:40.030794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3504","last_scrub_stamp":"2024-09-15T20:51:40.030412+0000","last_deep_scrub":"27'3504","last_deep_scrub_stamp":"2024-09-15T20:51:40.030412+0000","last_clean_scrub_stamp":"2024-09-15T20:51:40.030412+0000","objects_scrubbed":26,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:43.096753+0000","scrub_duration":375,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3405,"num_write_kb":176771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"27'8103","reported_seq":8246,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:41.504943+0000","last_change":"2024-09-15T20:51:41.504806+0000","last_active":"2024-09-15T20:51:41.504943+0000","last_peered":"2024-09-15T20:51:41.504943+0000","last_clean":"2024-09-15T20:51:41.504943+0000","last_became_active":"2024-09-15T20:47:21.005684+0000","last_became_peered":"2024-09-15T20:47:21.005684+0000","last_unstale":"2024-09-15T20:51:41.504943+0000","last_undegraded":"2024-09-15T20:51:41.504943+0000","last_fullsized":"2024-09-15T20:51:41.504943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8103","last_scrub_stamp":"2024-09-15T20:51:41.504658+0000","last_deep_scrub":"27'8103","last_deep_scrub_stamp":"2024-09-15T20:51:41.504658+0000","last_clean_scrub_stamp":"2024-09-15T20:51:41.504658+0000","objects_scrubbed":26,"log_size":8103,"log_dups_size":0,"ondisk_log_size":8103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:39:00.140950+0000","scrub_duration":443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104858112,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":381,"num_read_kb":346,"num_write":6033,"num_write_kb":166034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'6170","reported_seq":6223,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:43.511687+0000","last_change":"2024-09-15T20:51:43.511539+0000","last_active":"2024-09-15T20:51:43.511687+0000","last_peered":"2024-09-15T20:51:43.511687+0000","last_clean":"2024-09-15T20:51:43.511687+0000","last_became_active":"2024-09-15T20:47:21.006304+0000","last_became_peered":"2024-09-15T20:47:21.006304+0000","last_unstale":"2024-09-15T20:51:43.511687+0000","last_undegraded":"2024-09-15T20:51:43.511687+0000","last_fullsized":"2024-09-15T20:51:43.511687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6170","last_scrub_stamp":"2024-09-15T20:51:43.511387+0000","last_deep_scrub":"27'6170","last_deep_scrub_stamp":"2024-09-15T20:51:43.511387+0000","last_clean_scrub_stamp":"2024-09-15T20:51:43.511387+0000","objects_scrubbed":35,"log_size":6170,"log_dups_size":0,"ondisk_log_size":6170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:46.348373+0000","scrub_duration":463,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138543632,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":97,"num_read_kb":78,"num_write":6159,"num_write_kb":180177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'4333","reported_seq":4362,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:38.923141+0000","last_change":"2024-09-15T20:51:38.923068+0000","last_active":"2024-09-15T20:51:38.923141+0000","last_peered":"2024-09-15T20:51:38.923141+0000","last_clean":"2024-09-15T20:51:38.923141+0000","last_became_active":"2024-09-15T20:47:21.025992+0000","last_became_peered":"2024-09-15T20:47:21.025992+0000","last_unstale":"2024-09-15T20:51:38.923141+0000","last_undegraded":"2024-09-15T20:51:38.923141+0000","last_fullsized":"2024-09-15T20:51:38.923141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4333","last_scrub_stamp":"2024-09-15T20:51:38.922940+0000","last_deep_scrub":"27'4333","last_deep_scrub_stamp":"2024-09-15T20:51:38.922940+0000","last_clean_scrub_stamp":"2024-09-15T20:51:38.922940+0000","objects_scrubbed":28,"log_size":4333,"log_dups_size":0,"ondisk_log_size":4333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:07.184657+0000","scrub_duration":387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113312264,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":4307,"num_write_kb":192020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"27'2828","reported_seq":2856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:35.495537+0000","last_change":"2024-09-15T20:51:35.495445+0000","last_active":"2024-09-15T20:51:35.495537+0000","last_peered":"2024-09-15T20:51:35.495537+0000","last_clean":"2024-09-15T20:51:35.495537+0000","last_became_active":"2024-09-15T20:47:21.019431+0000","last_became_peered":"2024-09-15T20:47:21.019431+0000","last_unstale":"2024-09-15T20:51:35.495537+0000","last_undegraded":"2024-09-15T20:51:35.495537+0000","last_fullsized":"2024-09-15T20:51:35.495537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2828","last_scrub_stamp":"2024-09-15T20:51:35.495369+0000","last_deep_scrub":"27'2828","last_deep_scrub_stamp":"2024-09-15T20:51:35.495369+0000","last_clean_scrub_stamp":"2024-09-15T20:51:35.495369+0000","objects_scrubbed":17,"log_size":2828,"log_dups_size":0,"ondisk_log_size":2828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:04.922644+0000","scrub_duration":215,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69863248,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2764,"num_write_kb":138455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"27'3237","reported_seq":3267,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:42.317721+0000","last_change":"2024-09-15T20:51:42.317630+0000","last_active":"2024-09-15T20:51:42.317721+0000","last_peered":"2024-09-15T20:51:42.317721+0000","last_clean":"2024-09-15T20:51:42.317721+0000","last_became_active":"2024-09-15T20:47:21.002454+0000","last_became_peered":"2024-09-15T20:47:21.002454+0000","last_unstale":"2024-09-15T20:51:42.317721+0000","last_undegraded":"2024-09-15T20:51:42.317721+0000","last_fullsized":"2024-09-15T20:51:42.317721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3237","last_scrub_stamp":"2024-09-15T20:51:42.317484+0000","last_deep_scrub":"27'3237","last_deep_scrub_stamp":"2024-09-15T20:51:42.317484+0000","last_clean_scrub_stamp":"2024-09-15T20:51:42.317484+0000","objects_scrubbed":28,"log_size":3237,"log_dups_size":0,"ondisk_log_size":3237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:09.807248+0000","scrub_duration":295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111936016,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":3190,"num_write_kb":137614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5691","reported_seq":6123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:37.027724+0000","last_change":"2024-09-15T20:51:37.027669+0000","last_active":"2024-09-15T20:51:37.027724+0000","last_peered":"2024-09-15T20:51:37.027724+0000","last_clean":"2024-09-15T20:51:37.027724+0000","last_became_active":"2024-09-15T20:47:21.007899+0000","last_became_peered":"2024-09-15T20:47:21.007899+0000","last_unstale":"2024-09-15T20:51:37.027724+0000","last_undegraded":"2024-09-15T20:51:37.027724+0000","last_fullsized":"2024-09-15T20:51:37.027724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5691","last_scrub_stamp":"2024-09-15T20:51:37.027579+0000","last_deep_scrub":"27'5691","last_deep_scrub_stamp":"2024-09-15T20:51:37.027579+0000","last_clean_scrub_stamp":"2024-09-15T20:51:37.027579+0000","objects_scrubbed":30,"log_size":5691,"log_dups_size":0,"ondisk_log_size":5691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:34.094413+0000","scrub_duration":267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114950144,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":1345,"num_read_kb":1168,"num_write":6126,"num_write_kb":191597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"27'4921","reported_seq":4953,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:36.496771+0000","last_change":"2024-09-15T20:51:36.496721+0000","last_active":"2024-09-15T20:51:36.496771+0000","last_peered":"2024-09-15T20:51:36.496771+0000","last_clean":"2024-09-15T20:51:36.496771+0000","last_became_active":"2024-09-15T20:47:21.008922+0000","last_became_peered":"2024-09-15T20:47:21.008922+0000","last_unstale":"2024-09-15T20:51:36.496771+0000","last_undegraded":"2024-09-15T20:51:36.496771+0000","last_fullsized":"2024-09-15T20:51:36.496771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4921","last_scrub_stamp":"2024-09-15T20:51:36.496651+0000","last_deep_scrub":"27'4921","last_deep_scrub_stamp":"2024-09-15T20:51:36.496651+0000","last_clean_scrub_stamp":"2024-09-15T20:51:36.496651+0000","objects_scrubbed":34,"log_size":4921,"log_dups_size":0,"ondisk_log_size":4921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T21:33:51.268600+0000","scrub_duration":211,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":4843,"num_write_kb":242701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"27'5619","reported_seq":5647,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:38.241307+0000","last_change":"2024-09-15T20:51:38.241307+0000","last_active":"2024-09-15T20:51:38.241307+0000","last_peered":"2024-09-15T20:51:38.241307+0000","last_clean":"2024-09-15T20:51:38.241307+0000","last_became_active":"2024-09-15T20:47:21.028396+0000","last_became_peered":"2024-09-15T20:47:21.028396+0000","last_unstale":"2024-09-15T20:51:38.241307+0000","last_undegraded":"2024-09-15T20:51:38.241307+0000","last_fullsized":"2024-09-15T20:51:38.241307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5619","last_scrub_stamp":"2024-09-15T20:51:38.241117+0000","last_deep_scrub":"27'5619","last_deep_scrub_stamp":"2024-09-15T20:51:38.241117+0000","last_clean_scrub_stamp":"2024-09-15T20:51:38.241117+0000","objects_scrubbed":36,"log_size":5619,"log_dups_size":0,"ondisk_log_size":5619,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:16.245043+0000","scrub_duration":475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":149618688,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5530,"num_write_kb":231368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'3851","reported_seq":3887,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:44.378790+0000","last_change":"2024-09-15T20:51:44.378790+0000","last_active":"2024-09-15T20:51:44.378790+0000","last_peered":"2024-09-15T20:51:44.378790+0000","last_clean":"2024-09-15T20:51:44.378790+0000","last_became_active":"2024-09-15T20:47:21.009741+0000","last_became_peered":"2024-09-15T20:47:21.009741+0000","last_unstale":"2024-09-15T20:51:44.378790+0000","last_undegraded":"2024-09-15T20:51:44.378790+0000","last_fullsized":"2024-09-15T20:51:44.378790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3851","last_scrub_stamp":"2024-09-15T20:51:44.378644+0000","last_deep_scrub":"27'3851","last_deep_scrub_stamp":"2024-09-15T20:51:44.378644+0000","last_clean_scrub_stamp":"2024-09-15T20:51:44.378644+0000","objects_scrubbed":32,"log_size":3851,"log_dups_size":0,"ondisk_log_size":3851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:28.405095+0000","scrub_duration":351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130680656,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":3826,"num_write_kb":196699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2688","reported_seq":2740,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:39.692763+0000","last_change":"2024-09-15T20:51:39.692763+0000","last_active":"2024-09-15T20:51:39.692763+0000","last_peered":"2024-09-15T20:51:39.692763+0000","last_clean":"2024-09-15T20:51:39.692763+0000","last_became_active":"2024-09-15T20:47:21.012712+0000","last_became_peered":"2024-09-15T20:47:21.012712+0000","last_unstale":"2024-09-15T20:51:39.692763+0000","last_undegraded":"2024-09-15T20:51:39.692763+0000","last_fullsized":"2024-09-15T20:51:39.692763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2688","last_scrub_stamp":"2024-09-15T20:51:39.692599+0000","last_deep_scrub":"27'2688","last_deep_scrub_stamp":"2024-09-15T20:51:39.692599+0000","last_clean_scrub_stamp":"2024-09-15T20:51:39.692599+0000","objects_scrubbed":22,"log_size":2688,"log_dups_size":0,"ondisk_log_size":2688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:05.838118+0000","scrub_duration":283,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080896,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":94,"num_read_kb":81,"num_write":2658,"num_write_kb":115655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"27'7955","reported_seq":7984,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-15T20:51:45.471467+0000","last_change":"2024-09-15T20:51:45.471467+0000","last_active":"2024-09-15T20:51:45.471467+0000","last_peered":"2024-09-15T20:51:45.471467+0000","last_clean":"2024-09-15T20:51:45.471467+0000","last_became_active":"2024-09-15T20:47:21.012087+0000","last_became_peered":"2024-09-15T20:47:21.012087+0000","last_unstale":"2024-09-15T20:51:45.471467+0000","last_undegraded":"2024-09-15T20:51:45.471467+0000","last_fullsized":"2024-09-15T20:51:45.471467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7955","last_scrub_stamp":"2024-09-15T20:51:45.471202+0000","last_deep_scrub":"27'7955","last_deep_scrub_stamp":"2024-09-15T20:51:45.471202+0000","last_clean_scrub_stamp":"2024-09-15T20:51:45.471202+0000","objects_scrubbed":31,"log_size":7955,"log_dups_size":0,"ondisk_log_size":7955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:30.282392+0000","scrub_duration":427,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125895176,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":7906,"num_write_kb":193612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3573534968,"num_objects":879,"num_object_clones":0,"num_object_copies":1758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":879,"num_whiteouts":0,"num_read":2563,"num_read_kb":2579,"num_write":159645,"num_write_kb":5636249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6849421312,"data_stored":6845154424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162369,"ondisk_log_size":162369,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509501,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":555512,"kb_used_data":474344,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":93816328,"statfs":{"total":96636764160,"available":96067919872,"internally_reserved":0,"allocated":485728256,"data_stored":485313060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":83098058},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509502,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1212972,"kb_used_data":938908,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93158868,"statfs":{"total":96636764160,"available":95394680832,"internally_reserved":0,"allocated":961441792,"data_stored":960577612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509502,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1169692,"kb_used_data":926156,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":93202148,"statfs":{"total":96636764160,"available":95438999552,"internally_reserved":0,"allocated":948383744,"data_stored":947689656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542205,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1027632,"kb_used_data":807712,"kb_used_omap":1,"kb_used_meta":219902,"kb_avail":93344208,"statfs":{"total":96636764160,"available":95584468992,"internally_reserved":0,"allocated":827097088,"data_stored":826451219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225180102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542205,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1064728,"kb_used_data":821192,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":93307112,"statfs":{"total":96636764160,"available":95546482688,"internally_reserved":0,"allocated":840900608,"data_stored":840208120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":927364,"kb_used_data":721332,"kb_used_omap":1,"kb_used_meta":206014,"kb_avail":93444476,"statfs":{"total":96636764160,"available":95687143424,"internally_reserved":0,"allocated":738643968,"data_stored":738011512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":210958789},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542204,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1368964,"kb_used_data":1067124,"kb_used_omap":1,"kb_used_meta":301822,"kb_avail":93002876,"statfs":{"total":96636764160,"available":95234945024,"internally_reserved":0,"allocated":1092734976,"data_stored":1091861215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":309066183},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1227488,"kb_used_data":935376,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93144352,"statfs":{"total":96636764160,"available":95379816448,"internally_reserved":0,"allocated":957825024,"data_stored":956945044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":948101120,"data_stored":947584016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":960626688,"data_stored":959943044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":957542400,"data_stored":956839404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1092448256,"data_stored":1091755556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":738361344,"data_stored":737905872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":840085504,"data_stored":839573552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":826810368,"data_stored":826345560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":485445632,"data_stored":485207420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T20:51:58.343 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T20:51:58.463 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9faf0640 1 Processor -- start 2024-09-15T20:51:58.464 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9faf0640 1 -- start start 2024-09-15T20:51:58.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9faf0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a9813dcf0 0x7f3a98073500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:58.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9faf0640 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a98072b60 con 0x7f3a98072780 2024-09-15T20:51:58.465 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9faf0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a980aeb40 con 0x7f3a98070650 2024-09-15T20:51:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9faf0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f3a98073a40 con 0x7f3a9813dcf0 2024-09-15T20:51:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9d88c640 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3a98072780 0x7f3a981442b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54830/0 (socket says 172.21.15.52:54830) 2024-09-15T20:51:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9d88c640 1 -- 172.21.15.52:0/471807380 learned_addr learned my addr 172.21.15.52:0/471807380 (peer_addr_for_me v1:172.21.15.52:0/0) 2024-09-15T20:51:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9e08d640 1 --2- 172.21.15.52:0/471807380 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a9813dcf0 0x7f3a98073500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9c88a640 1 -- 172.21.15.52:0/471807380 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349859045 0 0) 0x7f3a94001120 con 0x7f3a98072780 2024-09-15T20:51:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9c88a640 1 -- 172.21.15.52:0/471807380 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a84003530 con 0x7f3a98072780 2024-09-15T20:51:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9e08d640 1 -- 172.21.15.52:0/471807380 >> v1:172.21.15.81:6789/0 conn(0x7f3a98070650 legacy=0x7f3a9813d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9e08d640 1 -- 172.21.15.52:0/471807380 >> v1:172.21.15.52:6789/0 conn(0x7f3a98072780 legacy=0x7f3a981442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9c88a640 1 -- 172.21.15.52:0/471807380 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1837351521 0 0) 0x7f3a84003530 con 0x7f3a98072780 2024-09-15T20:51:58.466 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.460+0000 7f3a9e08d640 1 -- 172.21.15.52:0/471807380 --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a98143d90 con 0x7f3a9813dcf0 2024-09-15T20:51:58.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9e08d640 1 --2- 172.21.15.52:0/471807380 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a9813dcf0 0x7f3a98073500 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009dc0 tx=0x7f3a9001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93ae43585cd8241c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:58.467 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9c88a640 1 -- 172.21.15.52:0/471807380 <== mon.2 v2:172.21.15.52:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a900ac070 con 0x7f3a9813dcf0 2024-09-15T20:51:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9c88a640 1 -- 172.21.15.52:0/471807380 <== mon.2 v2:172.21.15.52:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a900a6450 con 0x7f3a9813dcf0 2024-09-15T20:51:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9c88a640 1 -- 172.21.15.52:0/471807380 <== mon.2 v2:172.21.15.52:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a940018d0 con 0x7f3a9813dcf0 2024-09-15T20:51:58.468 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 -- 172.21.15.52:0/471807380 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a9813dcf0 msgr2=0x7f3a98073500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 --2- 172.21.15.52:0/471807380 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a9813dcf0 0x7f3a98073500 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009dc0 tx=0x7f3a9001c800 comp rx=0 tx=0).stop 2024-09-15T20:51:58.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 -- 172.21.15.52:0/471807380 shutdown_connections 2024-09-15T20:51:58.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 --2- 172.21.15.52:0/471807380 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a9813dcf0 0x7f3a98073500 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 -- 172.21.15.52:0/471807380 >> 172.21.15.52:0/471807380 conn(0x7f3a980b9db0 msgr2=0x7f3a980ba1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:58.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 -- 172.21.15.52:0/471807380 shutdown_connections 2024-09-15T20:51:58.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 -- 172.21.15.52:0/471807380 wait complete. 2024-09-15T20:51:58.469 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 Processor -- start 2024-09-15T20:51:58.470 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 -- start start 2024-09-15T20:51:58.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98070650 0x7f3a98138c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:58.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a98072780 0x7f3a981df850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:58.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 --2- >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a9813dcf0 0x7f3a981465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:58.472 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3a98152130 con 0x7f3a98070650 2024-09-15T20:51:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3a98151fb0 con 0x7f3a98072780 2024-09-15T20:51:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9faf0640 1 -- --> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] -- mon_getmap magic: 0 -- 0x7f3a981522b0 con 0x7f3a9813dcf0 2024-09-15T20:51:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9d88c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98070650 0x7f3a98138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9d88c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98070650 0x7f3a98138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52772/0 (socket says 172.21.15.52:52772) 2024-09-15T20:51:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9d88c640 1 -- 172.21.15.52:0/3866372449 learned_addr learned my addr 172.21.15.52:0/3866372449 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-15T20:51:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9e08d640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a9813dcf0 0x7f3a981465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9d08b640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a98072780 0x7f3a981df850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9d88c640 1 -- 172.21.15.52:0/3866372449 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a9813dcf0 msgr2=0x7f3a981465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9d88c640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a9813dcf0 0x7f3a981465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9d88c640 1 -- 172.21.15.52:0/3866372449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a98072780 msgr2=0x7f3a981df850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.473 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9d88c640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a98072780 0x7f3a981df850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9d88c640 1 -- 172.21.15.52:0/3866372449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a98147fd0 con 0x7f3a98070650 2024-09-15T20:51:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9d08b640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a98072780 0x7f3a981df850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T20:51:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.464+0000 7f3a9d88c640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98070650 0x7f3a98138c30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3a94001a40 tx=0x7f3a9400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.468+0000 7f3a8e7fc640 1 -- 172.21.15.52:0/3866372449 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94005ae0 con 0x7f3a98070650 2024-09-15T20:51:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.468+0000 7f3a8e7fc640 1 -- 172.21.15.52:0/3866372449 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a94005c80 con 0x7f3a98070650 2024-09-15T20:51:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.468+0000 7f3a9faf0640 1 -- 172.21.15.52:0/3866372449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a981dffd0 con 0x7f3a98070650 2024-09-15T20:51:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.468+0000 7f3a8e7fc640 1 -- 172.21.15.52:0/3866372449 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a940072b0 con 0x7f3a98070650 2024-09-15T20:51:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.468+0000 7f3a9faf0640 1 -- 172.21.15.52:0/3866372449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a981e04f0 con 0x7f3a98070650 2024-09-15T20:51:58.474 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.468+0000 7f3a9faf0640 1 -- 172.21.15.52:0/3866372449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a98073500 con 0x7f3a98070650 2024-09-15T20:51:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.468+0000 7f3a8e7fc640 1 -- 172.21.15.52:0/3866372449 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) ==== 97080+0+0 (secure 0 0 0) 0x7f3a94007450 con 0x7f3a98070650 2024-09-15T20:51:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.468+0000 7f3a8e7fc640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3a7c072ec0 0x7f3a7c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T20:51:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.468+0000 7f3a8e7fc640 1 -- 172.21.15.52:0/3866372449 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5645+0+0 (secure 0 0 0) 0x7f3a940938f0 con 0x7f3a98070650 2024-09-15T20:51:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.468+0000 7f3a9d08b640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3a7c072ec0 0x7f3a7c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T20:51:58.475 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.468+0000 7f3a9d08b640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3a7c072ec0 0x7f3a7c075380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3a98139370 tx=0x7f3a88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T20:51:58.481 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.472+0000 7f3a8e7fc640 1 -- 172.21.15.52:0/3866372449 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187702 (secure 0 0 0) 0x7f3a98072b60 con 0x7f3a98070650 2024-09-15T20:51:58.652 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.648+0000 7f3a9faf0640 1 -- 172.21.15.52:0/3866372449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3a9813bd90 con 0x7f3a98070650 2024-09-15T20:51:58.656 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.652+0000 7f3a8e7fc640 1 -- 172.21.15.52:0/3866372449 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v7)=0 v7) ==== 123+0+0 (secure 0 0 0) 0x7f3a9405ec10 con 0x7f3a98070650 2024-09-15T20:51:58.657 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.652+0000 7f3a8e7fc640 1 -- 172.21.15.52:0/3866372449 <== mon.0 v2:172.21.15.52:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3a94065030 con 0x7f3a98070650 2024-09-15T20:51:58.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.656+0000 7f3a9faf0640 1 -- 172.21.15.52:0/3866372449 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3a7c072ec0 msgr2=0x7f3a7c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.659 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.656+0000 7f3a9faf0640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3a7c072ec0 0x7f3a7c075380 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3a98139370 tx=0x7f3a88009040 comp rx=0 tx=0).stop 2024-09-15T20:51:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.656+0000 7f3a9faf0640 1 -- 172.21.15.52:0/3866372449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98070650 msgr2=0x7f3a98138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T20:51:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.656+0000 7f3a9faf0640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98070650 0x7f3a98138c30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3a94001a40 tx=0x7f3a9400cbb0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.656+0000 7f3a9faf0640 1 -- 172.21.15.52:0/3866372449 shutdown_connections 2024-09-15T20:51:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.656+0000 7f3a9faf0640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.81:6832/3693261179,v1:172.21.15.81:6833/3693261179] conn(0x7f3a7c072ec0 0x7f3a7c075380 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.656+0000 7f3a9faf0640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] conn(0x7f3a9813dcf0 0x7f3a981465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.656+0000 7f3a9faf0640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a98072780 0x7f3a981df850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.656+0000 7f3a9faf0640 1 --2- 172.21.15.52:0/3866372449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a98070650 0x7f3a98138c30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T20:51:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.656+0000 7f3a9faf0640 1 -- 172.21.15.52:0/3866372449 >> 172.21.15.52:0/3866372449 conn(0x7f3a980b9db0 msgr2=0x7f3a9813c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T20:51:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.656+0000 7f3a9faf0640 1 -- 172.21.15.52:0/3866372449 shutdown_connections 2024-09-15T20:51:58.660 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-15T20:51:58.656+0000 7f3a9faf0640 1 -- 172.21.15.52:0/3866372449 wait complete. 2024-09-15T20:51:58.676 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T20:51:58.676 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T20:51:58.677 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T20:51:58.677 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:51:58.750 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T20:51:58.751 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T20:51:58.751 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:52:04.852 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T20:52:04.853 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T20:52:04.853 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:52:04.931 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T20:52:04.931 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-15T20:52:04.931 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:52:05.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-15T20:52:05.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-15T20:52:11.033 INFO:tasks.ceph.osd.3:Stopped 2024-09-15T20:52:11.034 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-15T20:52:11.034 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:52:11.100 INFO:tasks.ceph.osd.4:Stopped 2024-09-15T20:52:11.100 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-15T20:52:11.100 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:52:11.846 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-15T20:52:11.846 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-15T20:52:11.846 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-15T20:52:17.203 INFO:tasks.ceph.osd.5:Stopped 2024-09-15T20:52:17.203 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-15T20:52:17.203 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:52:17.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-15T20:52:17.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-15T20:52:23.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-15T20:52:23.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-15T20:52:23.305 INFO:tasks.ceph.osd.6:Stopped 2024-09-15T20:52:23.306 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-15T20:52:23.306 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:52:23.384 INFO:tasks.ceph.osd.7:Stopped 2024-09-15T20:52:23.384 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T20:52:23.384 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-15T20:52:23.385 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:52:23.417 INFO:tasks.ceph.mgr.y:Stopped 2024-09-15T20:52:23.417 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T20:52:23.417 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:52:23.449 INFO:tasks.ceph.mgr.x:Stopped 2024-09-15T20:52:23.449 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-15T20:52:23.449 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-15T20:52:23.449 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:52:23.473 INFO:tasks.ceph.mon.a:Stopped 2024-09-15T20:52:23.473 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-15T20:52:23.473 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:52:23.542 INFO:tasks.ceph.mon.c:Stopped 2024-09-15T20:52:23.542 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-15T20:52:23.543 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T20:52:23.567 INFO:tasks.ceph.mon.b:Stopped 2024-09-15T20:52:23.568 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-15T20:52:23.568 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | head -n 1 2024-09-15T20:52:23.598 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:52:23.598 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-15T20:52:23.867 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:52:23.867 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-15T20:52:24.211 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:52:24.212 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-15T20:52:24.388 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:52:24.388 DEBUG:teuthology.orchestra.run.smithi052:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-15T20:52:24.574 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-15T20:52:24.574 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-15T20:52:24.767 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-15T20:52:24.767 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-15T20:52:24.955 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-15T20:52:24.955 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-15T20:52:25.135 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-15T20:52:25.136 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-15T20:52:25.313 INFO:tasks.ceph:Archiving mon data... 2024-09-15T20:52:25.315 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610/data/mon.a.tgz 2024-09-15T20:52:25.316 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-15T20:52:25.322 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.xTnhAKIMl2 2024-09-15T20:52:25.322 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.xTnhAKIMl2 2024-09-15T20:52:25.438 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.xTnhAKIMl2 2024-09-15T20:52:25.499 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.xTnhAKIMl2 is 323KB 2024-09-15T20:52:25.557 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.xTnhAKIMl2 2024-09-15T20:52:25.562 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610/data/mon.c.tgz 2024-09-15T20:52:25.562 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-09-15T20:52:25.608 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.Y7PXIvCrJr 2024-09-15T20:52:25.608 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Y7PXIvCrJr 2024-09-15T20:52:25.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.Y7PXIvCrJr 2024-09-15T20:52:25.793 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.Y7PXIvCrJr is 323KB 2024-09-15T20:52:25.853 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.Y7PXIvCrJr 2024-09-15T20:52:25.859 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610/data/mon.b.tgz 2024-09-15T20:52:25.859 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-15T20:52:25.865 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.MMEsNmDybf 2024-09-15T20:52:25.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.MMEsNmDybf 2024-09-15T20:52:25.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.MMEsNmDybf 2024-09-15T20:52:26.045 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.MMEsNmDybf is 323KB 2024-09-15T20:52:26.103 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.MMEsNmDybf 2024-09-15T20:52:26.108 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-15T20:52:26.108 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T20:52:26.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T20:52:26.168 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T20:52:26.210 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T20:52:26.210 INFO:tasks.ceph:Archiving crash dumps... 2024-09-15T20:52:26.211 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610/remote/smithi052/crash 2024-09-15T20:52:26.212 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T20:52:26.226 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610/remote/smithi081/crash 2024-09-15T20:52:26.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T20:52:26.265 INFO:tasks.ceph:Compressing logs... 2024-09-15T20:52:26.266 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T20:52:26.272 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T20:52:26.296 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21476.log 2024-09-15T20:52:26.296 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-15T20:52:26.296 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.tmp-client.admin.21476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32459.log 2024-09-15T20:52:26.297 INFO:teuthology.orchestra.run.smithi052.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21476.log.gz 2024-09-15T20:52:26.297 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32069.log 2024-09-15T20:52:26.297 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30558.log 2024-09-15T20:52:26.299 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32199.log 2024-09-15T20:52:26.299 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32459.log.gz 2024-09-15T20:52:26.299 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30558.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32069.log.gz 2024-09-15T20:52:26.299 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-15T20:52:26.299 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30558.log.gz 2024-09-15T20:52:26.299 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31799.log 2024-09-15T20:52:26.299 INFO:teuthology.orchestra.run.smithi052.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32199.log.gz 2024-09-15T20:52:26.299 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31910.log 2024-09-15T20:52:26.299 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30491.log 2024-09-15T20:52:26.299 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.libcephsqlite.31799.log: /var/log/ceph/ceph-client.libcephsqlite.31910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32017.log 2024-09-15T20:52:26.311 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26516.log 2024-09-15T20:52:26.311 INFO:teuthology.orchestra.run.smithi052.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30491.log.gz 2024-09-15T20:52:26.311 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31867.log 2024-09-15T20:52:26.312 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32017.log: gzip/var/log/ceph/ceph-client.admin.26516.log: -5 --verbose 91.4% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31910.log.gz 2024-09-15T20:52:26.312 INFO:teuthology.orchestra.run.smithi052.stderr: -- 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32017.log.gz 2024-09-15T20:52:26.312 INFO:teuthology.orchestra.run.smithi052.stderr: /var/log/ceph/ceph-client.admin.30562.log 2024-09-15T20:52:26.312 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.26516.log.gz 2024-09-15T20:52:26.312 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.libcephsqlite.31867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30982.log 2024-09-15T20:52:26.312 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31659.log 2024-09-15T20:52:26.312 INFO:teuthology.orchestra.run.smithi052.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30562.log.gz 2024-09-15T20:52:26.312 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-15T20:52:26.312 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30982.log: /var/log/ceph/ceph-client.libcephsqlite.31659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30772.log 2024-09-15T20:52:26.312 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30982.log.gz/var/log/ceph/ceph-osd.2.log: 2024-09-15T20:52:26.312 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30980.log 2024-09-15T20:52:26.313 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30772.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-15T20:52:26.313 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30772.log.gz 2024-09-15T20:52:26.313 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32329.log 2024-09-15T20:52:26.313 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32509.log 2024-09-15T20:52:26.313 INFO:teuthology.orchestra.run.smithi052.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30980.log.gz 2024-09-15T20:52:26.313 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32329.log: 91.9% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31659.log.gz 2024-09-15T20:52:26.313 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32303.log 2024-09-15T20:52:26.313 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-15T20:52:26.313 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32509.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32329.log.gz 2024-09-15T20:52:26.313 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32303.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.32509.log.gz --verbose 2024-09-15T20:52:26.313 INFO:teuthology.orchestra.run.smithi052.stderr: -- /var/log/ceph/ceph-client.libcephsqlite.31701.log 2024-09-15T20:52:26.313 INFO:teuthology.orchestra.run.smithi052.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32303.log.gz 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30779.log 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.libcephsqlite.31701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30569.log 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30779.log: 89.7% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31701.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31965.log 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30779.log.gz 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32485.log 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32407.log 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30569.log.gz 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32485.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31680.log 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31965.log.gz 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32485.log.gz 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32407.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32407.log.gz 2024-09-15T20:52:26.314 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30555.log 2024-09-15T20:52:26.315 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.libcephsqlite.31680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30565.log 2024-09-15T20:52:26.321 INFO:teuthology.orchestra.run.smithi052.stderr: 89.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30986.log 2024-09-15T20:52:26.321 INFO:teuthology.orchestra.run.smithi052.stderr: -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31680.log.gz 2024-09-15T20:52:26.321 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30555.log: /var/log/ceph/ceph-client.admin.30565.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30555.log.gz 2024-09-15T20:52:26.321 INFO:teuthology.orchestra.run.smithi052.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30565.log.gz 2024-09-15T20:52:26.321 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30559.log 2024-09-15T20:52:26.321 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31776.log 2024-09-15T20:52:26.321 INFO:teuthology.orchestra.run.smithi052.stderr: 89.2%/var/log/ceph/ceph-client.admin.30559.log: -- replaced with /var/log/ceph/ceph-client.admin.30986.log.gz 2024-09-15T20:52:26.321 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32381.log 2024-09-15T20:52:26.321 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32277.log 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6%/var/log/ceph/ceph-client.libcephsqlite.31776.log: -- replaced with /var/log/ceph/ceph-client.admin.30559.log.gz 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32381.log: 89.6% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31776.log.gz 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32381.log.gz 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30773.log 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32277.log.gz 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30778.log 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30773.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30773.log.gz 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30774.log 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31637.log 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30778.log.gz/var/log/ceph/ceph-client.admin.30774.log: 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30774.log.gz 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-15T20:52:26.322 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.libcephsqlite.31637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31193.log 2024-09-15T20:52:26.323 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-osd.1.log: 89.1% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31637.log.gz 2024-09-15T20:52:26.324 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30959.log 2024-09-15T20:52:26.324 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31193.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31193.log.gz 2024-09-15T20:52:26.328 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30777.log 2024-09-15T20:52:26.328 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30959.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30959.log.gz 2024-09-15T20:52:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31724.log 2024-09-15T20:52:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30777.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30777.log.gz 2024-09-15T20:52:26.330 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30517.log 2024-09-15T20:52:26.338 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.libcephsqlite.31724.log: 92.7% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31724.log.gz 2024-09-15T20:52:26.339 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31219.log 2024-09-15T20:52:26.340 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30517.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30517.log.gz 2024-09-15T20:52:26.340 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30369.log 2024-09-15T20:52:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31219.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31219.log.gz 2024-09-15T20:52:26.341 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32095.log 2024-09-15T20:52:26.342 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26532.log 2024-09-15T20:52:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30369.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30369.log.gz 2024-09-15T20:52:26.343 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T20:52:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26508.log 2024-09-15T20:52:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.26532.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-15T20:52:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.26508.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.26532.log.gz 2024-09-15T20:52:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-15T20:52:26.345 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.26508.log.gz 2024-09-15T20:52:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26556.log 2024-09-15T20:52:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26484.log 2024-09-15T20:52:26.345 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.26556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26580.log 2024-09-15T20:52:26.345 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.26556.log.gz 2024-09-15T20:52:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32095.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32095.log.gz 2024-09-15T20:52:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30394.log 2024-09-15T20:52:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.log: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T20:52:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32121.log 2024-09-15T20:52:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30394.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30394.log.gz 2024-09-15T20:52:26.349 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31167.log 2024-09-15T20:52:26.350 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.26484.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-15T20:52:26.350 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.26580.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.26484.log.gz 2024-09-15T20:52:26.350 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.26580.log.gz 2024-09-15T20:52:26.350 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.26460.log 2024-09-15T20:52:26.350 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26412.log 2024-09-15T20:52:26.351 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.26460.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-15T20:52:26.351 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.26460.log.gz 2024-09-15T20:52:26.351 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.26412.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T20:52:26.351 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.26412.log.gz 2024-09-15T20:52:26.351 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26436.log 2024-09-15T20:52:26.351 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T20:52:26.351 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-15T20:52:26.351 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.26436.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-15T20:52:26.351 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.26436.log.gz 2024-09-15T20:52:26.351 INFO:teuthology.orchestra.run.smithi081.stderr: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T20:52:26.351 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.b.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T20:52:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32121.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32121.log.gz 2024-09-15T20:52:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31844.log 2024-09-15T20:52:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31167.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31167.log.gz 2024-09-15T20:52:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32043.log 2024-09-15T20:52:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.libcephsqlite.31844.log: 89.7% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31844.log.gz 2024-09-15T20:52:26.353 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30984.log 2024-09-15T20:52:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32043.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32043.log.gz 2024-09-15T20:52:26.354 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32147.log 2024-09-15T20:52:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30984.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30984.log.gz 2024-09-15T20:52:26.355 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-15T20:52:26.356 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32147.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32147.log.gz 2024-09-15T20:52:26.356 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32433.log 2024-09-15T20:52:26.375 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31939.log 2024-09-15T20:52:26.376 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32433.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32433.log.gz 2024-09-15T20:52:26.383 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30776.log 2024-09-15T20:52:26.384 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31939.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31939.log.gz 2024-09-15T20:52:26.390 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.4.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-15T20:52:26.399 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30985.log 2024-09-15T20:52:26.400 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30776.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30776.log.gz 2024-09-15T20:52:26.415 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32225.log 2024-09-15T20:52:26.416 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30985.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30985.log.gz 2024-09-15T20:52:26.423 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32355.log 2024-09-15T20:52:26.424 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32225.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32225.log.gz 2024-09-15T20:52:26.431 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30570.log 2024-09-15T20:52:26.432 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32355.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32355.log.gz 2024-09-15T20:52:26.443 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30987.log 2024-09-15T20:52:26.444 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30570.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30570.log.gz 2024-09-15T20:52:26.453 INFO:teuthology.orchestra.run.smithi081.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-15T20:52:26.455 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T20:52:26.456 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30987.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30987.log.gz 2024-09-15T20:52:26.467 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30758.log 2024-09-15T20:52:26.469 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph.audit.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T20:52:26.479 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31825.log 2024-09-15T20:52:26.480 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30758.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30758.log.gz 2024-09-15T20:52:26.491 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32251.log 2024-09-15T20:52:26.494 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.libcephsqlite.31825.log: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-15T20:52:26.494 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26416.log 2024-09-15T20:52:26.496 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32251.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32251.log.gz 2024-09-15T20:52:26.496 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30976.log 2024-09-15T20:52:26.496 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26416.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.26416.log.gz 2024-09-15T20:52:26.496 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31270.log 2024-09-15T20:52:26.497 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30976.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30976.log.gz 2024-09-15T20:52:26.497 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30571.log 2024-09-15T20:52:26.498 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31270.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31270.log.gz 2024-09-15T20:52:26.499 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30465.log 2024-09-15T20:52:26.500 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30571.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30571.log.gz 2024-09-15T20:52:26.500 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31294.log 2024-09-15T20:52:26.501 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30465.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30465.log.gz 2024-09-15T20:52:26.501 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26269.log 2024-09-15T20:52:26.515 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.libcephsqlite.31294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31243.log 2024-09-15T20:52:26.517 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.26269.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.26269.log.gz 2024-09-15T20:52:26.526 INFO:teuthology.orchestra.run.smithi052.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31825.log.gz 2024-09-15T20:52:26.531 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.31756.log 2024-09-15T20:52:26.532 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31243.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31243.log.gz 2024-09-15T20:52:26.532 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30419.log 2024-09-15T20:52:26.539 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.libcephsqlite.31756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30439.log 2024-09-15T20:52:26.539 INFO:teuthology.orchestra.run.smithi052.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31799.log.gz 2024-09-15T20:52:26.542 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30419.log: 94.6% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31756.log.gz 2024-09-15T20:52:26.543 INFO:teuthology.orchestra.run.smithi052.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30419.log.gz 2024-09-15T20:52:26.543 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31991.log 2024-09-15T20:52:26.544 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30439.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30439.log.gz 2024-09-15T20:52:26.545 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32173.log 2024-09-15T20:52:26.545 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.31991.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31991.log.gz 2024-09-15T20:52:26.545 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30307.log 2024-09-15T20:52:26.546 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.32173.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32173.log.gz 2024-09-15T20:52:26.548 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ceph-client.admin.30307.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30307.log.gz 2024-09-15T20:52:26.597 INFO:teuthology.orchestra.run.smithi052.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-15T20:52:26.696 INFO:teuthology.orchestra.run.smithi052.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31867.log.gz 2024-09-15T20:52:27.923 INFO:teuthology.orchestra.run.smithi052.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.31294.log.gz 2024-09-15T20:52:28.158 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-15T20:52:31.770 INFO:teuthology.orchestra.run.smithi081.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-15T20:52:37.876 INFO:teuthology.orchestra.run.smithi081.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-15T20:52:38.424 INFO:teuthology.orchestra.run.smithi052.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-15T20:52:38.527 INFO:teuthology.orchestra.run.smithi081.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-15T20:52:39.316 INFO:teuthology.orchestra.run.smithi052.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-15T20:52:41.020 INFO:teuthology.orchestra.run.smithi081.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-15T20:52:41.021 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-15T20:52:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m14.703s 2024-09-15T20:52:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m42.625s 2024-09-15T20:52:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m1.367s 2024-09-15T20:52:41.327 INFO:teuthology.orchestra.run.smithi052.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-15T20:52:47.478 INFO:teuthology.orchestra.run.smithi052.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-15T20:52:47.479 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-15T20:52:47.479 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m21.205s 2024-09-15T20:52:47.479 INFO:teuthology.orchestra.run.smithi052.stderr:user 1m2.146s 2024-09-15T20:52:47.480 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m1.778s 2024-09-15T20:52:47.481 INFO:tasks.ceph:Archiving logs... 2024-09-15T20:52:47.481 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610/remote/smithi052/log 2024-09-15T20:52:47.482 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T20:52:55.942 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610/remote/smithi081/log 2024-09-15T20:52:55.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T20:53:02.113 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T20:53:02.122 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T20:53:02.123 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T20:53:02.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T20:53:02.207 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T20:53:02.216 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T20:53:02.216 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T20:53:02.219 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T20:53:02.230 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T20:53:02.231 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-09-15T20:53:02.231 INFO:teuthology.orchestra.run.smithi081.stdout:+hv01.front.sepi 67.205.162.81 3 u 1 64 377 0.062 +0.487 0.411 2024-09-15T20:53:02.231 INFO:teuthology.orchestra.run.smithi081.stdout:*hv02.front.sepi 63.231.80.2 3 u 67 64 377 0.081 +0.016 0.697 2024-09-15T20:53:02.231 INFO:teuthology.orchestra.run.smithi081.stdout:+hv03.front.sepi 74.6.168.72 3 u 66 64 377 0.086 +2.413 0.608 2024-09-15T20:53:02.231 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T20:53:02.232 INFO:teuthology.orchestra.run.smithi052.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T20:53:02.232 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================== 2024-09-15T20:53:02.232 INFO:teuthology.orchestra.run.smithi052.stdout:*hv01.front.sepi 67.205.162.81 3 u 2 64 377 0.073 -1.371 0.609 2024-09-15T20:53:02.232 INFO:teuthology.orchestra.run.smithi052.stdout:+hv02.front.sepi 63.231.80.2 3 u 65 64 377 0.076 -1.804 0.918 2024-09-15T20:53:02.232 INFO:teuthology.orchestra.run.smithi052.stdout:+hv03.front.sepi 74.6.168.72 3 u - 64 377 0.071 -0.676 1.203 2024-09-15T20:53:02.232 INFO:teuthology.orchestra.run.smithi052.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T20:53:02.232 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T20:53:02.241 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T20:53:02.242 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T20:53:02.250 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T20:53:02.258 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T20:53:02.267 INFO:teuthology.task.internal:Duration was 991.129645 seconds 2024-09-15T20:53:02.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T20:53:02.276 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T20:53:02.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T20:53:02.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T20:53:02.317 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T20:53:02.317 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-09-15T20:53:02.317 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T20:53:02.369 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-15T20:53:02.369 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T20:53:02.380 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T20:53:02.380 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T20:53:02.413 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T20:53:02.452 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T20:53:02.452 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T20:53:02.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T20:53:02.551 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T20:53:02.561 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T20:53:02.561 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T20:53:02.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T20:53:02.586 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T20:53:02.596 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T20:53:02.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T20:53:02.629 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-09-15T20:53:02.640 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-15T20:53:02.721 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T20:53:02.726 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi052.front.sepia.ceph.com, flagging run as failed 2024-09-15T20:53:02.727 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T20:53:02.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:53:02.766 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T20:53:02.776 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T20:53:02.777 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610/remote/smithi052 2024-09-15T20:53:02.777 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T20:53:09.754 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-09-15T20:53:10.221 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/teuthology-2024-09-15_20:00:16-rados-main-distro-default-smithi/7905610/remote/smithi052/coredump/1726433479.31867.core.gz: gzip compressed data, was "1726433479.31867.core", last modified: Sun Sep 15 20:53:02 2024, max compression, original size modulo 2^32 174047232 2024-09-15T20:53:10.221 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2024-09-15T20:53:10.965 INFO:teuthology.task.internal: core looks like: /tmp/tmpj9po99ix: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'sqlite3 -cmd .output /dev/null -cmd .load libcephsqlite.so -cmd pragma journal_', real uid: 1000, effective uid: 1000, real gid: 1271, effective gid: 1271, execfn: '/usr/bin/sqlite3', platform: 'x86_64' 2024-09-15T20:53:10.985 INFO:teuthology.task.internal: dump_program: sqlite3 -cmd .output /dev/null -cmd .load libcephsqlite.so -cmd pragma journal_ 2024-09-15T20:53:10.986 DEBUG:teuthology.orchestra.run.smithi052:> which 'sqlite3 -cmd .output /dev/null -cmd .load libcephsqlite.so -cmd pragma journal_' 2024-09-15T20:53:10.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:53:10.992 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi052 with status 1: "which 'sqlite3 -cmd .output /dev/null -cmd .load libcephsqlite.so -cmd pragma journal_'" 2024-09-15T20:53:10.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T20:53:11.003 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T20:53:11.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T20:53:11.013 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T20:53:11.013 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T20:53:11.037 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T20:53:11.041 INFO:teuthology.orchestra.run.smithi052.stdout: 658641 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 15 20:53 /home/ubuntu/cephtest 2024-09-15T20:53:11.041 INFO:teuthology.orchestra.run.smithi052.stdout: 658642 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Sep 15 20:36 /home/ubuntu/cephtest/archive 2024-09-15T20:53:11.041 INFO:teuthology.orchestra.run.smithi052.stdout: 658644 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 20:53 /home/ubuntu/cephtest/archive/syslog 2024-09-15T20:53:11.041 INFO:teuthology.orchestra.run.smithi052.stdout: 658646 4 -rw-rw-rw- 1 ubuntu ubuntu 1018 Sep 15 20:52 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-09-15T20:53:11.042 INFO:teuthology.orchestra.run.smithi052.stdout: 658645 192 -rw-rw-r-- 1 ubuntu ubuntu 192696 Sep 15 20:53 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T20:53:11.042 INFO:teuthology.orchestra.run.smithi052.stdout: 664801 180 -rw-rw-rw- 1 ubuntu ubuntu 180587 Sep 15 20:53 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-09-15T20:53:11.042 INFO:teuthology.orchestra.run.smithi052.stdout: 658643 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 20:51 /home/ubuntu/cephtest/archive/coredump 2024-09-15T20:53:11.042 INFO:teuthology.orchestra.run.smithi052.stdout: 678476 28780 -rw------- 1 ubuntu ubuntu 174047232 Sep 15 20:51 /home/ubuntu/cephtest/archive/coredump/1726433479.31867.core 2024-09-15T20:53:11.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T20:53:11.044 INFO:teuthology.orchestra.run.smithi052.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-15T20:53:11.044 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi052 with status 1: "which 'sqlite3 -cmd .output /dev/null -cmd .load libcephsqlite.so -cmd pragma journal_'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi052 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-15T20:53:11.045 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T20:53:11.063 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T20:53:11.074 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi052 with status 1: "which 'sqlite3 -cmd .output /dev/null -cmd .load libcephsqlite.so -cmd pragma journal_'" 2024-09-15T20:53:11.079 INFO:teuthology.run:Summary data: description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-low-osd-mem-target} rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} duration: 991.129644870758 failure_reason: Found coredumps on ubuntu@smithi052.front.sepia.ceph.com flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-15T20:53:11.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T20:53:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: 658463 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 15 20:53 /home/ubuntu/cephtest 2024-09-15T20:53:11.085 INFO:teuthology.orchestra.run.smithi081.stdout: 658464 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 15 20:53 /home/ubuntu/cephtest/archive 2024-09-15T20:53:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 20:53 /home/ubuntu/cephtest/archive/syslog 2024-09-15T20:53:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: 658468 4 -rw-rw-rw- 1 ubuntu ubuntu 819 Sep 15 20:52 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-09-15T20:53:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: 658467 188 -rw-rw-r-- 1 ubuntu ubuntu 191044 Sep 15 20:53 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T20:53:11.086 INFO:teuthology.orchestra.run.smithi081.stdout: 664624 176 -rw-rw-rw- 1 ubuntu ubuntu 178731 Sep 15 20:53 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-09-15T20:53:11.087 INFO:teuthology.orchestra.run.smithi081.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-15T20:53:11.197 INFO:teuthology.run:FAIL