2024-05-06T06:38:31.576 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-06T06:38:31.577 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --verbose --description rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} --name yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280 -- /home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280/orig.config.yaml 2024-05-06T06:38:31.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-06T06:38:31.711 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280 branch: wip-yuriw-testing-20240503.181540-main description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} email: yweinste@redhat.com first_in_suite: false job_id: '7690280' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuriw-testing-20240503.181540-main ceph: conf: client: debug cephsqlite: 20 debug client: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject socket failures: 1500 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - POOL_APP_NOT_ENABLED - do not have an application enabled mon_bind_msgr2: false sha1: e08cbbf6fd79a8dd2949f340bce25e28ea3db004 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e08cbbf6fd79a8dd2949f340bce25e28ea3db004 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuriw-testing-20240503.181540-main sha1: e08cbbf6fd79a8dd2949f340bce25e28ea3db004 owner: scheduled_yuriw@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4116 sha1: e08cbbf6fd79a8dd2949f340bce25e28ea3db004 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuriw-testing-20240503.181540-main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_e08cbbf6fd79a8dd2949f340bce25e28ea3db004/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: e08cbbf6fd79a8dd2949f340bce25e28ea3db004 targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGkfn7vJilnM+S81nkjLHMYbT/ARmls76OTwboKCkmJxlbMIcBXjEy1pCoG13D2VeDFilEWOiLKMsyxD/9+Rj00= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4WQTeKmFsHN61WMC/8XA/CWDJ725jbHKnDlMEoJoTeZMf/e/HfxuM+Cu4ZrqXMwc1JAGYQ8J1uhWkPuu2TfeI= tasks: - install: extra_system_packages: deb: - sqlite3 rpm: - sqlite-devel - ceph: null - exec: client.0: - ceph osd pool create cephsqlite - ceph auth get-or-create client.libcephsqlite mon 'profile simple-rados-client-with-blocklist' osd 'allow rwx pool=cephsqlite' >> /etc/ceph/ceph.keyring - exec: client.0: - ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr - workunit: clients: client.0: - rados/test_libcephsqlite.sh cephsqlite env: CEPH_ARGS: --id libcephsqlite --no-log-to-stderr teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-03_23:44:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-06T06:38:31.712 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_e08cbbf6fd79a8dd2949f340bce25e28ea3db004/qa; will attempt to use it 2024-05-06T06:38:31.712 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_e08cbbf6fd79a8dd2949f340bce25e28ea3db004/qa/tasks 2024-05-06T06:38:31.712 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-06T06:38:31.714 INFO:teuthology.task.internal:Checking packages... 2024-05-06T06:38:31.738 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'e08cbbf6fd79a8dd2949f340bce25e28ea3db004' 2024-05-06T06:38:31.738 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-06T06:38:31.738 INFO:teuthology.packaging:ref: None 2024-05-06T06:38:31.738 INFO:teuthology.packaging:tag: None 2024-05-06T06:38:31.738 INFO:teuthology.packaging:branch: wip-yuriw-testing-20240503.181540-main 2024-05-06T06:38:31.738 INFO:teuthology.packaging:sha1: e08cbbf6fd79a8dd2949f340bce25e28ea3db004 2024-05-06T06:38:31.739 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuriw-testing-20240503.181540-main 2024-05-06T06:38:32.078 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3516-ge08cbbf6-1jammy 2024-05-06T06:38:32.079 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-06T06:38:32.085 INFO:teuthology.task.internal:no buildpackages task found 2024-05-06T06:38:32.085 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-06T06:38:32.098 INFO:teuthology.task.internal:Saving configuration 2024-05-06T06:38:32.114 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-06T06:38:32.119 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-06T06:38:32.145 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 06:31:24.624315', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFYbr+GlYGVRCRmj8t8aJKOsR+rL3JWzWge/jj5dUoi9'} 2024-05-06T06:38:32.166 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 06:31:24.625831', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINjYF5onhgM0mgqUUAgTH49rJfipDKTqzJrqehOHHZ4V'} 2024-05-06T06:38:32.166 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-06T06:38:32.171 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-05-06T06:38:32.172 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-05-06T06:38:32.172 INFO:teuthology.run_tasks:Running task console_log... 2024-05-06T06:38:32.239 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff64690b3a0>, signals=[15]) 2024-05-06T06:38:32.239 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-06T06:38:32.248 INFO:teuthology.task.internal:Opening connections... 2024-05-06T06:38:32.248 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:38:32.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T06:38:32.332 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-05-06T06:38:32.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T06:38:32.411 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-06T06:38:32.418 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-05-06T06:38:32.423 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-05-06T06:38:32.423 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-05-06T06:38:32.467 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-06T06:38:32.467 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Ubuntu" 2024-05-06T06:38:32.468 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="22.04" 2024-05-06T06:38:32.468 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-06T06:38:32.468 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_CODENAME=jammy 2024-05-06T06:38:32.468 INFO:teuthology.orchestra.run.smithi070.stdout:ID=ubuntu 2024-05-06T06:38:32.468 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE=debian 2024-05-06T06:38:32.468 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-06T06:38:32.468 INFO:teuthology.orchestra.run.smithi070.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-06T06:38:32.468 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-06T06:38:32.468 INFO:teuthology.orchestra.run.smithi070.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-06T06:38:32.468 INFO:teuthology.orchestra.run.smithi070.stdout:UBUNTU_CODENAME=jammy 2024-05-06T06:38:32.469 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-05-06T06:38:32.493 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-05-06T06:38:32.498 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-05-06T06:38:32.499 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-05-06T06:38:32.551 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-06T06:38:32.551 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2024-05-06T06:38:32.551 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="22.04" 2024-05-06T06:38:32.551 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-06T06:38:32.551 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=jammy 2024-05-06T06:38:32.551 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2024-05-06T06:38:32.551 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2024-05-06T06:38:32.551 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-06T06:38:32.551 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-06T06:38:32.551 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-06T06:38:32.551 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-06T06:38:32.551 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=jammy 2024-05-06T06:38:32.552 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-05-06T06:38:32.576 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-06T06:38:32.585 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-06T06:38:32.625 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-06T06:38:32.625 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-05-06T06:38:32.628 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-05-06T06:38:32.632 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-06T06:38:32.638 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-06T06:38:32.638 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-05-06T06:38:32.673 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-05-06T06:38:32.758 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-06T06:38:32.813 INFO:teuthology.run_tasks:Running task kernel... 2024-05-06T06:38:32.827 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-06T06:38:32.827 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-06T06:38:32.828 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-06T06:38:32.828 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-06T06:38:32.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:38:32.833 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-05-06T06:38:32.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:38:32.834 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-05-06T06:38:32.879 INFO:teuthology.orchestra.run.smithi184.stdout:5.15.0-56-generic 2024-05-06T06:38:32.879 INFO:teuthology.task.kernel:Running kernel on smithi184: 5.15.0-56-generic 2024-05-06T06:38:32.879 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get clean 2024-05-06T06:38:32.880 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-56-generic 2024-05-06T06:38:32.880 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.15.0-56-generic 2024-05-06T06:38:32.880 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-05-06T06:38:33.005 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-05-06T06:38:33.031 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2024-05-06T06:38:33.148 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-06T06:38:33.170 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-06T06:38:33.188 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-06T06:38:33.250 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-06T06:38:33.267 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-06T06:38:33.278 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-06T06:38:33.344 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-06T06:38:33.354 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-05-06T06:38:33.385 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [620 kB] 2024-05-06T06:38:33.467 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,613 kB] 2024-05-06T06:38:33.470 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [453 kB] 2024-05-06T06:38:33.476 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-05-06T06:38:33.479 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-06T06:38:33.479 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-06T06:38:33.480 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-05-06T06:38:33.503 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-05-06T06:38:33.507 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-06T06:38:33.507 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-05-06T06:38:33.513 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [304 kB] 2024-05-06T06:38:33.516 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-05-06T06:38:33.519 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-06T06:38:33.520 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-06T06:38:33.521 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-05-06T06:38:33.526 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-06T06:38:33.528 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-06T06:38:33.531 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-06T06:38:33.532 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-06T06:38:33.545 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-05-06T06:38:33.548 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-06T06:38:33.548 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,072 kB] 2024-05-06T06:38:33.552 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-06T06:38:33.552 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-06T06:38:33.559 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [701 kB] 2024-05-06T06:38:33.579 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-06T06:38:33.582 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-06T06:38:33.582 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-06T06:38:33.583 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-06T06:38:33.583 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-06T06:38:33.584 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-06T06:38:33.584 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-06T06:38:33.584 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-06T06:38:33.585 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-06T06:38:33.604 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-06T06:38:33.604 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-06T06:38:33.605 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-06T06:38:33.605 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-06T06:38:33.605 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-06T06:38:33.703 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [453 kB] 2024-05-06T06:38:33.733 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-06T06:38:33.879 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [620 kB] 2024-05-06T06:38:33.988 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-05-06T06:38:34.098 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,613 kB] 2024-05-06T06:38:34.161 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-05-06T06:38:34.180 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-06T06:38:34.181 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-05-06T06:38:34.277 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-06T06:38:34.278 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-05-06T06:38:34.288 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-06T06:38:34.288 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-05-06T06:38:34.291 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [304 kB] 2024-05-06T06:38:34.307 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-05-06T06:38:34.309 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-06T06:38:34.310 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-05-06T06:38:34.395 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-06T06:38:34.395 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-05-06T06:38:34.403 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-06T06:38:34.503 INFO:teuthology.orchestra.run.smithi184.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-06T06:38:34.568 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [701 kB] 2024-05-06T06:38:34.914 INFO:teuthology.orchestra.run.smithi184.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-06T06:38:34.920 INFO:teuthology.orchestra.run.smithi184.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-06T06:38:34.938 INFO:teuthology.orchestra.run.smithi184.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-06T06:38:34.938 INFO:teuthology.orchestra.run.smithi184.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-06T06:38:34.941 INFO:teuthology.orchestra.run.smithi184.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-06T06:38:35.154 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,072 kB] 2024-05-06T06:38:35.265 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-06T06:38:35.286 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-06T06:38:35.287 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-06T06:38:35.288 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-06T06:38:35.292 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-06T06:38:35.293 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-06T06:38:35.293 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-06T06:38:35.298 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-06T06:38:35.303 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-06T06:38:35.470 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-06T06:38:35.553 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-06T06:38:35.680 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-06T06:38:35.731 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-06T06:38:35.781 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-06T06:38:39.199 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 13.3 MB in 2s (7,185 kB/s) 2024-05-06T06:38:40.193 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 13.3 MB in 3s (4,879 kB/s) 2024-05-06T06:38:40.483 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-05-06T06:38:40.501 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-06T06:38:40.552 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-05-06T06:38:40.729 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2024-05-06T06:38:40.730 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2024-05-06T06:38:40.886 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2024-05-06T06:38:40.886 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-06T06:38:40.886 INFO:teuthology.orchestra.run.smithi184.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-06T06:38:40.887 INFO:teuthology.orchestra.run.smithi184.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-06T06:38:40.887 INFO:teuthology.orchestra.run.smithi184.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-06T06:38:40.887 INFO:teuthology.orchestra.run.smithi184.stdout: python2.7-minimal 2024-05-06T06:38:40.887 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-06T06:38:40.888 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2024-05-06T06:38:40.888 INFO:teuthology.orchestra.run.smithi184.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-05-06T06:38:40.888 INFO:teuthology.orchestra.run.smithi184.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-05-06T06:38:40.888 INFO:teuthology.orchestra.run.smithi184.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-05-06T06:38:40.889 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2024-05-06T06:38:40.889 INFO:teuthology.orchestra.run.smithi184.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-06T06:38:40.889 INFO:teuthology.orchestra.run.smithi184.stdout:Recommended packages: 2024-05-06T06:38:40.889 INFO:teuthology.orchestra.run.smithi184.stdout: thermald 2024-05-06T06:38:40.942 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2024-05-06T06:38:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-05-06T06:38:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-05-06T06:38:40.942 INFO:teuthology.orchestra.run.smithi184.stdout: linux-modules-extra-5.15.0-105-generic 2024-05-06T06:38:40.943 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2024-05-06T06:38:40.944 INFO:teuthology.orchestra.run.smithi184.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-06T06:38:41.000 INFO:teuthology.orchestra.run.smithi184.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-06T06:38:41.000 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 113 MB of archives. 2024-05-06T06:38:41.000 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-06T06:38:41.000 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-05-06T06:38:41.502 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-05-06T06:38:41.551 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-05-06T06:38:41.566 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-06T06:38:41.610 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-05-06T06:38:41.625 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-05-06T06:38:41.835 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-05-06T06:38:41.836 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-05-06T06:38:42.007 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-05-06T06:38:42.007 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-06T06:38:42.007 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-06T06:38:42.008 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-06T06:38:42.008 INFO:teuthology.orchestra.run.smithi070.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-06T06:38:42.008 INFO:teuthology.orchestra.run.smithi070.stdout: python2.7-minimal 2024-05-06T06:38:42.008 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-06T06:38:42.009 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-05-06T06:38:42.009 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-05-06T06:38:42.009 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-05-06T06:38:42.010 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-05-06T06:38:42.011 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-05-06T06:38:42.011 INFO:teuthology.orchestra.run.smithi070.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-06T06:38:42.011 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-05-06T06:38:42.011 INFO:teuthology.orchestra.run.smithi070.stdout: thermald 2024-05-06T06:38:42.070 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-05-06T06:38:42.070 INFO:teuthology.orchestra.run.smithi070.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-05-06T06:38:42.070 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-05-06T06:38:42.070 INFO:teuthology.orchestra.run.smithi070.stdout: linux-modules-extra-5.15.0-105-generic 2024-05-06T06:38:42.072 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages will be upgraded: 2024-05-06T06:38:42.072 INFO:teuthology.orchestra.run.smithi070.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-06T06:38:42.142 INFO:teuthology.orchestra.run.smithi070.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-06T06:38:42.142 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 113 MB of archives. 2024-05-06T06:38:42.142 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-06T06:38:42.142 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-05-06T06:38:42.545 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-05-06T06:38:42.545 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-05-06T06:38:42.545 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-05-06T06:38:42.678 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-05-06T06:38:42.828 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-05-06T06:38:43.034 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-05-06T06:38:43.168 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-05-06T06:38:43.583 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 113 MB in 2s (51.1 MB/s) 2024-05-06T06:38:43.742 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-05-06T06:38:43.854 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-05-06T06:38:43.854 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-05-06T06:38:43.855 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-05-06T06:38:43.992 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-05-06T06:38:44.022 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-05-06T06:38:44.407 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 113 MB in 2s (58.3 MB/s) 2024-05-06T06:38:44.572 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-05-06T06:38:45.739 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-06T06:38:45.743 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-06T06:38:45.840 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:38:46.542 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-06T06:38:46.546 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-06T06:38:46.628 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:38:47.791 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-05-06T06:38:47.812 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-06T06:38:47.895 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:38:48.370 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-05-06T06:38:48.390 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-06T06:38:48.428 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:38:48.755 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-05-06T06:38:48.776 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-06T06:38:48.867 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:38:49.342 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-05-06T06:38:49.362 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-06T06:38:49.467 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:38:54.895 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-05-06T06:38:55.023 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-05-06T06:38:55.339 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-05-06T06:38:55.443 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-05-06T06:38:55.721 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-05-06T06:38:55.732 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-05-06T06:38:55.771 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-05-06T06:38:56.430 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-05-06T06:38:56.555 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-05-06T06:38:56.905 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-05-06T06:38:57.050 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-05-06T06:38:57.362 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-05-06T06:38:57.384 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-05-06T06:38:57.428 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-05-06T06:39:01.579 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-05-06T06:39:01.617 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-06T06:39:01.662 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:39:02.883 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-05-06T06:39:02.920 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-05-06T06:39:02.949 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:39:04.190 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-05-06T06:39:04.297 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-05-06T06:39:04.629 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-05-06T06:39:04.752 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:39:04.878 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-05-06T06:39:05.006 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:39:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-05-06T06:39:06.321 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-05-06T06:39:06.335 INFO:teuthology.orchestra.run.smithi184.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-06T06:39:06.335 INFO:teuthology.orchestra.run.smithi184.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-06T06:39:06.335 INFO:teuthology.orchestra.run.smithi184.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-05-06T06:39:06.335 INFO:teuthology.orchestra.run.smithi184.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-05-06T06:39:06.491 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:39:06.646 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-05-06T06:39:06.768 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:39:06.894 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-05-06T06:39:07.022 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:39:07.894 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:39:08.357 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-06T06:39:08.357 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-06T06:39:08.357 INFO:teuthology.orchestra.run.smithi070.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-05-06T06:39:08.357 INFO:teuthology.orchestra.run.smithi070.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-05-06T06:39:08.508 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:39:09.710 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-05-06T06:39:09.836 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-05-06T06:39:09.971 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:39:10.033 INFO:teuthology.orchestra.run.smithi184.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-06T06:39:10.033 INFO:teuthology.orchestra.run.smithi184.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-05-06T06:39:10.053 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:39:11.470 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-05-06T06:39:11.587 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-05-06T06:39:11.697 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-05-06T06:39:11.762 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-06T06:39:11.762 INFO:teuthology.orchestra.run.smithi070.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-05-06T06:39:24.761 INFO:teuthology.orchestra.run.smithi184.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-06T06:39:24.762 INFO:teuthology.orchestra.run.smithi184.stdout:Sourcing file `/etc/default/grub' 2024-05-06T06:39:24.775 INFO:teuthology.orchestra.run.smithi184.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-06T06:39:24.790 INFO:teuthology.orchestra.run.smithi184.stdout:Generating grub configuration file ... 2024-05-06T06:39:25.057 INFO:teuthology.orchestra.run.smithi184.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-05-06T06:39:25.077 INFO:teuthology.orchestra.run.smithi184.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-05-06T06:39:25.347 INFO:teuthology.orchestra.run.smithi184.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-06T06:39:25.352 INFO:teuthology.orchestra.run.smithi184.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-06T06:39:25.415 INFO:teuthology.orchestra.run.smithi184.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-06T06:39:25.420 INFO:teuthology.orchestra.run.smithi184.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-06T06:39:25.584 INFO:teuthology.orchestra.run.smithi184.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-06T06:39:25.584 INFO:teuthology.orchestra.run.smithi184.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-06T06:39:25.585 INFO:teuthology.orchestra.run.smithi184.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-06T06:39:25.622 INFO:teuthology.orchestra.run.smithi184.stdout:done 2024-05-06T06:39:25.924 INFO:teuthology.orchestra.run.smithi070.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-06T06:39:25.924 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub' 2024-05-06T06:39:25.941 INFO:teuthology.orchestra.run.smithi070.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-06T06:39:25.964 INFO:teuthology.orchestra.run.smithi070.stdout:Generating grub configuration file ... 2024-05-06T06:39:26.130 DEBUG:teuthology.orchestra.run.smithi184:> dpkg -s linux-image-generic 2024-05-06T06:39:26.149 INFO:teuthology.orchestra.run.smithi184.stdout:Package: linux-image-generic 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout:Status: install ok installed 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout:Priority: optional 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout:Section: kernel 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout:Installed-Size: 21 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout:Maintainer: Ubuntu Kernel Team 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: amd64 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout:Source: linux-meta 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout:Version: 5.15.0.105.102 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout:Recommends: thermald 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout:Description: Generic Linux kernel image 2024-05-06T06:39:26.150 INFO:teuthology.orchestra.run.smithi184.stdout: This package will always depend on the latest generic kernel image 2024-05-06T06:39:26.151 INFO:teuthology.orchestra.run.smithi184.stdout: available. 2024-05-06T06:39:26.151 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-05-06T06:39:26.151 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-06T06:39:26.151 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-06T06:39:26.151 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-06T06:39:26.151 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=None, version=distro) 2024-05-06T06:39:26.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get clean 2024-05-06T06:39:26.235 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-05-06T06:39:26.256 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-05-06T06:39:26.323 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2024-05-06T06:39:26.470 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-06T06:39:26.471 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-06T06:39:26.475 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-06T06:39:26.503 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-06T06:39:26.569 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-06T06:39:26.575 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-06T06:39:26.643 INFO:teuthology.orchestra.run.smithi070.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-06T06:39:26.649 INFO:teuthology.orchestra.run.smithi070.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-06T06:39:26.834 INFO:teuthology.orchestra.run.smithi070.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-06T06:39:26.834 INFO:teuthology.orchestra.run.smithi070.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-06T06:39:26.834 INFO:teuthology.orchestra.run.smithi070.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-06T06:39:26.870 INFO:teuthology.orchestra.run.smithi070.stdout:done 2024-05-06T06:39:27.296 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-05-06T06:39:27.327 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.105.102 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-05-06T06:39:27.328 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-05-06T06:39:27.329 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-05-06T06:39:27.329 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-06T06:39:27.329 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-06T06:39:27.329 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-06T06:39:27.329 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-05-06T06:39:27.329 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get clean 2024-05-06T06:39:27.521 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-05-06T06:39:27.776 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-06T06:39:27.776 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-06T06:39:27.832 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-05-06T06:39:27.840 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-06T06:39:27.850 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-06T06:39:27.912 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-05-06T06:39:27.923 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-06T06:39:28.113 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2024-05-06T06:39:28.113 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2024-05-06T06:39:28.290 INFO:teuthology.orchestra.run.smithi184.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-05-06T06:39:28.290 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2024-05-06T06:39:28.290 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-06T06:39:28.290 INFO:teuthology.orchestra.run.smithi184.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-06T06:39:28.290 INFO:teuthology.orchestra.run.smithi184.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-06T06:39:28.291 INFO:teuthology.orchestra.run.smithi184.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-06T06:39:28.291 INFO:teuthology.orchestra.run.smithi184.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-06T06:39:28.291 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-06T06:39:28.333 INFO:teuthology.orchestra.run.smithi184.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-06T06:39:28.334 DEBUG:teuthology.orchestra.run.smithi184:> dpkg -s linux-image-generic 2024-05-06T06:39:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:Package: linux-image-generic 2024-05-06T06:39:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:Status: install ok installed 2024-05-06T06:39:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:Priority: optional 2024-05-06T06:39:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:Section: kernel 2024-05-06T06:39:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:Installed-Size: 21 2024-05-06T06:39:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:Maintainer: Ubuntu Kernel Team 2024-05-06T06:39:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: amd64 2024-05-06T06:39:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:Source: linux-meta 2024-05-06T06:39:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:Version: 5.15.0.105.102 2024-05-06T06:39:28.351 INFO:teuthology.orchestra.run.smithi184.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-06T06:39:28.351 INFO:teuthology.orchestra.run.smithi184.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-06T06:39:28.351 INFO:teuthology.orchestra.run.smithi184.stdout:Recommends: thermald 2024-05-06T06:39:28.351 INFO:teuthology.orchestra.run.smithi184.stdout:Description: Generic Linux kernel image 2024-05-06T06:39:28.351 INFO:teuthology.orchestra.run.smithi184.stdout: This package will always depend on the latest generic kernel image 2024-05-06T06:39:28.351 INFO:teuthology.orchestra.run.smithi184.stdout: available. 2024-05-06T06:39:28.351 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-05-06T06:39:28.397 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.kJjaG1TqlQ 2024-05-06T06:39:28.398 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub/grub.cfg /tmp/tmp.kJjaG1TqlQ 2024-05-06T06:39:28.455 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.kJjaG1TqlQ 2024-05-06T06:39:28.574 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.kJjaG1TqlQ is 10KB 2024-05-06T06:39:28.587 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.kJjaG1TqlQ 2024-05-06T06:39:28.593 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-06T06:39:28.645 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:39:28.645 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-06T06:39:28.645 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-06T06:39:28.709 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-05-06T06:39:28.709 DEBUG:teuthology.orchestra.run.smithi184:> sudo update-grub 2024-05-06T06:39:29.141 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-05-06T06:39:29.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-06T06:39:29.220 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-05-06T06:39:29.420 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-05-06T06:39:29.421 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-05-06T06:39:29.601 INFO:teuthology.orchestra.run.smithi070.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-05-06T06:39:29.601 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-05-06T06:39:29.601 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-06T06:39:29.601 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-06T06:39:29.601 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-06T06:39:29.602 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-06T06:39:29.602 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-06T06:39:29.602 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-06T06:39:29.644 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-06T06:39:29.646 DEBUG:teuthology.orchestra.run.smithi070:> dpkg -s linux-image-generic 2024-05-06T06:39:29.662 INFO:teuthology.orchestra.run.smithi070.stdout:Package: linux-image-generic 2024-05-06T06:39:29.662 INFO:teuthology.orchestra.run.smithi070.stdout:Status: install ok installed 2024-05-06T06:39:29.662 INFO:teuthology.orchestra.run.smithi070.stdout:Priority: optional 2024-05-06T06:39:29.662 INFO:teuthology.orchestra.run.smithi070.stdout:Section: kernel 2024-05-06T06:39:29.662 INFO:teuthology.orchestra.run.smithi070.stdout:Installed-Size: 21 2024-05-06T06:39:29.662 INFO:teuthology.orchestra.run.smithi070.stdout:Maintainer: Ubuntu Kernel Team 2024-05-06T06:39:29.662 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: amd64 2024-05-06T06:39:29.662 INFO:teuthology.orchestra.run.smithi070.stdout:Source: linux-meta 2024-05-06T06:39:29.663 INFO:teuthology.orchestra.run.smithi070.stdout:Version: 5.15.0.105.102 2024-05-06T06:39:29.663 INFO:teuthology.orchestra.run.smithi070.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-06T06:39:29.663 INFO:teuthology.orchestra.run.smithi070.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-06T06:39:29.663 INFO:teuthology.orchestra.run.smithi070.stdout:Recommends: thermald 2024-05-06T06:39:29.663 INFO:teuthology.orchestra.run.smithi070.stdout:Description: Generic Linux kernel image 2024-05-06T06:39:29.663 INFO:teuthology.orchestra.run.smithi070.stdout: This package will always depend on the latest generic kernel image 2024-05-06T06:39:29.663 INFO:teuthology.orchestra.run.smithi070.stdout: available. 2024-05-06T06:39:29.663 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-05-06T06:39:29.707 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.1Q6TGHwYsB 2024-05-06T06:39:29.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub/grub.cfg /tmp/tmp.1Q6TGHwYsB 2024-05-06T06:39:29.763 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.1Q6TGHwYsB 2024-05-06T06:39:29.834 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub' 2024-05-06T06:39:29.836 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-06T06:39:29.837 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2024-05-06T06:39:29.872 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.1Q6TGHwYsB is 10KB 2024-05-06T06:39:29.884 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.1Q6TGHwYsB 2024-05-06T06:39:29.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-06T06:39:29.946 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:39:29.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-06T06:39:29.946 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-06T06:39:30.022 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-05-06T06:39:30.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo update-grub 2024-05-06T06:39:30.025 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-05-06T06:39:30.032 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-05-06T06:39:30.269 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-06T06:39:30.275 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-06T06:39:30.319 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-06T06:39:30.322 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-06T06:39:30.447 INFO:teuthology.orchestra.run.smithi184.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-06T06:39:30.447 INFO:teuthology.orchestra.run.smithi184.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-06T06:39:30.448 INFO:teuthology.orchestra.run.smithi184.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-06T06:39:30.459 INFO:teuthology.orchestra.run.smithi184.stderr:done 2024-05-06T06:39:30.477 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2024-05-06T06:39:31.249 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub' 2024-05-06T06:39:31.250 INFO:teuthology.orchestra.run.smithi070.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-06T06:39:31.253 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-05-06T06:39:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-05-06T06:39:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-05-06T06:39:31.698 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-06T06:39:31.704 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-06T06:39:31.743 INFO:teuthology.orchestra.run.smithi070.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-06T06:39:31.748 INFO:teuthology.orchestra.run.smithi070.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-06T06:39:31.859 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-06T06:39:31.859 INFO:teuthology.orchestra.run.smithi070.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-06T06:39:31.859 INFO:teuthology.orchestra.run.smithi070.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-06T06:39:31.872 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-05-06T06:39:31.881 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-05-06T06:40:00.506 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-06T06:40:00.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-05-06T06:40:00.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T06:40:01.885 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-06T06:40:01.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-06T06:40:01.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T06:40:18.979 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-05-06T06:40:20.254 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-05-06T06:40:27.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-05-06T06:40:27.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T06:40:29.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-06T06:40:29.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T06:40:31.038 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-05-06T06:40:32.322 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-05-06T06:40:43.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-05-06T06:40:43.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T06:40:44.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-06T06:40:44.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T06:41:01.474 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-05-06T06:41:02.750 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-05-06T06:41:16.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-05-06T06:41:16.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T06:41:16.718 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-05-06T06:41:17.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-05-06T06:41:17.179 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-05-06T06:41:17.179 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-05-06T06:41:17.225 INFO:teuthology.orchestra.run.smithi184.stdout:5.15.0-105-generic 2024-05-06T06:41:17.225 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-05-06T06:41:17.225 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-06T06:41:17.225 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-06T06:41:17.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-06T06:41:17.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T06:41:18.136 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-05-06T06:41:18.227 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-06T06:41:18.227 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-06T06:41:18.317 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2024-05-06T06:41:18.355 DEBUG:teuthology.parallel:result is None 2024-05-06T06:41:18.915 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-06T06:41:18.915 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-05-06T06:41:18.915 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-05-06T06:41:18.963 INFO:teuthology.orchestra.run.smithi070.stdout:5.15.0-105-generic 2024-05-06T06:41:18.963 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-05-06T06:41:18.963 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-06T06:41:18.963 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-06T06:41:19.964 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-06T06:41:19.964 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-06T06:41:20.071 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-05-06T06:41:20.093 DEBUG:teuthology.parallel:result is None 2024-05-06T06:41:20.093 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-06T06:41:20.101 INFO:teuthology.task.internal:Creating test directory... 2024-05-06T06:41:20.101 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-06T06:41:20.104 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-06T06:41:20.110 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-06T06:41:20.117 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-06T06:41:20.124 INFO:teuthology.task.internal:Creating archive directory... 2024-05-06T06:41:20.124 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-06T06:41:20.152 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-06T06:41:20.380 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-06T06:41:20.388 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-06T06:41:20.389 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-06T06:41:20.391 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-06T06:41:20.412 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T06:41:20.422 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T06:41:20.426 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T06:41:20.436 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-06T06:41:20.437 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-06T06:41:20.445 INFO:teuthology.task.internal:Configuring sudo... 2024-05-06T06:41:20.445 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-06T06:41:20.484 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-06T06:41:20.498 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-06T06:41:20.507 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-06T06:41:20.507 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-06T06:41:20.540 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-06T06:41:20.546 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T06:41:20.591 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T06:41:20.640 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:41:20.640 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-06T06:41:20.695 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-06T06:41:20.701 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-06T06:41:20.750 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:41:20.751 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-06T06:41:20.822 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-05-06T06:41:20.824 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-05-06T06:41:20.901 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-06T06:41:20.909 INFO:teuthology.task.internal:Starting timer... 2024-05-06T06:41:20.909 INFO:teuthology.run_tasks:Running task pcp... 2024-05-06T06:41:20.924 INFO:teuthology.run_tasks:Running task selinux... 2024-05-06T06:41:20.933 DEBUG:teuthology.task.selinux:Excluding smithi070: OS 'ubuntu' does not support SELinux 2024-05-06T06:41:20.933 DEBUG:teuthology.task.selinux:Excluding smithi184: OS 'ubuntu' does not support SELinux 2024-05-06T06:41:20.933 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-06T06:41:20.934 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-06T06:41:20.934 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-06T06:41:20.934 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-06T06:41:20.943 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-06T06:41:20.950 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-06T06:41:21.126 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-06T06:41:21.144 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-06T06:41:21.145 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-06T06:48:25.376 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2024-05-06T06:48:25.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-06T06:48:25.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T06:48:25.464 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-05-06T06:48:25.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-06T06:48:25.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-05-06T06:48:25.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-06T06:48:25.625 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-05-06T06:48:25.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-05-06T06:48:25.702 INFO:teuthology.run_tasks:Running task clock... 2024-05-06T06:48:25.713 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-06T06:48:25.713 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-06T06:48:25.713 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T06:48:25.716 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-06T06:48:25.716 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T06:48:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-06T06:48:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: Command line: ntpd -gq 2024-05-06T06:48:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: ---------------------------------------------------- 2024-05-06T06:48:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: ntp-4 is maintained by Network Time Foundation, 2024-05-06T06:48:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-06T06:48:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: corporation. Support and training for ntp-4 are 2024-05-06T06:48:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: available at https://www.nwtime.org/support 2024-05-06T06:48:25.743 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: ---------------------------------------------------- 2024-05-06T06:48:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: proto: precision = 0.061 usec (-24) 2024-05-06T06:48:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: basedate set to 2022-02-04 2024-05-06T06:48:25.744 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: gps base set to 2022-02-06 (week 2196) 2024-05-06T06:48:25.744 INFO:teuthology.orchestra.run.smithi070.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-06T06:48:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-06T06:48:25.745 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: restrict ::: KOD does nothing without LIMITED. 2024-05-06T06:48:25.745 INFO:teuthology.orchestra.run.smithi070.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-06T06:48:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: Listen and drop on 0 v6wildcard [::]:123 2024-05-06T06:48:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-06T06:48:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: Listen normally on 2 lo 127.0.0.1:123 2024-05-06T06:48:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: Listen normally on 3 enp3s0f1 172.21.15.70:123 2024-05-06T06:48:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: Listen normally on 4 lo [::1]:123 2024-05-06T06:48:25.746 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3e7%5]:123 2024-05-06T06:48:25.747 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:25 ntpd[17232]: Listening on routing socket on fd #22 for interface updates 2024-05-06T06:48:25.773 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-06T06:48:25.773 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: Command line: ntpd -gq 2024-05-06T06:48:25.774 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: ---------------------------------------------------- 2024-05-06T06:48:25.774 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: ntp-4 is maintained by Network Time Foundation, 2024-05-06T06:48:25.774 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-06T06:48:25.774 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: corporation. Support and training for ntp-4 are 2024-05-06T06:48:25.774 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: available at https://www.nwtime.org/support 2024-05-06T06:48:25.774 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: ---------------------------------------------------- 2024-05-06T06:48:25.774 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: proto: precision = 0.044 usec (-24) 2024-05-06T06:48:25.775 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: basedate set to 2022-02-04 2024-05-06T06:48:25.775 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: gps base set to 2022-02-06 (week 2196) 2024-05-06T06:48:25.775 INFO:teuthology.orchestra.run.smithi184.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-06T06:48:25.775 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-06T06:48:25.775 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: restrict ::: KOD does nothing without LIMITED. 2024-05-06T06:48:25.776 INFO:teuthology.orchestra.run.smithi184.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-06T06:48:25.777 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: Listen and drop on 0 v6wildcard [::]:123 2024-05-06T06:48:25.777 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-06T06:48:25.777 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: Listen normally on 2 lo 127.0.0.1:123 2024-05-06T06:48:25.777 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: Listen normally on 3 enp3s0f1 172.21.15.184:123 2024-05-06T06:48:25.777 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: Listen normally on 4 lo [::1]:123 2024-05-06T06:48:25.777 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7b8f%5]:123 2024-05-06T06:48:25.777 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:25 ntpd[17298]: Listening on routing socket on fd #22 for interface updates 2024-05-06T06:48:26.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:26 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:26.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:26 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:27.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:27 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:27.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:27 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:27.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:27 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:27.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:27 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:27.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:27 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:27.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:27 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:27.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:27 ntpd[17298]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:27.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:27 ntpd[17298]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:27.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:27 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:27.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:27 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:27.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:27 ntpd[17298]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:27.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:27 ntpd[17298]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:28.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:28 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:28.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:28 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:28.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:28 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:28.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:28 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:28.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:28 ntpd[17298]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:28.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:28 ntpd[17298]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:29.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:29 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:29.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:29 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:29.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:29 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:29.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:29 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:29.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:29 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:29.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:29 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:29.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:29 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:29.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:29 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:29.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:29 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:29.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:29 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:29.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:29 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:29.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:29 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:29.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:29 ntpd[17298]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:29.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:29 ntpd[17298]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:29.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:29 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:29.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:29 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:29.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:29 ntpd[17298]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:29.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:29 ntpd[17298]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:30.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:30.746 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:30 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:30.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:30 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:30.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:30 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:30.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:30 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:30.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:30 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:30.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:30 ntpd[17298]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:30.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:30 ntpd[17298]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:31.743 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:31 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:31.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:31 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:31.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:31 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:31.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:31 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:31.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:31 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:31.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:31 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:31.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:31 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:31.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:31 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:31.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:31 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:31.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:31 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:31.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:31 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:31.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:31 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:31.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:31 ntpd[17298]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:31.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:31 ntpd[17298]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:31.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:31 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:31.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:31 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:31.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:31 ntpd[17298]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:31.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:31 ntpd[17298]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:32.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:32 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:32.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:32 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:32.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:32 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:32.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:32 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:32.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:32 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:32.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:32 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:32.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:32 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:32.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:32 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:32.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:32 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:32.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:32 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:32.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:32 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:32.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:32 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:32.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:32 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:32.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:32 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:32.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:32 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:32.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:32 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:32.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:32 ntpd[17298]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:32.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:32 ntpd[17298]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:33.743 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:33 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:33.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:33 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:33.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:33 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:33.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:33 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:33.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:33 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:33.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:33 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:33.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:33 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:33.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:33 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:33.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:33 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:33.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:33 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:33.774 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:33 ntpd[17298]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:33.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:33 ntpd[17298]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:33.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:33 ntpd[17298]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:33.775 INFO:teuthology.orchestra.run.smithi184.stdout: 6 May 06:48:33 ntpd[17298]: ntpd: time slew -0.000829 s 2024-05-06T06:48:33.775 INFO:teuthology.orchestra.run.smithi184.stdout:ntpd: time slew -0.000829s 2024-05-06T06:48:33.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:33 ntpd[17298]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:33.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:33 ntpd[17298]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-06T06:48:33.775 INFO:teuthology.orchestra.run.smithi184.stderr: 6 May 06:48:33 ntpd[17298]: can't open /var/log/ntpstats/loopstats.20240506: Permission denied 2024-05-06T06:48:33.819 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2024-05-06T06:48:33.819 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2024-05-06T06:48:33.819 INFO:teuthology.orchestra.run.smithi184.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-06T06:48:33.819 INFO:teuthology.orchestra.run.smithi184.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-06T06:48:33.820 INFO:teuthology.orchestra.run.smithi184.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-06T06:48:33.820 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-06T06:48:34.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:34 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:34.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:34 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:34.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:34 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:34.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:34 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:34.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:34 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:34.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:34 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:34.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:34 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:34.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:34 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:34.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:34 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:34.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:34 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:34.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:34 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:34.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:34 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:35.743 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:35 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:35.743 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:35 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:35.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:35 ntpd[17232]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-06T06:48:35.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:35 ntpd[17232]: can't open /var/log/ntpstats/rawstats.20240506: Permission denied 2024-05-06T06:48:35.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:35 ntpd[17232]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-06T06:48:35.744 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:35 ntpd[17232]: can't open /var/log/ntpstats/peerstats.20240506: Permission denied 2024-05-06T06:48:35.744 INFO:teuthology.orchestra.run.smithi070.stdout: 6 May 06:48:35 ntpd[17232]: ntpd: time slew -0.000739 s 2024-05-06T06:48:35.744 INFO:teuthology.orchestra.run.smithi070.stdout:ntpd: time slew -0.000739s 2024-05-06T06:48:35.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:35 ntpd[17232]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-06T06:48:35.745 INFO:teuthology.orchestra.run.smithi070.stderr: 6 May 06:48:35 ntpd[17232]: can't open /var/log/ntpstats/loopstats.20240506: Permission denied 2024-05-06T06:48:35.805 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-05-06T06:48:35.805 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-05-06T06:48:35.805 INFO:teuthology.orchestra.run.smithi070.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-06T06:48:35.806 INFO:teuthology.orchestra.run.smithi070.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-06T06:48:35.806 INFO:teuthology.orchestra.run.smithi070.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-06T06:48:35.806 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-06T06:48:35.807 INFO:teuthology.run_tasks:Running task install... 2024-05-06T06:48:35.820 DEBUG:teuthology.task.install:project ceph 2024-05-06T06:48:35.820 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e08cbbf6fd79a8dd2949f340bce25e28ea3db004'}} 2024-05-06T06:48:35.820 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'flavor': 'default', 'sha1': 'e08cbbf6fd79a8dd2949f340bce25e28ea3db004'} 2024-05-06T06:48:35.820 INFO:teuthology.task.install:Using flavor: default 2024-05-06T06:48:35.826 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-06T06:48:35.826 INFO:teuthology.task.install:extra packages: [] 2024-05-06T06:48:35.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-key list | grep Ceph 2024-05-06T06:48:35.827 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-key list | grep Ceph 2024-05-06T06:48:35.892 INFO:teuthology.orchestra.run.smithi184.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-06T06:48:35.906 INFO:teuthology.orchestra.run.smithi070.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-06T06:48:35.919 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-06T06:48:35.919 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph.com (release key) 2024-05-06T06:48:35.920 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-06T06:48:35.920 INFO:teuthology.task.install.deb:Installing system (non-project) packages: sqlite3 on remote deb x86_64 2024-05-06T06:48:35.921 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e08cbbf6fd79a8dd2949f340bce25e28ea3db004 2024-05-06T06:48:35.931 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-06T06:48:35.931 INFO:teuthology.orchestra.run.smithi070.stdout:uid [ unknown] Ceph.com (release key) 2024-05-06T06:48:35.932 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-06T06:48:35.932 INFO:teuthology.task.install.deb:Installing system (non-project) packages: sqlite3 on remote deb x86_64 2024-05-06T06:48:35.932 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e08cbbf6fd79a8dd2949f340bce25e28ea3db004 2024-05-06T06:48:36.087 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default/ 2024-05-06T06:48:36.087 INFO:teuthology.task.install.deb:Package version is 19.0.0-3516-ge08cbbf6-1jammy 2024-05-06T06:48:36.198 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:48:36.198 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-06T06:48:36.212 DEBUG:teuthology.orchestra.run.smithi070:> sudo apt-get update 2024-05-06T06:48:36.261 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default/ 2024-05-06T06:48:36.261 INFO:teuthology.task.install.deb:Package version is 19.0.0-3516-ge08cbbf6-1jammy 2024-05-06T06:48:36.394 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-06T06:48:36.394 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-06T06:48:36.406 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-06T06:48:36.426 INFO:teuthology.orchestra.run.smithi070.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-06T06:48:36.432 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy InRelease 2024-05-06T06:48:36.452 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:48:36.452 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-06T06:48:36.453 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-06T06:48:36.466 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2024-05-06T06:48:36.475 INFO:teuthology.orchestra.run.smithi070.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-06T06:48:36.496 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-06T06:48:36.523 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,399 B] 2024-05-06T06:48:36.640 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-06T06:48:36.686 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy InRelease 2024-05-06T06:48:36.707 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-06T06:48:36.728 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-06T06:48:36.734 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 29.2 kB in 0s (84.6 kB/s) 2024-05-06T06:48:36.750 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,399 B] 2024-05-06T06:48:36.756 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-06T06:48:36.777 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-06T06:48:36.835 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-06T06:48:36.922 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-06T06:48:37.068 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 29.2 kB in 0s (70.3 kB/s) 2024-05-06T06:48:37.692 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-05-06T06:48:37.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3516-ge08cbbf6-1jammy cephadm=19.0.0-3516-ge08cbbf6-1jammy ceph-mds=19.0.0-3516-ge08cbbf6-1jammy ceph-mgr=19.0.0-3516-ge08cbbf6-1jammy ceph-common=19.0.0-3516-ge08cbbf6-1jammy ceph-fuse=19.0.0-3516-ge08cbbf6-1jammy ceph-test=19.0.0-3516-ge08cbbf6-1jammy ceph-volume=19.0.0-3516-ge08cbbf6-1jammy radosgw=19.0.0-3516-ge08cbbf6-1jammy python3-rados=19.0.0-3516-ge08cbbf6-1jammy python3-rgw=19.0.0-3516-ge08cbbf6-1jammy python3-cephfs=19.0.0-3516-ge08cbbf6-1jammy python3-rbd=19.0.0-3516-ge08cbbf6-1jammy libcephfs2=19.0.0-3516-ge08cbbf6-1jammy libcephfs-dev=19.0.0-3516-ge08cbbf6-1jammy librados2=19.0.0-3516-ge08cbbf6-1jammy librbd1=19.0.0-3516-ge08cbbf6-1jammy rbd-fuse=19.0.0-3516-ge08cbbf6-1jammy 2024-05-06T06:48:37.759 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-05-06T06:48:37.935 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-05-06T06:48:37.935 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-05-06T06:48:37.989 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-05-06T06:48:38.004 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3516-ge08cbbf6-1jammy cephadm=19.0.0-3516-ge08cbbf6-1jammy ceph-mds=19.0.0-3516-ge08cbbf6-1jammy ceph-mgr=19.0.0-3516-ge08cbbf6-1jammy ceph-common=19.0.0-3516-ge08cbbf6-1jammy ceph-fuse=19.0.0-3516-ge08cbbf6-1jammy ceph-test=19.0.0-3516-ge08cbbf6-1jammy ceph-volume=19.0.0-3516-ge08cbbf6-1jammy radosgw=19.0.0-3516-ge08cbbf6-1jammy python3-rados=19.0.0-3516-ge08cbbf6-1jammy python3-rgw=19.0.0-3516-ge08cbbf6-1jammy python3-cephfs=19.0.0-3516-ge08cbbf6-1jammy python3-rbd=19.0.0-3516-ge08cbbf6-1jammy libcephfs2=19.0.0-3516-ge08cbbf6-1jammy libcephfs-dev=19.0.0-3516-ge08cbbf6-1jammy librados2=19.0.0-3516-ge08cbbf6-1jammy librbd1=19.0.0-3516-ge08cbbf6-1jammy rbd-fuse=19.0.0-3516-ge08cbbf6-1jammy 2024-05-06T06:48:38.064 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-05-06T06:48:38.107 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-05-06T06:48:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-06T06:48:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-06T06:48:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-06T06:48:38.107 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-06T06:48:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-06T06:48:38.108 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-06T06:48:38.108 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-05-06T06:48:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-06T06:48:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-06T06:48:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-06T06:48:38.108 INFO:teuthology.orchestra.run.smithi070.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-06T06:48:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-06T06:48:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-06T06:48:38.109 INFO:teuthology.orchestra.run.smithi070.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-06T06:48:38.110 INFO:teuthology.orchestra.run.smithi070.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-06T06:48:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-06T06:48:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-06T06:48:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet zip 2024-05-06T06:48:38.111 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-05-06T06:48:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-06T06:48:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-06T06:48:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-06T06:48:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-06T06:48:38.111 INFO:teuthology.orchestra.run.smithi070.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-06T06:48:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-06T06:48:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-06T06:48:38.112 INFO:teuthology.orchestra.run.smithi070.stdout:Recommended packages: 2024-05-06T06:48:38.112 INFO:teuthology.orchestra.run.smithi070.stdout: btrfs-tools 2024-05-06T06:48:38.208 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-05-06T06:48:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-06T06:48:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-06T06:48:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-06T06:48:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-06T06:48:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-06T06:48:38.208 INFO:teuthology.orchestra.run.smithi070.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-06T06:48:38.209 INFO:teuthology.orchestra.run.smithi070.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-06T06:48:38.210 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-06T06:48:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-06T06:48:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-06T06:48:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-06T06:48:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-06T06:48:38.211 INFO:teuthology.orchestra.run.smithi070.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-06T06:48:38.276 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2024-05-06T06:48:38.276 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2024-05-06T06:48:38.350 INFO:teuthology.orchestra.run.smithi070.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-06T06:48:38.350 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 181 MB of archives. 2024-05-06T06:48:38.350 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 829 MB of additional disk space will be used. 2024-05-06T06:48:38.351 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3516-ge08cbbf6-1jammy [3,555 kB] 2024-05-06T06:48:38.399 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-06T06:48:38.469 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2024-05-06T06:48:38.469 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-06T06:48:38.469 INFO:teuthology.orchestra.run.smithi184.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-06T06:48:38.469 INFO:teuthology.orchestra.run.smithi184.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-06T06:48:38.470 INFO:teuthology.orchestra.run.smithi184.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-06T06:48:38.470 INFO:teuthology.orchestra.run.smithi184.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-06T06:48:38.470 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-06T06:48:38.470 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2024-05-06T06:48:38.470 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-06T06:48:38.471 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-06T06:48:38.472 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-06T06:48:38.473 INFO:teuthology.orchestra.run.smithi184.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-06T06:48:38.473 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-06T06:48:38.473 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-06T06:48:38.473 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-06T06:48:38.473 INFO:teuthology.orchestra.run.smithi184.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-06T06:48:38.473 INFO:teuthology.orchestra.run.smithi184.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-06T06:48:38.473 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-06T06:48:38.473 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-06T06:48:38.473 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet zip 2024-05-06T06:48:38.474 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2024-05-06T06:48:38.474 INFO:teuthology.orchestra.run.smithi184.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-06T06:48:38.474 INFO:teuthology.orchestra.run.smithi184.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-06T06:48:38.474 INFO:teuthology.orchestra.run.smithi184.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-06T06:48:38.474 INFO:teuthology.orchestra.run.smithi184.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-06T06:48:38.474 INFO:teuthology.orchestra.run.smithi184.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-06T06:48:38.474 INFO:teuthology.orchestra.run.smithi184.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-06T06:48:38.474 INFO:teuthology.orchestra.run.smithi184.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-06T06:48:38.474 INFO:teuthology.orchestra.run.smithi184.stdout:Recommended packages: 2024-05-06T06:48:38.474 INFO:teuthology.orchestra.run.smithi184.stdout: btrfs-tools 2024-05-06T06:48:38.572 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2024-05-06T06:48:38.572 INFO:teuthology.orchestra.run.smithi184.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-06T06:48:38.572 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-06T06:48:38.572 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-06T06:48:38.572 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-06T06:48:38.572 INFO:teuthology.orchestra.run.smithi184.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-06T06:48:38.572 INFO:teuthology.orchestra.run.smithi184.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-06T06:48:38.573 INFO:teuthology.orchestra.run.smithi184.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-06T06:48:38.574 INFO:teuthology.orchestra.run.smithi184.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-06T06:48:38.574 INFO:teuthology.orchestra.run.smithi184.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-06T06:48:38.574 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-06T06:48:38.574 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-06T06:48:38.574 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-06T06:48:38.574 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-06T06:48:38.574 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-06T06:48:38.574 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-06T06:48:38.574 INFO:teuthology.orchestra.run.smithi184.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-06T06:48:38.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-06T06:48:38.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-06T06:48:38.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-06T06:48:38.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-06T06:48:38.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-06T06:48:38.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-06T06:48:38.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-06T06:48:38.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-06T06:48:38.575 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-06T06:48:38.575 INFO:teuthology.orchestra.run.smithi184.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-06T06:48:38.611 INFO:teuthology.orchestra.run.smithi070.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3516-ge08cbbf6-1jammy [3,224 kB] 2024-05-06T06:48:38.638 INFO:teuthology.orchestra.run.smithi184.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-06T06:48:38.638 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 181 MB of archives. 2024-05-06T06:48:38.638 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 829 MB of additional disk space will be used. 2024-05-06T06:48:38.638 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-06T06:48:38.712 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3516-ge08cbbf6-1jammy [3,555 kB] 2024-05-06T06:48:38.723 INFO:teuthology.orchestra.run.smithi070.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3516-ge08cbbf6-1jammy [714 kB] 2024-05-06T06:48:38.745 INFO:teuthology.orchestra.run.smithi070.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3516-ge08cbbf6-1jammy [356 kB] 2024-05-06T06:48:38.745 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-06T06:48:38.747 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-06T06:48:38.760 INFO:teuthology.orchestra.run.smithi070.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3516-ge08cbbf6-1jammy [32.8 kB] 2024-05-06T06:48:38.761 INFO:teuthology.orchestra.run.smithi070.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3516-ge08cbbf6-1jammy [180 kB] 2024-05-06T06:48:38.767 INFO:teuthology.orchestra.run.smithi070.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3516-ge08cbbf6-1jammy [67.4 kB] 2024-05-06T06:48:38.768 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-06T06:48:38.769 INFO:teuthology.orchestra.run.smithi070.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3516-ge08cbbf6-1jammy [330 kB] 2024-05-06T06:48:38.787 INFO:teuthology.orchestra.run.smithi070.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3516-ge08cbbf6-1jammy [6,894 kB] 2024-05-06T06:48:38.825 INFO:teuthology.orchestra.run.smithi070.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-06T06:48:38.834 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-06T06:48:38.839 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-06T06:48:38.846 INFO:teuthology.orchestra.run.smithi070.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-06T06:48:38.851 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-06T06:48:38.856 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-06T06:48:38.856 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-06T06:48:38.857 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-06T06:48:38.865 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-06T06:48:38.868 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-06T06:48:38.870 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-06T06:48:38.871 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-06T06:48:38.881 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-06T06:48:38.883 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-06T06:48:38.886 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-06T06:48:38.887 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-06T06:48:38.902 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-06T06:48:38.902 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-06T06:48:38.903 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-06T06:48:38.903 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-06T06:48:38.904 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-06T06:48:38.904 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-06T06:48:38.925 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-06T06:48:38.926 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-06T06:48:38.926 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-06T06:48:38.929 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-06T06:48:38.936 INFO:teuthology.orchestra.run.smithi070.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-06T06:48:38.946 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-06T06:48:38.947 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-06T06:48:38.947 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-06T06:48:38.948 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-06T06:48:38.948 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-06T06:48:38.949 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-06T06:48:38.966 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-06T06:48:38.967 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-06T06:48:38.968 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-06T06:48:38.973 INFO:teuthology.orchestra.run.smithi184.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-06T06:48:38.987 INFO:teuthology.orchestra.run.smithi184.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-06T06:48:38.988 INFO:teuthology.orchestra.run.smithi184.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-06T06:48:38.988 INFO:teuthology.orchestra.run.smithi184.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-06T06:48:38.989 INFO:teuthology.orchestra.run.smithi184.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-06T06:48:38.991 INFO:teuthology.orchestra.run.smithi184.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-06T06:48:38.992 INFO:teuthology.orchestra.run.smithi184.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-06T06:48:39.008 INFO:teuthology.orchestra.run.smithi184.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-06T06:48:39.008 INFO:teuthology.orchestra.run.smithi184.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-06T06:48:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-06T06:48:39.011 INFO:teuthology.orchestra.run.smithi184.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-06T06:48:39.029 INFO:teuthology.orchestra.run.smithi184.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-06T06:48:39.031 INFO:teuthology.orchestra.run.smithi184.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-06T06:48:39.086 INFO:teuthology.orchestra.run.smithi184.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-06T06:48:39.086 INFO:teuthology.orchestra.run.smithi184.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-06T06:48:39.088 INFO:teuthology.orchestra.run.smithi184.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-06T06:48:39.088 INFO:teuthology.orchestra.run.smithi184.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-06T06:48:39.090 INFO:teuthology.orchestra.run.smithi184.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-06T06:48:39.114 INFO:teuthology.orchestra.run.smithi184.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-06T06:48:39.116 INFO:teuthology.orchestra.run.smithi184.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-06T06:48:39.117 INFO:teuthology.orchestra.run.smithi184.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-06T06:48:39.120 INFO:teuthology.orchestra.run.smithi070.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3516-ge08cbbf6-1jammy [112 kB] 2024-05-06T06:48:39.123 INFO:teuthology.orchestra.run.smithi070.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3516-ge08cbbf6-1jammy [466 kB] 2024-05-06T06:48:39.135 INFO:teuthology.orchestra.run.smithi070.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3516-ge08cbbf6-1jammy [25.8 MB] 2024-05-06T06:48:39.137 INFO:teuthology.orchestra.run.smithi184.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-06T06:48:39.137 INFO:teuthology.orchestra.run.smithi184.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-06T06:48:39.138 INFO:teuthology.orchestra.run.smithi184.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-06T06:48:39.138 INFO:teuthology.orchestra.run.smithi184.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-06T06:48:39.139 INFO:teuthology.orchestra.run.smithi184.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-06T06:48:39.139 INFO:teuthology.orchestra.run.smithi184.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-06T06:48:39.151 INFO:teuthology.orchestra.run.smithi184.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3516-ge08cbbf6-1jammy [3,224 kB] 2024-05-06T06:48:39.153 INFO:teuthology.orchestra.run.smithi184.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-06T06:48:39.154 INFO:teuthology.orchestra.run.smithi184.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-06T06:48:39.158 INFO:teuthology.orchestra.run.smithi184.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-06T06:48:39.174 INFO:teuthology.orchestra.run.smithi184.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-06T06:48:39.176 INFO:teuthology.orchestra.run.smithi184.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-06T06:48:39.176 INFO:teuthology.orchestra.run.smithi184.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-06T06:48:39.180 INFO:teuthology.orchestra.run.smithi184.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-06T06:48:39.183 INFO:teuthology.orchestra.run.smithi184.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-06T06:48:39.184 INFO:teuthology.orchestra.run.smithi184.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-06T06:48:39.184 INFO:teuthology.orchestra.run.smithi184.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-06T06:48:39.195 INFO:teuthology.orchestra.run.smithi184.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-06T06:48:39.195 INFO:teuthology.orchestra.run.smithi184.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-06T06:48:39.198 INFO:teuthology.orchestra.run.smithi184.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-06T06:48:39.215 INFO:teuthology.orchestra.run.smithi184.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-06T06:48:39.216 INFO:teuthology.orchestra.run.smithi184.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-06T06:48:39.216 INFO:teuthology.orchestra.run.smithi184.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-06T06:48:39.218 INFO:teuthology.orchestra.run.smithi184.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-06T06:48:39.218 INFO:teuthology.orchestra.run.smithi184.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-06T06:48:39.225 INFO:teuthology.orchestra.run.smithi184.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-06T06:48:39.225 INFO:teuthology.orchestra.run.smithi184.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-06T06:48:39.236 INFO:teuthology.orchestra.run.smithi184.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-06T06:48:39.238 INFO:teuthology.orchestra.run.smithi184.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-06T06:48:39.239 INFO:teuthology.orchestra.run.smithi184.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-06T06:48:39.250 INFO:teuthology.orchestra.run.smithi070.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-06T06:48:39.264 INFO:teuthology.orchestra.run.smithi070.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-06T06:48:39.305 INFO:teuthology.orchestra.run.smithi070.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-06T06:48:39.315 INFO:teuthology.orchestra.run.smithi070.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-06T06:48:39.316 INFO:teuthology.orchestra.run.smithi070.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-06T06:48:39.318 INFO:teuthology.orchestra.run.smithi070.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-06T06:48:39.349 INFO:teuthology.orchestra.run.smithi070.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-06T06:48:39.464 INFO:teuthology.orchestra.run.smithi184.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3516-ge08cbbf6-1jammy [714 kB] 2024-05-06T06:48:39.518 INFO:teuthology.orchestra.run.smithi070.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-06T06:48:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3516-ge08cbbf6-1jammy [356 kB] 2024-05-06T06:48:39.596 INFO:teuthology.orchestra.run.smithi184.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3516-ge08cbbf6-1jammy [32.8 kB] 2024-05-06T06:48:39.597 INFO:teuthology.orchestra.run.smithi184.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3516-ge08cbbf6-1jammy [180 kB] 2024-05-06T06:48:39.603 INFO:teuthology.orchestra.run.smithi184.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3516-ge08cbbf6-1jammy [67.4 kB] 2024-05-06T06:48:39.605 INFO:teuthology.orchestra.run.smithi184.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3516-ge08cbbf6-1jammy [330 kB] 2024-05-06T06:48:39.671 INFO:teuthology.orchestra.run.smithi184.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3516-ge08cbbf6-1jammy [6,894 kB] 2024-05-06T06:48:39.926 INFO:teuthology.orchestra.run.smithi070.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-06T06:48:39.964 INFO:teuthology.orchestra.run.smithi070.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-06T06:48:39.966 INFO:teuthology.orchestra.run.smithi070.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-06T06:48:40.042 INFO:teuthology.orchestra.run.smithi070.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-06T06:48:40.099 INFO:teuthology.orchestra.run.smithi070.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-06T06:48:40.120 INFO:teuthology.orchestra.run.smithi070.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-06T06:48:40.127 INFO:teuthology.orchestra.run.smithi070.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-06T06:48:40.128 INFO:teuthology.orchestra.run.smithi070.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-06T06:48:40.140 INFO:teuthology.orchestra.run.smithi070.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-06T06:48:40.140 INFO:teuthology.orchestra.run.smithi070.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-06T06:48:40.301 INFO:teuthology.orchestra.run.smithi184.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3516-ge08cbbf6-1jammy [112 kB] 2024-05-06T06:48:40.303 INFO:teuthology.orchestra.run.smithi184.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3516-ge08cbbf6-1jammy [466 kB] 2024-05-06T06:48:40.308 INFO:teuthology.orchestra.run.smithi070.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-06T06:48:40.338 INFO:teuthology.orchestra.run.smithi184.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3516-ge08cbbf6-1jammy [25.8 MB] 2024-05-06T06:48:40.393 INFO:teuthology.orchestra.run.smithi070.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-06T06:48:40.432 INFO:teuthology.orchestra.run.smithi070.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-06T06:48:40.447 INFO:teuthology.orchestra.run.smithi070.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-06T06:48:40.531 INFO:teuthology.orchestra.run.smithi070.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3516-ge08cbbf6-1jammy [5,095 kB] 2024-05-06T06:48:40.531 INFO:teuthology.orchestra.run.smithi070.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-06T06:48:40.697 INFO:teuthology.orchestra.run.smithi070.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-06T06:48:40.706 INFO:teuthology.orchestra.run.smithi070.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3516-ge08cbbf6-1jammy [244 kB] 2024-05-06T06:48:40.713 INFO:teuthology.orchestra.run.smithi070.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-06T06:48:40.721 INFO:teuthology.orchestra.run.smithi070.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-06T06:48:40.730 INFO:teuthology.orchestra.run.smithi070.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-06T06:48:40.732 INFO:teuthology.orchestra.run.smithi070.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3516-ge08cbbf6-1jammy [124 kB] 2024-05-06T06:48:40.736 INFO:teuthology.orchestra.run.smithi070.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3516-ge08cbbf6-1jammy [1,544 kB] 2024-05-06T06:48:40.767 INFO:teuthology.orchestra.run.smithi070.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-06T06:48:40.771 INFO:teuthology.orchestra.run.smithi070.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-06T06:48:40.808 INFO:teuthology.orchestra.run.smithi070.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3516-ge08cbbf6-1jammy [6,259 kB] 2024-05-06T06:48:40.937 INFO:teuthology.orchestra.run.smithi070.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-06T06:48:41.140 INFO:teuthology.orchestra.run.smithi070.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3516-ge08cbbf6-1jammy [22.8 MB] 2024-05-06T06:48:41.275 INFO:teuthology.orchestra.run.smithi070.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-06T06:48:41.310 INFO:teuthology.orchestra.run.smithi070.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-06T06:48:41.322 INFO:teuthology.orchestra.run.smithi070.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-06T06:48:41.547 INFO:teuthology.orchestra.run.smithi070.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-06T06:48:41.550 INFO:teuthology.orchestra.run.smithi070.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-06T06:48:41.555 INFO:teuthology.orchestra.run.smithi070.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-06T06:48:41.560 INFO:teuthology.orchestra.run.smithi070.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-06T06:48:41.580 INFO:teuthology.orchestra.run.smithi070.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-06T06:48:41.608 INFO:teuthology.orchestra.run.smithi070.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-06T06:48:41.613 INFO:teuthology.orchestra.run.smithi070.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-06T06:48:41.866 INFO:teuthology.orchestra.run.smithi070.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-06T06:48:42.203 INFO:teuthology.orchestra.run.smithi070.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-06T06:48:42.372 INFO:teuthology.orchestra.run.smithi070.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3516-ge08cbbf6-1jammy [14.0 kB] 2024-05-06T06:48:42.372 INFO:teuthology.orchestra.run.smithi070.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3516-ge08cbbf6-1jammy [870 kB] 2024-05-06T06:48:42.389 INFO:teuthology.orchestra.run.smithi070.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3516-ge08cbbf6-1jammy [2,439 kB] 2024-05-06T06:48:42.443 INFO:teuthology.orchestra.run.smithi070.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-06T06:48:42.465 INFO:teuthology.orchestra.run.smithi070.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-06T06:48:42.470 INFO:teuthology.orchestra.run.smithi070.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3516-ge08cbbf6-1jammy [792 kB] 2024-05-06T06:48:42.495 INFO:teuthology.orchestra.run.smithi070.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-06T06:48:42.520 INFO:teuthology.orchestra.run.smithi070.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3516-ge08cbbf6-1jammy [148 kB] 2024-05-06T06:48:42.524 INFO:teuthology.orchestra.run.smithi070.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3516-ge08cbbf6-1jammy [2,279 kB] 2024-05-06T06:48:42.589 INFO:teuthology.orchestra.run.smithi070.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-06T06:48:42.624 INFO:teuthology.orchestra.run.smithi070.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3516-ge08cbbf6-1jammy [8,625 kB] 2024-05-06T06:48:42.740 INFO:teuthology.orchestra.run.smithi184.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3516-ge08cbbf6-1jammy [5,095 kB] 2024-05-06T06:48:43.096 INFO:teuthology.orchestra.run.smithi070.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-06T06:48:43.096 INFO:teuthology.orchestra.run.smithi070.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3516-ge08cbbf6-1jammy [14.2 kB] 2024-05-06T06:48:43.096 INFO:teuthology.orchestra.run.smithi070.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3516-ge08cbbf6-1jammy [51.7 MB] 2024-05-06T06:48:43.098 INFO:teuthology.orchestra.run.smithi070.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-06T06:48:43.101 INFO:teuthology.orchestra.run.smithi070.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-06T06:48:43.102 INFO:teuthology.orchestra.run.smithi070.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-06T06:48:43.105 INFO:teuthology.orchestra.run.smithi070.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-06T06:48:43.131 INFO:teuthology.orchestra.run.smithi184.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3516-ge08cbbf6-1jammy [244 kB] 2024-05-06T06:48:43.137 INFO:teuthology.orchestra.run.smithi184.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3516-ge08cbbf6-1jammy [124 kB] 2024-05-06T06:48:43.142 INFO:teuthology.orchestra.run.smithi184.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3516-ge08cbbf6-1jammy [1,544 kB] 2024-05-06T06:48:43.311 INFO:teuthology.orchestra.run.smithi070.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-06T06:48:43.312 INFO:teuthology.orchestra.run.smithi184.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3516-ge08cbbf6-1jammy [6,259 kB] 2024-05-06T06:48:43.758 INFO:teuthology.orchestra.run.smithi070.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-06T06:48:43.768 INFO:teuthology.orchestra.run.smithi070.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-06T06:48:43.911 INFO:teuthology.orchestra.run.smithi184.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3516-ge08cbbf6-1jammy [22.8 MB] 2024-05-06T06:48:44.101 INFO:teuthology.orchestra.run.smithi070.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-06T06:48:44.102 INFO:teuthology.orchestra.run.smithi070.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-06T06:48:44.104 INFO:teuthology.orchestra.run.smithi070.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-06T06:48:44.106 INFO:teuthology.orchestra.run.smithi070.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-06T06:48:44.107 INFO:teuthology.orchestra.run.smithi070.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-06T06:48:44.110 INFO:teuthology.orchestra.run.smithi070.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-06T06:48:44.111 INFO:teuthology.orchestra.run.smithi070.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-06T06:48:44.113 INFO:teuthology.orchestra.run.smithi070.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-06T06:48:44.299 INFO:teuthology.orchestra.run.smithi070.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-06T06:48:44.708 INFO:teuthology.orchestra.run.smithi070.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-06T06:48:44.762 INFO:teuthology.orchestra.run.smithi070.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-06T06:48:44.789 INFO:teuthology.orchestra.run.smithi070.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-06T06:48:44.892 INFO:teuthology.orchestra.run.smithi070.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-06T06:48:44.933 INFO:teuthology.orchestra.run.smithi070.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-06T06:48:44.951 INFO:teuthology.orchestra.run.smithi070.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-06T06:48:44.962 INFO:teuthology.orchestra.run.smithi070.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-06T06:48:45.018 INFO:teuthology.orchestra.run.smithi070.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-06T06:48:45.023 INFO:teuthology.orchestra.run.smithi070.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-06T06:48:45.047 INFO:teuthology.orchestra.run.smithi070.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-06T06:48:45.211 INFO:teuthology.orchestra.run.smithi070.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-06T06:48:45.477 INFO:teuthology.orchestra.run.smithi070.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-06T06:48:45.498 INFO:teuthology.orchestra.run.smithi070.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-06T06:48:45.664 INFO:teuthology.orchestra.run.smithi070.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-06T06:48:45.738 INFO:teuthology.orchestra.run.smithi070.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-06T06:48:45.816 INFO:teuthology.orchestra.run.smithi070.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3516-ge08cbbf6-1jammy [124 kB] 2024-05-06T06:48:45.818 INFO:teuthology.orchestra.run.smithi070.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3516-ge08cbbf6-1jammy [38.9 kB] 2024-05-06T06:48:45.819 INFO:teuthology.orchestra.run.smithi070.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3516-ge08cbbf6-1jammy [13.6 MB] 2024-05-06T06:48:45.880 INFO:teuthology.orchestra.run.smithi070.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-06T06:48:45.883 INFO:teuthology.orchestra.run.smithi070.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-06T06:48:45.884 INFO:teuthology.orchestra.run.smithi070.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-06T06:48:45.908 INFO:teuthology.orchestra.run.smithi070.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-06T06:48:45.914 INFO:teuthology.orchestra.run.smithi070.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-06T06:48:46.269 INFO:teuthology.orchestra.run.smithi070.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3516-ge08cbbf6-1jammy [91.4 kB] 2024-05-06T06:48:46.275 INFO:teuthology.orchestra.run.smithi184.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3516-ge08cbbf6-1jammy [14.0 kB] 2024-05-06T06:48:46.276 INFO:teuthology.orchestra.run.smithi184.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3516-ge08cbbf6-1jammy [870 kB] 2024-05-06T06:48:46.293 INFO:teuthology.orchestra.run.smithi184.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3516-ge08cbbf6-1jammy [2,439 kB] 2024-05-06T06:48:46.365 INFO:teuthology.orchestra.run.smithi184.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3516-ge08cbbf6-1jammy [792 kB] 2024-05-06T06:48:46.389 INFO:teuthology.orchestra.run.smithi184.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3516-ge08cbbf6-1jammy [148 kB] 2024-05-06T06:48:46.400 INFO:teuthology.orchestra.run.smithi184.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3516-ge08cbbf6-1jammy [2,279 kB] 2024-05-06T06:48:46.471 INFO:teuthology.orchestra.run.smithi184.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3516-ge08cbbf6-1jammy [8,625 kB] 2024-05-06T06:48:46.777 INFO:teuthology.orchestra.run.smithi184.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3516-ge08cbbf6-1jammy [14.2 kB] 2024-05-06T06:48:46.778 INFO:teuthology.orchestra.run.smithi184.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3516-ge08cbbf6-1jammy [51.7 MB] 2024-05-06T06:48:46.907 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 181 MB in 8s (22.3 MB/s) 2024-05-06T06:48:47.065 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-06T06:48:47.165 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-05-06T06:48:47.171 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-06T06:48:47.256 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-06T06:48:47.601 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-06T06:48:47.627 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-06T06:48:47.667 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-06T06:48:47.970 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-06T06:48:47.997 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-06T06:48:48.037 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-06T06:48:48.498 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-06T06:48:48.525 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-06T06:48:48.573 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-06T06:48:48.700 INFO:teuthology.orchestra.run.smithi184.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3516-ge08cbbf6-1jammy [124 kB] 2024-05-06T06:48:48.702 INFO:teuthology.orchestra.run.smithi184.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3516-ge08cbbf6-1jammy [38.9 kB] 2024-05-06T06:48:48.761 INFO:teuthology.orchestra.run.smithi184.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3516-ge08cbbf6-1jammy [13.6 MB] 2024-05-06T06:48:49.108 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-06T06:48:49.120 INFO:teuthology.orchestra.run.smithi184.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuriw-testing-20240503.181540-main/e08cbbf6fd79a8dd2949f340bce25e28ea3db004/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3516-ge08cbbf6-1jammy [91.4 kB] 2024-05-06T06:48:49.134 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-06T06:48:49.226 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-06T06:48:49.613 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-06T06:48:49.639 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-06T06:48:49.679 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-06T06:48:49.749 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 181 MB in 11s (17.1 MB/s) 2024-05-06T06:48:49.909 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-06T06:48:49.999 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-06T06:48:50.010 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-05-06T06:48:50.016 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-06T06:48:50.025 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-06T06:48:50.066 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-06T06:48:50.099 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-06T06:48:50.410 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librados2. 2024-05-06T06:48:50.436 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-06T06:48:50.436 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../007-librados2_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:50.462 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-06T06:48:50.476 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librados2 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:50.502 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-06T06:48:50.780 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-06T06:48:50.807 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-06T06:48:50.839 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-06T06:48:50.938 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librbd1. 2024-05-06T06:48:50.964 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../008-librbd1_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:51.004 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librbd1 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:51.276 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-06T06:48:51.302 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-06T06:48:51.351 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-06T06:48:51.440 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs2. 2024-05-06T06:48:51.467 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:51.499 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs2 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:51.762 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-06T06:48:51.768 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rados. 2024-05-06T06:48:51.788 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-06T06:48:51.794 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:51.829 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-06T06:48:51.834 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rados (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:52.154 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-06T06:48:52.180 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:48:52.207 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-06T06:48:52.220 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-argparse (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:52.233 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-06T06:48:52.273 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-06T06:48:52.456 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cephfs. 2024-05-06T06:48:52.482 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:52.523 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cephfs (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:52.593 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-06T06:48:52.619 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-06T06:48:52.651 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-06T06:48:52.809 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-06T06:48:52.824 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:48:52.859 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-ceph-common (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:52.980 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librados2. 2024-05-06T06:48:53.006 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../007-librados2_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:53.046 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librados2 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:53.179 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-06T06:48:53.205 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-06T06:48:53.237 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-06T06:48:53.516 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librbd1. 2024-05-06T06:48:53.540 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-prettytable. 2024-05-06T06:48:53.542 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../008-librbd1_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:53.566 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-06T06:48:53.582 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librbd1 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:53.606 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-06T06:48:53.892 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rbd. 2024-05-06T06:48:53.907 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:53.950 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rbd (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:53.993 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs2. 2024-05-06T06:48:54.009 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:54.043 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs2 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:54.270 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-06T06:48:54.296 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-06T06:48:54.321 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rados. 2024-05-06T06:48:54.347 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:54.353 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-06T06:48:54.388 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rados (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:54.589 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-06T06:48:54.616 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-06T06:48:54.656 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-06T06:48:54.716 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-06T06:48:54.742 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:48:54.782 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-argparse (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:54.959 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-06T06:48:54.974 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-06T06:48:55.017 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-06T06:48:55.035 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cephfs. 2024-05-06T06:48:55.061 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:55.102 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cephfs (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:55.362 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua5.1. 2024-05-06T06:48:55.388 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-06T06:48:55.388 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-06T06:48:55.414 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:48:55.428 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-06T06:48:55.454 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-common (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:55.715 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-any. 2024-05-06T06:48:55.729 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-06T06:48:55.741 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-06T06:48:55.756 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-06T06:48:55.765 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-06T06:48:55.791 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-06T06:48:55.984 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package zip. 2024-05-06T06:48:56.010 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-06T06:48:56.050 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking zip (3.0-12build2) ... 2024-05-06T06:48:56.127 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-prettytable. 2024-05-06T06:48:56.153 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-06T06:48:56.193 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-06T06:48:56.370 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package unzip. 2024-05-06T06:48:56.397 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-06T06:48:56.437 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-06T06:48:56.471 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rbd. 2024-05-06T06:48:56.497 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:56.554 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rbd (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:56.841 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package luarocks. 2024-05-06T06:48:56.866 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-06T06:48:56.866 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-06T06:48:56.892 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-06T06:48:56.907 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-06T06:48:56.932 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-06T06:48:57.177 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-06T06:48:57.203 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-06T06:48:57.243 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-06T06:48:57.248 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package librgw2. 2024-05-06T06:48:57.275 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../025-librgw2_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:57.306 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking librgw2 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:57.555 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-06T06:48:57.570 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-06T06:48:57.613 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-06T06:48:57.867 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rgw. 2024-05-06T06:48:57.882 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:57.924 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package lua5.1. 2024-05-06T06:48:57.925 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rgw (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:57.951 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-06T06:48:57.991 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-06T06:48:58.277 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package lua-any. 2024-05-06T06:48:58.293 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-06T06:48:58.303 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-06T06:48:58.327 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-06T06:48:58.329 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-06T06:48:58.370 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-06T06:48:58.580 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package zip. 2024-05-06T06:48:58.595 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-06T06:48:58.638 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking zip (3.0-12build2) ... 2024-05-06T06:48:58.639 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libradosstriper1. 2024-05-06T06:48:58.665 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:58.706 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libradosstriper1 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:58.958 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package unzip. 2024-05-06T06:48:58.984 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-06T06:48:59.025 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-06T06:48:59.101 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-common. 2024-05-06T06:48:59.127 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:48:59.167 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-common (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:48:59.629 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package luarocks. 2024-05-06T06:48:59.655 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-06T06:48:59.687 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-06T06:49:00.087 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librgw2. 2024-05-06T06:49:00.113 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../025-librgw2_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:00.162 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librgw2 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:00.573 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-base. 2024-05-06T06:49:00.599 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:00.648 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-base (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:00.689 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rgw. 2024-05-06T06:49:00.705 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:00.747 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rgw (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:01.084 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-06T06:49:01.110 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-06T06:49:01.150 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-06T06:49:01.201 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-06T06:49:01.228 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-06T06:49:01.268 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-06T06:49:01.462 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libradosstriper1. 2024-05-06T06:49:01.488 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:01.529 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libradosstriper1 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:01.529 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cheroot. 2024-05-06T06:49:01.544 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-06T06:49:01.579 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-06T06:49:01.849 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-06T06:49:01.864 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-06T06:49:01.882 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-common. 2024-05-06T06:49:01.907 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-06T06:49:01.908 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:01.948 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-common (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:02.210 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-06T06:49:02.236 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-06T06:49:02.276 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-06T06:49:02.604 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-06T06:49:02.631 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-06T06:49:02.671 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-06T06:49:02.932 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempora. 2024-05-06T06:49:02.958 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-06T06:49:02.990 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-06T06:49:03.268 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-portend. 2024-05-06T06:49:03.287 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-base. 2024-05-06T06:49:03.294 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-06T06:49:03.313 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:03.334 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-06T06:49:03.372 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-base (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:03.637 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-06T06:49:03.663 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-06T06:49:03.704 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-06T06:49:03.983 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-06T06:49:03.990 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-06T06:49:04.009 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-06T06:49:04.016 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-06T06:49:04.049 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-06T06:49:04.056 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-06T06:49:04.352 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cheroot. 2024-05-06T06:49:04.378 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-06T06:49:04.402 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-natsort. 2024-05-06T06:49:04.418 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-06T06:49:04.428 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-06T06:49:04.468 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-06T06:49:04.730 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-06T06:49:04.746 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-06T06:49:04.780 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-06T06:49:04.922 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-logutils. 2024-05-06T06:49:04.948 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-06T06:49:04.988 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-06T06:49:05.083 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-06T06:49:05.110 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-06T06:49:05.150 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-06T06:49:05.257 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-06T06:49:05.284 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-06T06:49:05.316 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-06T06:49:05.453 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-06T06:49:05.479 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-06T06:49:05.519 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-06T06:49:05.593 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-mako. 2024-05-06T06:49:05.620 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-06T06:49:05.660 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-06T06:49:05.789 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-tempora. 2024-05-06T06:49:05.818 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-06T06:49:05.847 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-06T06:49:05.997 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-06T06:49:06.023 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-06T06:49:06.063 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-06T06:49:06.117 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-portend. 2024-05-06T06:49:06.143 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-06T06:49:06.183 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-06T06:49:06.366 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-06T06:49:06.392 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-06T06:49:06.432 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-06T06:49:06.486 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-06T06:49:06.513 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-06T06:49:06.553 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-06T06:49:06.710 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webob. 2024-05-06T06:49:06.725 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-06T06:49:06.760 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-06T06:49:06.864 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-06T06:49:06.890 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-06T06:49:06.931 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-06T06:49:07.105 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-waitress. 2024-05-06T06:49:07.120 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-06T06:49:07.157 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-06T06:49:07.268 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-natsort. 2024-05-06T06:49:07.294 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-06T06:49:07.334 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-06T06:49:07.449 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-tempita. 2024-05-06T06:49:07.476 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-06T06:49:07.516 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-06T06:49:07.688 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-logutils. 2024-05-06T06:49:07.714 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-06T06:49:07.754 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-06T06:49:07.819 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-paste. 2024-05-06T06:49:07.845 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-06T06:49:07.887 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-06T06:49:08.024 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-06T06:49:08.050 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-06T06:49:08.082 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-06T06:49:08.215 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-06T06:49:08.242 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-06T06:49:08.282 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-06T06:49:08.368 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-mako. 2024-05-06T06:49:08.394 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-06T06:49:08.434 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-06T06:49:08.584 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-06T06:49:08.611 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-06T06:49:08.651 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-06T06:49:08.763 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-06T06:49:08.789 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-06T06:49:08.829 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-06T06:49:08.921 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-webtest. 2024-05-06T06:49:08.947 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-06T06:49:08.979 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-06T06:49:09.149 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-06T06:49:09.175 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-06T06:49:09.215 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-06T06:49:09.240 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pecan. 2024-05-06T06:49:09.267 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-06T06:49:09.306 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-06T06:49:09.518 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webob. 2024-05-06T06:49:09.545 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-06T06:49:09.670 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-certifi. 2024-05-06T06:49:09.696 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-06T06:49:09.736 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-06T06:49:09.871 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-06T06:49:10.148 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-idna. 2024-05-06T06:49:10.174 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-06T06:49:10.214 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-06T06:49:10.742 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-urllib3. 2024-05-06T06:49:10.768 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-06T06:49:10.808 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-06T06:49:10.822 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-waitress. 2024-05-06T06:49:10.848 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-06T06:49:10.891 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-06T06:49:11.136 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests. 2024-05-06T06:49:11.163 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-06T06:49:11.200 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-tempita. 2024-05-06T06:49:11.202 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-06T06:49:11.227 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-06T06:49:11.266 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-06T06:49:11.506 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-06T06:49:11.527 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-paste. 2024-05-06T06:49:11.532 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-06T06:49:11.554 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-06T06:49:11.564 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-06T06:49:11.586 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-06T06:49:11.889 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-06T06:49:11.904 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-06T06:49:11.939 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-06T06:49:12.217 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-06T06:49:12.244 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-06T06:49:12.283 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-06T06:49:12.586 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webtest. 2024-05-06T06:49:12.613 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-06T06:49:12.653 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-06T06:49:12.676 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-06T06:49:12.702 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:49:12.742 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:12.964 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pecan. 2024-05-06T06:49:12.991 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-06T06:49:13.031 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-06T06:49:13.147 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-06T06:49:13.174 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:13.214 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:13.386 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-certifi. 2024-05-06T06:49:13.412 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-06T06:49:13.452 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-06T06:49:13.508 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-06T06:49:13.534 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-06T06:49:13.575 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-06T06:49:13.789 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-idna. 2024-05-06T06:49:13.824 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-06T06:49:13.835 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-openssl. 2024-05-06T06:49:13.855 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-06T06:49:13.862 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-06T06:49:13.894 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-06T06:49:14.166 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-urllib3. 2024-05-06T06:49:14.193 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-06T06:49:14.233 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-06T06:49:14.238 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr. 2024-05-06T06:49:14.266 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:14.305 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:14.561 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-requests. 2024-05-06T06:49:14.588 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-06T06:49:14.628 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-06T06:49:14.725 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mon. 2024-05-06T06:49:14.752 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:14.791 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mon (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:14.914 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-06T06:49:14.941 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-06T06:49:14.972 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-06T06:49:15.309 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-06T06:49:15.335 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:49:15.361 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-osd. 2024-05-06T06:49:15.375 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:15.388 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:15.429 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-osd (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:15.756 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-06T06:49:15.783 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:15.822 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:16.075 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-06T06:49:16.090 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-06T06:49:16.125 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-06T06:49:16.403 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-openssl. 2024-05-06T06:49:16.430 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-06T06:49:16.469 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-06T06:49:16.481 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph. 2024-05-06T06:49:16.497 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../066-ceph_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:16.539 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:16.798 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr. 2024-05-06T06:49:16.824 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:16.865 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:16.867 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-fuse. 2024-05-06T06:49:16.894 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:16.933 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-fuse (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:17.251 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mon. 2024-05-06T06:49:17.277 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:17.317 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mon (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:17.370 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mds. 2024-05-06T06:49:17.396 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:17.444 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mds (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:17.895 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-osd. 2024-05-06T06:49:17.922 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:17.931 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package cephadm. 2024-05-06T06:49:17.958 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../069-cephadm_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:17.962 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-osd (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:18.006 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking cephadm (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:18.317 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-06T06:49:18.344 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-06T06:49:18.383 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-06T06:49:18.736 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-06T06:49:18.763 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-06T06:49:18.811 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-06T06:49:19.007 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph. 2024-05-06T06:49:19.030 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../066-ceph_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:19.091 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:19.468 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-fuse. 2024-05-06T06:49:19.495 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:19.543 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-fuse (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:19.875 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-babel. 2024-05-06T06:49:19.902 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-06T06:49:19.932 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mds. 2024-05-06T06:49:19.958 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:19.966 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-06T06:49:19.998 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mds (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:20.294 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-jinja2. 2024-05-06T06:49:20.314 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-06T06:49:20.352 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-06T06:49:20.593 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephadm. 2024-05-06T06:49:20.620 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../069-cephadm_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:20.659 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephadm (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:20.689 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-06T06:49:20.716 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:49:20.755 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:20.996 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-06T06:49:21.022 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-06T06:49:21.062 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-06T06:49:21.091 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-06T06:49:21.118 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-06T06:49:21.158 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-06T06:49:21.381 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-06T06:49:21.397 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-06T06:49:21.448 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-06T06:49:21.460 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-routes. 2024-05-06T06:49:21.487 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-06T06:49:21.527 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-06T06:49:21.864 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-06T06:49:21.891 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:49:21.930 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:22.453 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-babel. 2024-05-06T06:49:22.480 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-06T06:49:22.519 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-06T06:49:22.814 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jinja2. 2024-05-06T06:49:22.841 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-06T06:49:22.892 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-06T06:49:23.193 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-06T06:49:23.210 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-06T06:49:23.226 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-06T06:49:23.251 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-06T06:49:23.252 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:49:23.292 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:23.629 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-06T06:49:23.656 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-06T06:49:23.695 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-06T06:49:23.730 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-joblib. 2024-05-06T06:49:23.757 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-06T06:49:23.796 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-06T06:49:23.998 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-routes. 2024-05-06T06:49:24.025 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-06T06:49:24.065 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-06T06:49:24.158 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-06T06:49:24.185 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-06T06:49:24.225 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-06T06:49:24.385 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-06T06:49:24.411 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:49:24.451 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:24.561 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-sklearn. 2024-05-06T06:49:24.587 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-06T06:49:24.627 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-06T06:49:25.377 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-06T06:49:25.405 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:49:25.529 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:25.682 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-06T06:49:25.697 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-06T06:49:25.740 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-06T06:49:26.218 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-joblib. 2024-05-06T06:49:26.245 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-06T06:49:26.276 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-06T06:49:26.630 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-06T06:49:26.658 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-06T06:49:26.696 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-06T06:49:26.741 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-cachetools. 2024-05-06T06:49:26.769 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-06T06:49:26.807 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-06T06:49:27.016 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn. 2024-05-06T06:49:27.043 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-06T06:49:27.082 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-06T06:49:27.110 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-06T06:49:27.138 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-06T06:49:27.177 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-06T06:49:27.514 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-06T06:49:27.541 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-06T06:49:27.580 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-06T06:49:27.791 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-06T06:49:27.819 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:49:27.883 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-rsa. 2024-05-06T06:49:27.910 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-06T06:49:27.943 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:27.950 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-06T06:49:28.270 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-google-auth. 2024-05-06T06:49:28.297 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-06T06:49:28.336 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-06T06:49:28.655 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-06T06:49:28.682 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-06T06:49:28.723 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-06T06:49:28.872 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cachetools. 2024-05-06T06:49:28.899 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-06T06:49:28.938 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-06T06:49:29.001 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-websocket. 2024-05-06T06:49:29.028 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-06T06:49:29.059 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-06T06:49:29.250 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-06T06:49:29.277 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-06T06:49:29.316 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-06T06:49:29.371 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-06T06:49:29.398 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-06T06:49:29.437 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-06T06:49:29.645 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-06T06:49:29.673 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-06T06:49:29.711 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-06T06:49:30.023 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rsa. 2024-05-06T06:49:30.050 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-06T06:49:30.089 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-06T06:49:30.134 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-06T06:49:30.151 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:49:30.295 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:30.477 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-google-auth. 2024-05-06T06:49:30.504 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-06T06:49:30.534 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-06T06:49:30.720 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-06T06:49:30.748 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-06T06:49:30.795 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-06T06:49:31.071 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-06T06:49:31.099 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-06T06:49:31.138 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-06T06:49:31.190 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-06T06:49:31.218 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-06T06:49:31.256 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-06T06:49:31.458 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-websocket. 2024-05-06T06:49:31.485 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-06T06:49:31.524 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-06T06:49:31.634 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package jq. 2024-05-06T06:49:31.662 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-06T06:49:31.700 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-06T06:49:31.836 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-06T06:49:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-06T06:49:31.902 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-06T06:49:31.970 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package socat. 2024-05-06T06:49:31.986 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-06T06:49:32.036 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-06T06:49:32.398 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package xmlstarlet. 2024-05-06T06:49:32.425 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-06T06:49:32.473 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-06T06:49:32.550 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-06T06:49:32.578 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:49:32.608 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:32.819 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-test. 2024-05-06T06:49:32.846 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:32.893 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-test (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:32.894 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-06T06:49:32.922 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-06T06:49:32.969 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-06T06:49:33.305 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-06T06:49:33.333 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-06T06:49:33.372 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-06T06:49:33.642 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package jq. 2024-05-06T06:49:33.669 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-06T06:49:33.708 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-06T06:49:33.960 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package socat. 2024-05-06T06:49:33.976 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-06T06:49:34.019 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-06T06:49:34.330 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package xmlstarlet. 2024-05-06T06:49:34.358 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-06T06:49:34.422 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-06T06:49:34.785 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-test. 2024-05-06T06:49:34.812 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:34.851 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-test (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:35.106 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package ceph-volume. 2024-05-06T06:49:35.122 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:49:35.156 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking ceph-volume (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:35.426 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-06T06:49:35.442 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:35.476 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libcephfs-dev (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:35.779 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-06T06:49:35.807 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-06T06:49:35.845 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-06T06:49:36.192 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-06T06:49:36.219 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-06T06:49:36.258 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-06T06:49:36.587 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package nvme-cli. 2024-05-06T06:49:36.615 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-06T06:49:36.653 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-06T06:49:37.042 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package pkg-config. 2024-05-06T06:49:37.069 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-06T06:49:37.089 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-volume. 2024-05-06T06:49:37.100 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-06T06:49:37.117 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3516-ge08cbbf6-1jammy_all.deb ... 2024-05-06T06:49:37.155 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-volume (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:37.311 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-06T06:49:37.327 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-06T06:49:37.394 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-06T06:49:37.459 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-06T06:49:37.475 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:37.517 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs-dev (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:37.806 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-06T06:49:37.822 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-06T06:49:37.837 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-06T06:49:37.864 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-06T06:49:37.865 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-06T06:49:37.903 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-06T06:49:38.167 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-06T06:49:38.175 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pastescript. 2024-05-06T06:49:38.183 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-06T06:49:38.202 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-06T06:49:38.216 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-06T06:49:38.241 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-06T06:49:38.562 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pluggy. 2024-05-06T06:49:38.589 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-06T06:49:38.604 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package nvme-cli. 2024-05-06T06:49:38.628 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-06T06:49:38.632 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-06T06:49:38.670 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-06T06:49:38.939 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-psutil. 2024-05-06T06:49:38.970 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-06T06:49:39.005 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-06T06:49:39.092 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package pkg-config. 2024-05-06T06:49:39.120 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-06T06:49:39.159 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-06T06:49:39.350 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-py. 2024-05-06T06:49:39.378 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-06T06:49:39.386 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-06T06:49:39.414 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-06T06:49:39.416 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-06T06:49:39.445 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-06T06:49:39.745 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pygments. 2024-05-06T06:49:39.773 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-06T06:49:39.820 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-06T06:49:39.881 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-06T06:49:39.909 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-06T06:49:39.948 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-06T06:49:40.218 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastescript. 2024-05-06T06:49:40.245 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-06T06:49:40.265 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-06T06:49:40.275 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-06T06:49:40.293 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-06T06:49:40.332 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-06T06:49:40.537 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pluggy. 2024-05-06T06:49:40.565 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-06T06:49:40.606 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-06T06:49:40.618 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-toml. 2024-05-06T06:49:40.645 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-06T06:49:40.676 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-06T06:49:40.915 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-psutil. 2024-05-06T06:49:40.943 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-06T06:49:40.945 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-pytest. 2024-05-06T06:49:40.974 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-06T06:49:40.990 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-06T06:49:41.013 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-06T06:49:41.310 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-py. 2024-05-06T06:49:41.323 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package python3-simplejson. 2024-05-06T06:49:41.337 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-06T06:49:41.339 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-06T06:49:41.373 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-06T06:49:41.376 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-06T06:49:41.626 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-06T06:49:41.642 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-06T06:49:41.675 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-06T06:49:41.688 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pygments. 2024-05-06T06:49:41.715 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-06T06:49:41.754 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-06T06:49:42.242 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-06T06:49:42.269 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-06T06:49:42.308 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-06T06:49:42.363 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package radosgw. 2024-05-06T06:49:42.391 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../116-radosgw_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:42.429 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking radosgw (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:42.619 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-toml. 2024-05-06T06:49:42.635 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-06T06:49:42.669 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-06T06:49:42.914 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pytest. 2024-05-06T06:49:42.941 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-06T06:49:42.972 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-06T06:49:43.249 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package rbd-fuse. 2024-05-06T06:49:43.265 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:43.307 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking rbd-fuse (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:43.317 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplejson. 2024-05-06T06:49:43.345 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-06T06:49:43.384 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-06T06:49:43.611 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-06T06:49:43.653 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-06T06:49:43.669 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-06T06:49:43.703 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-06T06:49:43.854 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-06T06:49:43.980 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-06T06:49:44.244 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-06T06:49:44.424 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package radosgw. 2024-05-06T06:49:44.451 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../116-radosgw_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:44.490 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking radosgw (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:44.582 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-06T06:49:44.979 INFO:teuthology.orchestra.run.smithi070.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-06T06:49:45.048 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up cephadm (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:45.260 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package rbd-fuse. 2024-05-06T06:49:45.276 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3516-ge08cbbf6-1jammy_amd64.deb ... 2024-05-06T06:49:45.326 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking rbd-fuse (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:45.556 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user cephadm....done 2024-05-06T06:49:45.623 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-06T06:49:45.662 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-06T06:49:45.873 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-06T06:49:45.939 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-06T06:49:46.033 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-06T06:49:46.198 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-06T06:49:46.284 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-06T06:49:46.315 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-06T06:49:46.558 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-06T06:49:46.621 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-06T06:49:46.809 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-06T06:49:46.935 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-06T06:49:47.042 INFO:teuthology.orchestra.run.smithi184.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-06T06:49:47.101 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephadm (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:47.237 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-06T06:49:47.585 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user cephadm....done 2024-05-06T06:49:47.597 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-06T06:49:47.741 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-06T06:49:47.849 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-06T06:49:48.017 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-06T06:49:48.133 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-06T06:49:48.260 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-06T06:49:48.378 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-06T06:49:48.385 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-06T06:49:48.628 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-06T06:49:48.637 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-06T06:49:48.879 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-06T06:49:48.888 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-06T06:49:49.014 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-06T06:49:49.129 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-argparse (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:49.350 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-06T06:49:49.475 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-06T06:49:49.657 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-06T06:49:49.719 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-06T06:49:49.766 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-06T06:49:49.884 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-06T06:49:49.986 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-06T06:49:50.151 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-06T06:49:50.254 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-06T06:49:50.522 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-06T06:49:50.550 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-06T06:49:50.600 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-06T06:49:50.663 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-06T06:49:50.773 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-06T06:49:50.789 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-06T06:49:51.041 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-06T06:49:51.165 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-06T06:49:51.276 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-argparse (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:51.291 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-06T06:49:51.510 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-06T06:49:51.558 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-06T06:49:51.711 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-06T06:49:51.826 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-06T06:49:51.837 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-06T06:49:51.963 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-06T06:49:52.121 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up zip (3.0-12build2) ... 2024-05-06T06:49:52.222 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-06T06:49:52.555 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-06T06:49:52.631 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-06T06:49:52.662 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-06T06:49:52.709 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-06T06:49:52.827 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-06T06:49:53.178 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-06T06:49:53.249 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-06T06:49:53.304 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-06T06:49:53.500 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-06T06:49:53.563 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-06T06:49:53.626 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-06T06:49:53.752 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-06T06:49:53.848 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-06T06:49:54.053 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-06T06:49:54.158 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up zip (3.0-12build2) ... 2024-05-06T06:49:54.258 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-06T06:49:54.446 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-06T06:49:54.697 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-06T06:49:54.877 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-06T06:49:55.090 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-06T06:49:55.136 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-06T06:49:55.263 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-06T06:49:55.383 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-06T06:49:55.388 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-06T06:49:55.689 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-06T06:49:55.735 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-06T06:49:56.002 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-06T06:49:56.066 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-06T06:49:56.120 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-ceph-common (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:56.317 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-06T06:49:56.438 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-idna (3.3-1) ... 2024-05-06T06:49:56.677 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-06T06:49:56.756 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-06T06:49:56.945 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-06T06:49:57.288 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-06T06:49:57.539 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-06T06:49:57.665 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-common (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:49:57.919 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-06T06:49:57.958 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-idna (3.3-1) ... 2024-05-06T06:49:58.171 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-06T06:49:58.259 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-06T06:49:58.306 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-06T06:49:58.573 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-06T06:49:58.691 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-06T06:49:58.817 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-06T06:49:59.127 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-06T06:49:59.377 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-06T06:49:59.398 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-06T06:49:59.637 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-06T06:49:59.642 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-06T06:49:59.763 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-06T06:49:59.776 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-06T06:50:00.010 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-06T06:50:00.064 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-06T06:50:00.120 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-06T06:50:00.246 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-06T06:50:00.315 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-06T06:50:00.555 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-06T06:50:00.591 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-06T06:50:00.817 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-06T06:50:00.850 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-06T06:50:01.059 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-06T06:50:01.101 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-06T06:50:01.161 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-06T06:50:01.352 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-06T06:50:01.454 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-06T06:50:01.487 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-06T06:50:01.721 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-06T06:50:01.772 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-06T06:50:01.898 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-06T06:50:01.981 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-06T06:50:02.190 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-06T06:50:02.374 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-06T06:50:02.516 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-06T06:50:02.616 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-06T06:50:02.867 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-06T06:50:02.868 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-06T06:50:02.993 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-06T06:50:02.994 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-06T06:50:03.119 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-06T06:50:03.217 INFO:teuthology.orchestra.run.smithi070.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-06T06:50:03.278 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-06T06:50:03.404 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-06T06:50:03.463 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-06T06:50:03.580 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-06T06:50:03.697 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-06T06:50:03.957 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-06T06:50:03.998 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-06T06:50:04.208 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-06T06:50:04.224 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-06T06:50:04.334 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-06T06:50:04.359 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-06T06:50:04.460 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-06T06:50:04.532 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-06T06:50:04.576 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-06T06:50:04.694 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-06T06:50:04.778 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-06T06:50:04.904 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-06T06:50:05.020 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-06T06:50:05.297 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-06T06:50:05.313 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-06T06:50:05.557 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-06T06:50:05.580 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-06T06:50:05.683 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-06T06:50:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-06T06:50:05.950 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-06T06:50:05.966 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-06T06:50:06.077 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-06T06:50:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-06T06:50:06.386 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-06T06:50:06.537 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-06T06:50:06.687 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-06T06:50:06.922 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-06T06:50:06.972 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-06T06:50:07.098 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-06T06:50:07.198 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-06T06:50:07.357 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-06T06:50:07.551 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-06T06:50:07.625 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-06T06:50:07.651 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librados2 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:07.778 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:07.937 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-06T06:50:07.970 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-06T06:50:08.273 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs2 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:08.347 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-06T06:50:08.399 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libradosstriper1 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:08.525 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-06T06:50:08.640 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-06T06:50:08.785 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librbd1 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:08.911 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-modules-core (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:09.001 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-06T06:50:09.045 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-fuse (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:09.102 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librados2 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:09.211 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:09.257 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-06T06:50:09.257 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-06T06:50:09.337 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-06T06:50:09.682 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs2 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:09.755 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libcephfs-dev (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:09.808 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libradosstriper1 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:09.880 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rados (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:09.934 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-06T06:50:10.006 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up librgw2 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:10.132 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-06T06:50:10.186 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librbd1 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:10.304 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-modules-core (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:10.430 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-fuse (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:10.643 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-06T06:50:10.643 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-06T06:50:11.131 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs-dev (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:11.257 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rados (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:11.369 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rbd (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:11.383 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librgw2 (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:11.495 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up rbd-fuse (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:11.501 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-06T06:50:11.621 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-rgw (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:11.747 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up python3-cephfs (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:11.873 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-common (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:12.382 INFO:teuthology.orchestra.run.smithi070.stdout:Adding group ceph....done 2024-05-06T06:50:12.713 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rbd (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:12.759 INFO:teuthology.orchestra.run.smithi070.stdout:Adding system user ceph....done 2024-05-06T06:50:12.864 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up rbd-fuse (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:12.928 INFO:teuthology.orchestra.run.smithi070.stdout:Setting system user ceph properties....done 2024-05-06T06:50:12.939 INFO:teuthology.orchestra.run.smithi070.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-06T06:50:12.990 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rgw (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:13.076 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-06T06:50:13.116 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cephfs (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:13.250 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-common (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:13.414 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-06T06:50:13.760 INFO:teuthology.orchestra.run.smithi184.stdout:Adding group ceph....done 2024-05-06T06:50:13.882 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-test (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:13.991 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up radosgw (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:14.120 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user ceph....done 2024-05-06T06:50:14.280 INFO:teuthology.orchestra.run.smithi184.stdout:Setting system user ceph properties....done 2024-05-06T06:50:14.292 INFO:teuthology.orchestra.run.smithi184.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-06T06:50:14.428 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-06T06:50:14.428 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-06T06:50:14.430 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-06T06:50:14.792 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-06T06:50:14.868 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-base (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:15.214 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-06T06:50:15.285 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-test (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:15.394 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up radosgw (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:15.670 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mds (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:15.839 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-06T06:50:15.839 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-06T06:50:15.881 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-06T06:50:15.881 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-06T06:50:16.313 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-base (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:16.330 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:16.549 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-06T06:50:16.549 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-06T06:50:16.687 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-06T06:50:17.065 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-osd (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:17.274 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mds (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:17.344 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-06T06:50:17.345 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-06T06:50:17.524 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-06T06:50:17.524 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-06T06:50:17.900 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:18.001 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:18.034 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:18.244 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-06T06:50:18.244 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-06T06:50:18.338 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mon (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:18.550 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-06T06:50:18.550 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-06T06:50:18.694 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-osd (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:18.945 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-06T06:50:18.945 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-06T06:50:18.997 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-cephadm (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:19.157 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:19.258 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-mgr-dashboard (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:19.384 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up ceph-volume (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:19.437 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:19.538 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:19.689 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mon (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:19.745 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-06T06:50:19.854 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-06T06:50:19.900 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-06T06:50:19.900 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-06T06:50:20.015 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-06T06:50:20.365 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-cephadm (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:20.525 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:20.651 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-dashboard (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:20.802 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-volume (19.0.0-3516-ge08cbbf6-1jammy) ... 2024-05-06T06:50:21.073 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-06T06:50:21.146 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-06T06:50:21.252 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-06T06:50:21.492 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-06T06:50:21.727 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-06T06:50:21.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install sqlite3 2024-05-06T06:50:21.828 INFO:teuthology.orchestra.run.smithi070.stdout:Reading package lists... 2024-05-06T06:50:22.029 INFO:teuthology.orchestra.run.smithi070.stdout:Building dependency tree... 2024-05-06T06:50:22.030 INFO:teuthology.orchestra.run.smithi070.stdout:Reading state information... 2024-05-06T06:50:22.204 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages were automatically installed and are no longer required: 2024-05-06T06:50:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-06T06:50:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-06T06:50:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-06T06:50:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-06T06:50:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-06T06:50:22.205 INFO:teuthology.orchestra.run.smithi070.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-06T06:50:22.206 INFO:teuthology.orchestra.run.smithi070.stdout:The following additional packages will be installed: 2024-05-06T06:50:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: libsqlite3-0 2024-05-06T06:50:22.208 INFO:teuthology.orchestra.run.smithi070.stdout:Suggested packages: 2024-05-06T06:50:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: sqlite3-doc 2024-05-06T06:50:22.237 INFO:teuthology.orchestra.run.smithi070.stdout:The following NEW packages will be installed: 2024-05-06T06:50:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: sqlite3 2024-05-06T06:50:22.238 INFO:teuthology.orchestra.run.smithi070.stdout:The following packages will be upgraded: 2024-05-06T06:50:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: libsqlite3-0 2024-05-06T06:50:22.304 INFO:teuthology.orchestra.run.smithi070.stdout:1 upgraded, 1 newly installed, 0 to remove and 302 not upgraded. 2024-05-06T06:50:22.304 INFO:teuthology.orchestra.run.smithi070.stdout:Need to get 1,410 kB of archives. 2024-05-06T06:50:22.304 INFO:teuthology.orchestra.run.smithi070.stdout:After this operation, 1,873 kB of additional disk space will be used. 2024-05-06T06:50:22.304 INFO:teuthology.orchestra.run.smithi070.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-05-06T06:50:22.485 INFO:teuthology.orchestra.run.smithi070.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-05-06T06:50:22.643 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-06T06:50:22.880 INFO:teuthology.orchestra.run.smithi070.stdout:Fetched 1,410 kB in 0s (5,178 kB/s) 2024-05-06T06:50:23.113 INFO:teuthology.orchestra.run.smithi070.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173902 files and directories currently installed.) 2024-05-06T06:50:23.119 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-05-06T06:50:23.277 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-05-06T06:50:23.321 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-06T06:50:23.324 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install sqlite3 2024-05-06T06:50:23.378 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2024-05-06T06:50:23.577 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2024-05-06T06:50:23.578 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2024-05-06T06:50:23.769 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2024-05-06T06:50:23.770 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-06T06:50:23.770 INFO:teuthology.orchestra.run.smithi184.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-06T06:50:23.770 INFO:teuthology.orchestra.run.smithi184.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-06T06:50:23.770 INFO:teuthology.orchestra.run.smithi184.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-06T06:50:23.770 INFO:teuthology.orchestra.run.smithi184.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-06T06:50:23.771 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-06T06:50:23.771 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2024-05-06T06:50:23.772 INFO:teuthology.orchestra.run.smithi184.stdout: libsqlite3-0 2024-05-06T06:50:23.773 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2024-05-06T06:50:23.774 INFO:teuthology.orchestra.run.smithi184.stdout: sqlite3-doc 2024-05-06T06:50:23.803 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2024-05-06T06:50:23.803 INFO:teuthology.orchestra.run.smithi184.stdout: sqlite3 2024-05-06T06:50:23.804 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2024-05-06T06:50:23.805 INFO:teuthology.orchestra.run.smithi184.stdout: libsqlite3-0 2024-05-06T06:50:23.988 INFO:teuthology.orchestra.run.smithi184.stdout:1 upgraded, 1 newly installed, 0 to remove and 302 not upgraded. 2024-05-06T06:50:23.988 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 1,410 kB of archives. 2024-05-06T06:50:23.988 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 1,873 kB of additional disk space will be used. 2024-05-06T06:50:23.988 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsqlite3-0 amd64 3.37.2-2ubuntu0.3 [641 kB] 2024-05-06T06:50:24.109 INFO:teuthology.orchestra.run.smithi070.stdout:Selecting previously unselected package sqlite3. 2024-05-06T06:50:24.126 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-05-06T06:50:24.167 INFO:teuthology.orchestra.run.smithi070.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-05-06T06:50:24.519 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-05-06T06:50:24.647 INFO:teuthology.orchestra.run.smithi070.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-05-06T06:50:24.684 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.3 [768 kB] 2024-05-06T06:50:24.773 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-06T06:50:25.234 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 1,410 kB in 1s (1,337 kB/s) 2024-05-06T06:50:25.495 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173902 files and directories currently installed.) 2024-05-06T06:50:25.570 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../libsqlite3-0_3.37.2-2ubuntu0.3_amd64.deb ... 2024-05-06T06:50:25.673 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) over (3.37.2-2ubuntu0.1) ... 2024-05-06T06:50:25.815 INFO:teuthology.orchestra.run.smithi070.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-06T06:50:25.960 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package sqlite3. 2024-05-06T06:50:25.988 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../sqlite3_3.37.2-2ubuntu0.3_amd64.deb ... 2024-05-06T06:50:26.018 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.3) ... 2024-05-06T06:50:26.293 INFO:teuthology.orchestra.run.smithi070.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-06T06:50:26.299 DEBUG:teuthology.parallel:result is None 2024-05-06T06:50:26.379 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libsqlite3-0:amd64 (3.37.2-2ubuntu0.3) ... 2024-05-06T06:50:26.506 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.3) ... 2024-05-06T06:50:26.633 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-06T06:50:27.683 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-06T06:50:28.268 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-06T06:50:28.272 DEBUG:teuthology.parallel:result is None 2024-05-06T06:50:28.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e08cbbf6fd79a8dd2949f340bce25e28ea3db004 2024-05-06T06:50:28.426 DEBUG:teuthology.orchestra.run.smithi070:> dpkg-query -W -f '${Version}' ceph 2024-05-06T06:50:28.446 INFO:teuthology.orchestra.run.smithi070.stdout:19.0.0-3516-ge08cbbf6-1jammy 2024-05-06T06:50:28.446 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3516-ge08cbbf6-1jammy 2024-05-06T06:50:28.446 INFO:teuthology.task.install:The correct ceph version 19.0.0-3516-ge08cbbf6-1jammy is installed. 2024-05-06T06:50:28.448 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e08cbbf6fd79a8dd2949f340bce25e28ea3db004 2024-05-06T06:50:28.802 DEBUG:teuthology.orchestra.run.smithi184:> dpkg-query -W -f '${Version}' ceph 2024-05-06T06:50:28.822 INFO:teuthology.orchestra.run.smithi184.stdout:19.0.0-3516-ge08cbbf6-1jammy 2024-05-06T06:50:28.822 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3516-ge08cbbf6-1jammy 2024-05-06T06:50:28.822 INFO:teuthology.task.install:The correct ceph version 19.0.0-3516-ge08cbbf6-1jammy is installed. 2024-05-06T06:50:28.824 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-06T06:50:28.824 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:50:28.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-06T06:50:28.839 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:50:28.839 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-06T06:50:28.879 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-06T06:50:28.879 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:50:28.879 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-05-06T06:50:28.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-06T06:50:28.949 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:50:28.949 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-05-06T06:50:28.963 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-06T06:50:29.017 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-06T06:50:29.017 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:50:29.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-06T06:50:29.031 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-06T06:50:29.085 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:50:29.085 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-06T06:50:29.098 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-06T06:50:29.153 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-06T06:50:29.153 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:50:29.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-05-06T06:50:29.166 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-06T06:50:29.222 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:50:29.222 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-05-06T06:50:29.235 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-06T06:50:29.289 INFO:teuthology.run_tasks:Running task ceph... 2024-05-06T06:50:29.377 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-06T06:50:29.377 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /var/log/ceph 2024-05-06T06:50:29.380 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2024-05-06T06:50:29.393 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-06T06:50:29.393 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-06T06:50:29.436 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-06T06:50:29.448 INFO:tasks.ceph:Creating extra log directories... 2024-05-06T06:50:29.448 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-06T06:50:29.488 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-06T06:50:29.512 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-06T06:50:29.513 INFO:tasks.ceph:config {'conf': {'client': {'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 1500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2024-05-06T06:50:29.513 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280', 'branch': 'wip-yuriw-testing-20240503.181540-main', 'description': 'rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7690280', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuriw-testing-20240503.181540-main'}, 'ceph': {'conf': {'client': {'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 1500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled'], 'mon_bind_msgr2': False, 'sha1': 'e08cbbf6fd79a8dd2949f340bce25e28ea3db004'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e08cbbf6fd79a8dd2949f340bce25e28ea3db004'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuriw-testing-20240503.181540-main', 'sha1': 'e08cbbf6fd79a8dd2949f340bce25e28ea3db004'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4116, 'sha1': 'e08cbbf6fd79a8dd2949f340bce25e28ea3db004', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuriw-testing-20240503.181540-main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_e08cbbf6fd79a8dd2949f340bce25e28ea3db004/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'e08cbbf6fd79a8dd2949f340bce25e28ea3db004', 'targets': {'smithi070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGkfn7vJilnM+S81nkjLHMYbT/ARmls76OTwboKCkmJxlbMIcBXjEy1pCoG13D2VeDFilEWOiLKMsyxD/9+Rj00=', 'smithi184.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4WQTeKmFsHN61WMC/8XA/CWDJ725jbHKnDlMEoJoTeZMf/e/HfxuM+Cu4ZrqXMwc1JAGYQ8J1uhWkPuu2TfeI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['sqlite3'], 'rpm': ['sqlite-devel']}, 'flavor': 'default', 'sha1': 'e08cbbf6fd79a8dd2949f340bce25e28ea3db004'}}, {'ceph': None}, {'exec': {'client.0': ['ceph osd pool create cephsqlite', "ceph auth get-or-create client.libcephsqlite mon 'profile simple-rados-client-with-blocklist' osd 'allow rwx pool=cephsqlite' >> /etc/ceph/ceph.keyring"]}}, {'exec': {'client.0': ['ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr']}}, {'workunit': {'clients': {'client.0': ['rados/test_libcephsqlite.sh cephsqlite']}, 'env': {'CEPH_ARGS': '--id libcephsqlite --no-log-to-stderr'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-03_23:44:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-06T06:50:29.513 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-06T06:50:29.544 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-06T06:50:29.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m0777 -- /var/run/ceph 2024-05-06T06:50:29.592 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2024-05-06T06:50:29.605 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:50:29.605 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-05-06T06:50:29.651 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-06T06:50:29.651 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-05-06T06:50:29.700 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-06T06:50:29.700 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T06:50:29.700 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-05-06T06:50:29.700 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T06:50:29.700 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-06 06:45:08.953109714 +0000 2024-05-06T06:50:29.700 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-06 06:45:08.689112073 +0000 2024-05-06T06:50:29.700 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-06 06:45:08.689112073 +0000 2024-05-06T06:50:29.700 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-05-06T06:50:29.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-06T06:50:29.753 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-06T06:50:29.753 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-06T06:50:29.753 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000250246 s, 2.0 MB/s 2024-05-06T06:50:29.754 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-06T06:50:29.804 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-05-06T06:50:29.850 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-06T06:50:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T06:50:29.851 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-05-06T06:50:29.851 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T06:50:29.851 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-06 06:45:09.465105141 +0000 2024-05-06T06:50:29.851 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-06 06:45:09.197107535 +0000 2024-05-06T06:50:29.851 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-06 06:45:09.197107535 +0000 2024-05-06T06:50:29.851 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-05-06T06:50:29.851 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-06T06:50:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-06T06:50:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-06T06:50:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000301094 s, 1.7 MB/s 2024-05-06T06:50:29.906 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-06T06:50:29.956 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-05-06T06:50:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-06T06:50:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T06:50:30.003 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-05-06T06:50:30.003 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T06:50:30.003 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-06 06:45:09.945100853 +0000 2024-05-06T06:50:30.003 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-06 06:45:09.689103141 +0000 2024-05-06T06:50:30.003 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-06 06:45:09.689103141 +0000 2024-05-06T06:50:30.003 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-05-06T06:50:30.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-06T06:50:30.057 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-06T06:50:30.057 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-06T06:50:30.057 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000279231 s, 1.8 MB/s 2024-05-06T06:50:30.058 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-06T06:50:30.108 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-05-06T06:50:30.154 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-06T06:50:30.155 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T06:50:30.155 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-05-06T06:50:30.155 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T06:50:30.155 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-06 06:45:10.437096459 +0000 2024-05-06T06:50:30.155 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-06 06:45:10.169098852 +0000 2024-05-06T06:50:30.155 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-06 06:45:10.169098852 +0000 2024-05-06T06:50:30.155 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-05-06T06:50:30.155 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-06T06:50:30.209 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-06T06:50:30.209 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-06T06:50:30.209 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000312541 s, 1.6 MB/s 2024-05-06T06:50:30.210 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-06T06:50:30.260 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-06T06:50:30.260 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:50:30.260 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-05-06T06:50:30.266 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-06T06:50:30.266 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-05-06T06:50:30.314 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-06T06:50:30.314 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T06:50:30.314 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-05-06T06:50:30.314 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T06:50:30.315 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-05-06 06:45:08.514013851 +0000 2024-05-06T06:50:30.315 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-05-06 06:45:08.242088085 +0000 2024-05-06T06:50:30.315 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-05-06 06:45:08.242088085 +0000 2024-05-06T06:50:30.315 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-05-06T06:50:30.315 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-06T06:50:30.368 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-05-06T06:50:30.368 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-05-06T06:50:30.368 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000442059 s, 1.2 MB/s 2024-05-06T06:50:30.370 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-06T06:50:30.419 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-05-06T06:50:30.465 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-06T06:50:30.465 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T06:50:30.465 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-05-06T06:50:30.465 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T06:50:30.465 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-05-06 06:45:08.997881758 +0000 2024-05-06T06:50:30.465 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-05-06 06:45:08.745950533 +0000 2024-05-06T06:50:30.466 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-05-06 06:45:08.745950533 +0000 2024-05-06T06:50:30.466 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-05-06T06:50:30.467 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-06T06:50:30.520 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-05-06T06:50:30.520 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-05-06T06:50:30.520 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000434127 s, 1.2 MB/s 2024-05-06T06:50:30.521 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-06T06:50:30.571 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-05-06T06:50:30.618 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-06T06:50:30.618 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T06:50:30.618 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-05-06T06:50:30.618 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T06:50:30.618 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-05-06 06:45:09.517744479 +0000 2024-05-06T06:50:30.618 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-05-06 06:45:09.261812042 +0000 2024-05-06T06:50:30.618 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-05-06 06:45:09.261812042 +0000 2024-05-06T06:50:30.618 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-05-06T06:50:30.619 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-06T06:50:30.672 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-05-06T06:50:30.672 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-05-06T06:50:30.672 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000356794 s, 1.4 MB/s 2024-05-06T06:50:30.673 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-06T06:50:30.723 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-05-06T06:50:30.769 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-06T06:50:30.770 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-06T06:50:30.770 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-05-06T06:50:30.770 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-06T06:50:30.770 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-05-06 06:45:09.745684305 +0000 2024-05-06T06:50:30.770 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-05-06 06:45:09.741685360 +0000 2024-05-06T06:50:30.770 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-05-06 06:45:09.741685360 +0000 2024-05-06T06:50:30.770 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-05-06T06:50:30.770 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-06T06:50:30.824 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-05-06T06:50:30.824 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-05-06T06:50:30.824 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000389773 s, 1.3 MB/s 2024-05-06T06:50:30.825 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-06T06:50:30.875 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-06T06:50:30.875 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-06T06:50:30.875 INFO:tasks.ceph:Generating config... 2024-05-06T06:50:30.876 INFO:tasks.ceph:[client] debug cephsqlite = 20 2024-05-06T06:50:30.876 INFO:tasks.ceph:[client] debug client = 20 2024-05-06T06:50:30.876 INFO:tasks.ceph:[client] debug ms = 1 2024-05-06T06:50:30.876 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-05-06T06:50:30.876 INFO:tasks.ceph:[global] mon election default strategy = 1 2024-05-06T06:50:30.877 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-05-06T06:50:30.877 INFO:tasks.ceph:[global] ms inject socket failures = 1500 2024-05-06T06:50:30.877 INFO:tasks.ceph:[global] ms type = async 2024-05-06T06:50:30.877 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-06T06:50:30.877 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-06T06:50:30.877 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-06T06:50:30.877 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-06T06:50:30.877 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-06T06:50:30.877 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-05-06T06:50:30.877 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-05-06T06:50:30.877 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-05-06T06:50:30.877 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-05-06T06:50:30.877 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-05-06T06:50:30.877 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-05-06T06:50:30.877 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-06T06:50:30.877 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-05-06T06:50:30.878 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-06T06:50:30.879 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-05-06T06:50:30.879 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-05-06T06:50:30.879 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-06T06:50:30.879 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-05-06T06:50:30.879 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-05-06T06:50:30.879 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-05-06T06:50:30.879 INFO:tasks.ceph:Setting up mon.a... 2024-05-06T06:50:30.879 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-06T06:50:30.913 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.keyring 2024-05-06T06:50:30.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-06T06:50:31.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-06T06:50:31.062 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.70:6789]'), ('mon.c', '[v1:172.21.15.70:6790]'), ('mon.b', '[v1:172.21.15.184:6789]')] 2024-05-06T06:50:31.062 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.70:6789],[v1:172.21.15.70:6790],[v1:172.21.15.184:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 1500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug cephsqlite': 20, 'debug client': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-05-06T06:50:31.063 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:50:31.063 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-06T06:50:31.111 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.70:6789]' --addv c '[v1:172.21.15.70:6790]' --addv b '[v1:172.21.15.184:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:50:31.197 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:50:31.197 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: generated fsid 90193adb-e1e1-4e06-9c0d-7abb14f25fc6 2024-05-06T06:50:31.197 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = quincy 2024-05-06T06:50:31.197 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 0 2024-05-06T06:50:31.197 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 90193adb-e1e1-4e06-9c0d-7abb14f25fc6 2024-05-06T06:50:31.197 INFO:teuthology.orchestra.run.smithi070.stdout:last_changed 2024-05-06T06:50:31.201213+0000 2024-05-06T06:50:31.197 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-05-06T06:50:31.201213+0000 2024-05-06T06:50:31.197 INFO:teuthology.orchestra.run.smithi070.stdout:min_mon_release 17 (quincy) 2024-05-06T06:50:31.197 INFO:teuthology.orchestra.run.smithi070.stdout:election_strategy: 1 2024-05-06T06:50:31.197 INFO:teuthology.orchestra.run.smithi070.stdout:0: v1:172.21.15.70:6789/0 mon.a 2024-05-06T06:50:31.198 INFO:teuthology.orchestra.run.smithi070.stdout:1: v1:172.21.15.184:6789/0 mon.b 2024-05-06T06:50:31.198 INFO:teuthology.orchestra.run.smithi070.stdout:2: v1:172.21.15.70:6790/0 mon.c 2024-05-06T06:50:31.198 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-06T06:50:31.199 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-06T06:50:31.247 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 90193adb-e1e1-4e06-9c0d-7abb14f25fc6... 2024-05-06T06:50:31.248 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-06T06:50:31.292 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-06T06:50:31.320 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-05-06T06:50:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: chdir = "" 2024-05-06T06:50:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-06T06:50:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: auth supported = cephx 2024-05-06T06:50:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: filestore xattr use omap = true 2024-05-06T06:50:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: mon clock drift allowed = 1.000 2024-05-06T06:50:31.320 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: osd crush chooseleaf type = 0 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: auth debug = true 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on old message = true 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: ms die on bug = true 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: mon pg warn max object skew = 0 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: # disable pg_autoscaler by default for new pools 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default size = 2 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.321 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow primary affinity = true 2024-05-06T06:50:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd allow pg remap = true 2024-05-06T06:50:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on legacy crush tunables = false 2024-05-06T06:50:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on crush straw calc version zero = false 2024-05-06T06:50:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on no sortbitwise = false 2024-05-06T06:50:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on osd down out interval zero = false 2024-05-06T06:50:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: mon warn on too few osds = false 2024-05-06T06:50:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-06T06:50:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-06T06:50:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: mon_allow_pool_size_one = true 2024-05-06T06:50:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-06T06:50:31.322 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: osd default data pool replay window = 5 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: mon allow pool delete = true 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: mon cluster log file level = debug 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: debug asserts on shutdown = true 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: mon health detail to clog = false 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: mon host = "[v1:172.21.15.70:6789],[v1:172.21.15.70:6790],[v1:172.21.15.184:6789]" 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: mon client directed command retry = 5 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: mon election default strategy = 1 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: ms bind msgr2 = False 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: ms inject socket failures = 1500 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: ms type = async 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 90193adb-e1e1-4e06-9c0d-7abb14f25fc6 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout:[osd] 2024-05-06T06:50:31.323 INFO:teuthology.orchestra.run.smithi070.stdout: osd journal size = 100 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub load threshold = 5.0 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: osd scrub max interval = 600 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock profile = high_recovery_ops 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: osd recover clone overlap = true 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: osd recovery max chunk = 1048576 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug shutdown = true 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug op order = true 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify stray on activate = true 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug trim objects = true 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.324 INFO:teuthology.orchestra.run.smithi070.stdout: osd open classes on start = true 2024-05-06T06:50:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug pg log writeout = true 2024-05-06T06:50:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: osd deep scrub update digest min age = 30 2024-05-06T06:50:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: osd map max advance = 10 2024-05-06T06:50:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: journal zero on create = true 2024-05-06T06:50:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: filestore ondisk finisher threads = 3 2024-05-06T06:50:31.325 INFO:teuthology.orchestra.run.smithi070.stdout: filestore apply finisher threads = 3 2024-05-06T06:50:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: bdev debug aio = true 2024-05-06T06:50:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug misdirected ops = true 2024-05-06T06:50:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: bdev async discard = True 2024-05-06T06:50:31.326 INFO:teuthology.orchestra.run.smithi070.stdout: bdev enable discard = True 2024-05-06T06:50:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore allocator = stupid 2024-05-06T06:50:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore block size = 96636764160 2024-05-06T06:50:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore fsck on mount = True 2024-05-06T06:50:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: bluestore zero block detection = True 2024-05-06T06:50:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluefs = 20 2024-05-06T06:50:31.327 INFO:teuthology.orchestra.run.smithi070.stdout: debug bluestore = 20 2024-05-06T06:50:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-05-06T06:50:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: debug osd = 20 2024-05-06T06:50:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: debug rocksdb = 10 2024-05-06T06:50:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd backfillfull_ratio = 0.85 2024-05-06T06:50:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd full ratio = 0.9 2024-05-06T06:50:31.328 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd nearfull ratio = 0.8 2024-05-06T06:50:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify cached snaps = True 2024-05-06T06:50:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: osd debug verify missing on start = True 2024-05-06T06:50:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: osd failsafe full ratio = 0.95 2024-05-06T06:50:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: osd mclock override recovery settings = True 2024-05-06T06:50:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: osd objectstore = bluestore 2024-05-06T06:50:31.329 INFO:teuthology.orchestra.run.smithi070.stdout: osd op queue = debug_random 2024-05-06T06:50:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: osd op queue cut off = debug_random 2024-05-06T06:50:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: osd shutdown pgref assert = True 2024-05-06T06:50:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.330 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr] 2024-05-06T06:50:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-05-06T06:50:31.330 INFO:teuthology.orchestra.run.smithi070.stdout: debug mgr = 20 2024-05-06T06:50:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-05-06T06:50:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-05-06T06:50:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-05-06T06:50:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-05-06T06:50:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: mgr/telemetry/nag = false 2024-05-06T06:50:31.331 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.332 INFO:teuthology.orchestra.run.smithi070.stdout:[mon] 2024-05-06T06:50:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-05-06T06:50:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: debug mon = 20 2024-05-06T06:50:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: debug paxos = 20 2024-05-06T06:50:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: debug auth = 20 2024-05-06T06:50:31.332 INFO:teuthology.orchestra.run.smithi070.stdout: mon data avail warn = 5 2024-05-06T06:50:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: mon mgr mkfs grace = 240 2024-05-06T06:50:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min pgs per osd = 4 2024-05-06T06:50:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd reporter subtree level = osd 2024-05-06T06:50:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: mon osd prime pg temp = true 2024-05-06T06:50:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: mon reweight min bytes per osd = 10 2024-05-06T06:50:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.333 INFO:teuthology.orchestra.run.smithi070.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-06T06:50:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: auth mon ticket ttl = 660 # 11m 2024-05-06T06:50:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: auth service ticket ttl = 240 # 4m 2024-05-06T06:50:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: # don't complain about insecure global_id in the test suite 2024-05-06T06:50:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-06T06:50:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-06T06:50:31.334 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: # 1m isn't quite enough 2024-05-06T06:50:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: mon_down_mkfs_grace = 2m 2024-05-06T06:50:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: mon_warn_on_filestore_osds = false 2024-05-06T06:50:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: mon min osdmap epochs = 50 2024-05-06T06:50:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: mon osdmap full prune interval = 2 2024-05-06T06:50:31.335 INFO:teuthology.orchestra.run.smithi070.stdout: mon osdmap full prune min = 15 2024-05-06T06:50:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: mon osdmap full prune txsize = 2 2024-05-06T06:50:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: mon scrub interval = 300 2024-05-06T06:50:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: paxos service trim min = 10 2024-05-06T06:50:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:50:31.336 INFO:teuthology.orchestra.run.smithi070.stdout:[client] 2024-05-06T06:50:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: rgw cache enabled = true 2024-05-06T06:50:31.336 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable ops log = true 2024-05-06T06:50:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: rgw enable usage log = true 2024-05-06T06:50:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-06T06:50:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-06T06:50:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: debug cephsqlite = 20 2024-05-06T06:50:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: debug client = 20 2024-05-06T06:50:31.337 INFO:teuthology.orchestra.run.smithi070.stdout: debug ms = 1 2024-05-06T06:50:31.337 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.a] 2024-05-06T06:50:31.337 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.c] 2024-05-06T06:50:31.338 INFO:teuthology.orchestra.run.smithi070.stdout:[mon.b] 2024-05-06T06:50:31.340 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2024-05-06T06:50:31.340 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2024-05-06T06:50:31.340 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-06T06:50:31.340 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2024-05-06T06:50:31.340 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.340 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2024-05-06T06:50:31.341 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.341 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2024-05-06T06:50:31.341 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.341 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2024-05-06T06:50:31.341 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2024-05-06T06:50:31.341 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.342 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2024-05-06T06:50:31.342 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2024-05-06T06:50:31.342 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.342 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-06T06:50:31.342 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2024-05-06T06:50:31.342 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.342 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2024-05-06T06:50:31.343 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-06T06:50:31.343 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.343 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2024-05-06T06:50:31.343 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.343 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2024-05-06T06:50:31.343 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2024-05-06T06:50:31.343 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2024-05-06T06:50:31.344 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2024-05-06T06:50:31.344 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2024-05-06T06:50:31.344 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2024-05-06T06:50:31.344 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2024-05-06T06:50:31.344 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-06T06:50:31.345 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-06T06:50:31.345 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2024-05-06T06:50:31.345 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.345 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-06T06:50:31.345 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.345 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2024-05-06T06:50:31.346 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.346 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2024-05-06T06:50:31.346 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.346 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2024-05-06T06:50:31.346 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2024-05-06T06:50:31.346 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2024-05-06T06:50:31.346 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "[v1:172.21.15.70:6789],[v1:172.21.15.70:6790],[v1:172.21.15.184:6789]" 2024-05-06T06:50:31.347 INFO:teuthology.orchestra.run.smithi184.stdout: mon client directed command retry = 5 2024-05-06T06:50:31.347 INFO:teuthology.orchestra.run.smithi184.stdout: mon election default strategy = 1 2024-05-06T06:50:31.347 INFO:teuthology.orchestra.run.smithi184.stdout: ms bind msgr2 = False 2024-05-06T06:50:31.347 INFO:teuthology.orchestra.run.smithi184.stdout: ms inject socket failures = 1500 2024-05-06T06:50:31.347 INFO:teuthology.orchestra.run.smithi184.stdout: ms type = async 2024-05-06T06:50:31.347 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = 90193adb-e1e1-4e06-9c0d-7abb14f25fc6 2024-05-06T06:50:31.347 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.347 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2024-05-06T06:50:31.348 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2024-05-06T06:50:31.348 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.348 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2024-05-06T06:50:31.348 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2024-05-06T06:50:31.348 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2024-05-06T06:50:31.348 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.348 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2024-05-06T06:50:31.349 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2024-05-06T06:50:31.349 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.349 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2024-05-06T06:50:31.349 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2024-05-06T06:50:31.349 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2024-05-06T06:50:31.349 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug trim objects = true 2024-05-06T06:50:31.349 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.350 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2024-05-06T06:50:31.350 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2024-05-06T06:50:31.350 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.350 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2024-05-06T06:50:31.350 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.350 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2024-05-06T06:50:31.351 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.351 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2024-05-06T06:50:31.351 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.351 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2024-05-06T06:50:31.351 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2024-05-06T06:50:31.351 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.352 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2024-05-06T06:50:31.352 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2024-05-06T06:50:31.352 INFO:teuthology.orchestra.run.smithi184.stdout: bdev async discard = True 2024-05-06T06:50:31.352 INFO:teuthology.orchestra.run.smithi184.stdout: bdev enable discard = True 2024-05-06T06:50:31.352 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore allocator = stupid 2024-05-06T06:50:31.352 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2024-05-06T06:50:31.352 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2024-05-06T06:50:31.352 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore zero block detection = True 2024-05-06T06:50:31.352 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 20 2024-05-06T06:50:31.352 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 20 2024-05-06T06:50:31.352 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-05-06T06:50:31.352 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 10 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify cached snaps = True 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify missing on start = True 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock override recovery settings = True 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: osd op queue = debug_random 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: osd op queue cut off = debug_random 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: osd shutdown pgref assert = True 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2024-05-06T06:50:31.353 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2024-05-06T06:50:31.354 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2024-05-06T06:50:31.355 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: mon min osdmap epochs = 50 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: mon osdmap full prune interval = 2 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: mon osdmap full prune min = 15 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: mon osdmap full prune txsize = 2 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: mon scrub interval = 300 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: paxos service trim min = 10 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-06T06:50:31.356 INFO:teuthology.orchestra.run.smithi184.stdout: debug cephsqlite = 20 2024-05-06T06:50:31.357 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2024-05-06T06:50:31.357 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-05-06T06:50:31.357 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2024-05-06T06:50:31.357 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2024-05-06T06:50:31.357 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2024-05-06T06:50:31.357 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-06T06:50:31.357 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-06T06:50:31.430 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-06T06:50:31.430 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:50:31.430 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-06T06:50:31.479 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:50:31.479 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-06T06:50:31.527 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:50:31.527 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:50:31.527 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-06T06:50:31.527 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-06T06:50:31.592 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:50:31.592 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:50:31.638 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2024-05-06T06:50:31.638 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:50:31.639 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-06T06:50:31.639 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-06T06:50:31.662 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:50:31.663 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:50:31.710 INFO:tasks.ceph:Setting up mon nodes... 2024-05-06T06:50:31.710 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-06T06:50:31.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-06T06:50:31.752 INFO:teuthology.orchestra.run.smithi070.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-06T06:50:31.755 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-06T06:50:31.798 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-06T06:50:31.812 INFO:tasks.ceph:Setting up mds nodes... 2024-05-06T06:50:31.812 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-06T06:50:31.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-06T06:50:31.845 INFO:teuthology.orchestra.run.smithi070.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-06T06:50:31.854 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-06T06:50:31.887 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-06T06:50:31.897 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-06T06:50:31.897 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi070.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-06T06:50:31.897 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-06T06:50:31.909 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-06T06:50:31.909 INFO:tasks.ceph:role: osd.0 2024-05-06T06:50:31.909 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:50:31.909 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-06T06:50:31.961 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-06T06:50:31.961 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-06T06:50:31.961 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-06T06:50:31.961 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-06T06:50:31.961 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-06T06:50:31.962 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-05-06T06:50:31.962 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-06T06:50:31.962 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-06T06:50:31.962 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-06T06:50:31.962 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-06T06:50:31.986 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-05-06T06:50:31.987 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-05-06T06:50:31.987 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-06T06:50:32.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-06T06:50:32.099 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-05-06T06:50:32.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:50:32.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-06T06:50:32.153 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-06T06:50:32.153 INFO:tasks.ceph:role: osd.1 2024-05-06T06:50:32.153 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:50:32.154 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-06T06:50:32.206 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-06T06:50:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-06T06:50:32.206 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-06T06:50:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-06T06:50:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-06T06:50:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-05-06T06:50:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-06T06:50:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-06T06:50:32.207 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-06T06:50:32.207 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-06T06:50:32.232 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-05-06T06:50:32.234 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-05-06T06:50:32.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-06T06:50:32.293 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-06T06:50:32.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:50:32.347 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-05-06T06:50:32.347 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-06T06:50:32.400 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-06T06:50:32.400 INFO:tasks.ceph:role: osd.2 2024-05-06T06:50:32.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:50:32.400 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-06T06:50:32.453 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-06T06:50:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-06T06:50:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-06T06:50:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-06T06:50:32.454 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-06T06:50:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-05-06T06:50:32.454 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-06T06:50:32.454 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-06T06:50:32.454 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-06T06:50:32.454 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-06T06:50:32.477 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-05-06T06:50:32.479 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-05-06T06:50:32.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-06T06:50:32.540 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-06T06:50:32.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:50:32.591 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-05-06T06:50:32.592 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-06T06:50:32.644 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-06T06:50:32.644 INFO:tasks.ceph:role: osd.3 2024-05-06T06:50:32.645 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:50:32.645 DEBUG:teuthology.orchestra.run.smithi070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-06T06:50:32.699 INFO:teuthology.orchestra.run.smithi070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-06T06:50:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-06T06:50:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-06T06:50:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-06T06:50:32.699 INFO:teuthology.orchestra.run.smithi070.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-06T06:50:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: = sunit=0 swidth=0 blks 2024-05-06T06:50:32.699 INFO:teuthology.orchestra.run.smithi070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-06T06:50:32.699 INFO:teuthology.orchestra.run.smithi070.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-06T06:50:32.699 INFO:teuthology.orchestra.run.smithi070.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-06T06:50:32.699 INFO:teuthology.orchestra.run.smithi070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-06T06:50:32.723 INFO:teuthology.orchestra.run.smithi070.stdout:Discarding blocks...Done. 2024-05-06T06:50:32.724 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi070.front.sepia.ceph.com -o noatime 2024-05-06T06:50:32.725 DEBUG:teuthology.orchestra.run.smithi070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-06T06:50:32.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-06T06:50:32.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:50:32.839 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: /sbin/restorecon: command not found 2024-05-06T06:50:32.839 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:50:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:32.963+0000 7fa47cd0c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-06T06:50:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:32.963+0000 7fa47cd0c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-06T06:50:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:32.963+0000 7fa47cd0c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-06T06:50:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:32.963+0000 7fa47cd0c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-06T06:50:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:32.963+0000 7fa47cd0c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-06T06:50:32.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:32.963+0000 7fa47cd0c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-06T06:50:35.931 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-06T06:50:35.945 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:50:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:36.023+0000 7f106ead77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-06T06:50:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:36.023+0000 7f106ead77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-06T06:50:36.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:36.023+0000 7f106ead77c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-06T06:50:36.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:36.023+0000 7f106ead77c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-06T06:50:36.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:36.023+0000 7f106ead77c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-06T06:50:36.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:36.023+0000 7f106ead77c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-06T06:50:38.998 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-06T06:50:39.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:50:39.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:39.135+0000 7ff8a9d697c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-06T06:50:39.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:39.135+0000 7ff8a9d697c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-06T06:50:39.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:39.135+0000 7ff8a9d697c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-06T06:50:39.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:39.135+0000 7ff8a9d697c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-06T06:50:39.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:39.135+0000 7ff8a9d697c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-06T06:50:39.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:39.135+0000 7ff8a9d697c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-06T06:50:42.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-06T06:50:42.154 DEBUG:teuthology.orchestra.run.smithi070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:50:42.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:42.235+0000 7f42983857c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-06T06:50:42.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:42.239+0000 7f42983857c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-06T06:50:42.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:42.239+0000 7f42983857c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-06T06:50:42.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:42.239+0000 7f42983857c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-06T06:50:42.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:42.239+0000 7f42983857c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-06T06:50:42.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:50:42.239+0000 7f42983857c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-06T06:50:45.197 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-06T06:50:45.258 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-06T06:50:45.273 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-06T06:50:45.274 INFO:tasks.ceph:role: osd.4 2024-05-06T06:50:45.274 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2024-05-06T06:50:45.274 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-06T06:50:45.337 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-06T06:50:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-06T06:50:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-06T06:50:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-06T06:50:45.338 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-06T06:50:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-05-06T06:50:45.338 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-06T06:50:45.338 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-06T06:50:45.338 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-06T06:50:45.338 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-06T06:50:45.793 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-05-06T06:50:45.795 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-05-06T06:50:45.796 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-06T06:50:45.896 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-06T06:50:45.907 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2024-05-06T06:50:45.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:50:45.908 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-06T06:50:45.961 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-06T06:50:45.961 INFO:tasks.ceph:role: osd.5 2024-05-06T06:50:45.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2024-05-06T06:50:45.962 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-06T06:50:46.026 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-06T06:50:46.026 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-06T06:50:46.026 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-06T06:50:46.026 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-06T06:50:46.026 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-06T06:50:46.026 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-05-06T06:50:46.027 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-06T06:50:46.027 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-06T06:50:46.027 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-06T06:50:46.027 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-06T06:50:46.503 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-05-06T06:50:46.505 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-05-06T06:50:46.505 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-06T06:50:46.654 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-06T06:50:46.665 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2024-05-06T06:50:46.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:50:46.666 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-06T06:50:46.720 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-06T06:50:46.720 INFO:tasks.ceph:role: osd.6 2024-05-06T06:50:46.721 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2024-05-06T06:50:46.721 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-06T06:50:46.782 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-06T06:50:46.782 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-06T06:50:46.782 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-06T06:50:46.782 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-06T06:50:46.782 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-06T06:50:46.782 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-05-06T06:50:46.782 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-06T06:50:46.782 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-06T06:50:46.782 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-06T06:50:46.782 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-06T06:50:47.247 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-05-06T06:50:47.249 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-05-06T06:50:47.250 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-06T06:50:47.393 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-06T06:50:47.404 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:50:47.404 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2024-05-06T06:50:47.404 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-06T06:50:47.457 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-06T06:50:47.457 INFO:tasks.ceph:role: osd.7 2024-05-06T06:50:47.457 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2024-05-06T06:50:47.457 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-06T06:50:47.528 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-06T06:50:47.528 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-06T06:50:47.528 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-06T06:50:47.528 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-06T06:50:47.528 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-06T06:50:47.528 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-05-06T06:50:47.528 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-06T06:50:47.528 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-06T06:50:47.529 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-06T06:50:47.529 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-06T06:50:47.959 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-05-06T06:50:47.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-05-06T06:50:47.961 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-06T06:50:48.055 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-06T06:50:48.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:50:48.065 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2024-05-06T06:50:48.065 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:50:48.188 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:48.184+0000 7fdfd20ba7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-06T06:50:48.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:48.188+0000 7fdfd20ba7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-06T06:50:48.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:48.188+0000 7fdfd20ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-06T06:50:48.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:48.188+0000 7fdfd20ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-06T06:50:48.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:48.188+0000 7fdfd20ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-06T06:50:48.191 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:48.188+0000 7fdfd20ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-06T06:50:51.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-06T06:50:51.172 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:50:51.251 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:51.248+0000 7fb1127f97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-06T06:50:51.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:51.248+0000 7fb1127f97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-06T06:50:51.253 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:51.248+0000 7fb1127f97c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-06T06:50:51.253 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:51.248+0000 7fb1127f97c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-06T06:50:51.253 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:51.248+0000 7fb1127f97c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-06T06:50:51.253 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:51.252+0000 7fb1127f97c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-06T06:50:54.238 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-06T06:50:54.297 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:50:54.379 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:54.376+0000 7f3a20d4b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-06T06:50:54.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:54.376+0000 7f3a20d4b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-06T06:50:54.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:54.376+0000 7f3a20d4b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-06T06:50:54.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:54.376+0000 7f3a20d4b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-06T06:50:54.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:54.376+0000 7f3a20d4b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-06T06:50:54.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:54.376+0000 7f3a20d4b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-06T06:50:57.341 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-06T06:50:57.398 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:50:57.479 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:57.476+0000 7fbf7e1a57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-06T06:50:57.480 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:57.476+0000 7fbf7e1a57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-06T06:50:57.480 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:57.476+0000 7fbf7e1a57c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-06T06:50:57.480 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:57.476+0000 7fbf7e1a57c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-06T06:50:57.480 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:57.476+0000 7fbf7e1a57c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-06T06:50:57.481 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:50:57.476+0000 7fbf7e1a57c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-06T06:51:00.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-06T06:51:00.543 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-06T06:51:00.543 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:51:00.544 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-06T06:51:00.558 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:51:00.558 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-06T06:51:00.613 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:51:00.613 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-06T06:51:00.669 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:51:00.669 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-06T06:51:00.726 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:51:00.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-06T06:51:00.785 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:51:00.785 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-06T06:51:00.798 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:51:00.799 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-06T06:51:00.853 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:51:00.854 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-06T06:51:00.908 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:51:00.908 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-06T06:51:00.960 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:51:00.960 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-06T06:51:01.017 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:51:01.017 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-06T06:51:01.023 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:51:01.023 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-06T06:51:01.065 INFO:tasks.ceph:Adding keys to all mons... 2024-05-06T06:51:01.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-06T06:51:01.068 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-06T06:51:01.112 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.y] 2024-05-06T06:51:01.112 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQC3fThmpbggLRAADE/AIAWK46GpY5In7WA1Iw== 2024-05-06T06:51:01.112 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.0] 2024-05-06T06:51:01.112 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQC4fThm3wemORAA8XYTWS50O+ADVb1pLFDJkA== 2024-05-06T06:51:01.112 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.1] 2024-05-06T06:51:01.112 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQC8fThmuW2zARAAnaHaoAUzdyWTquFlYoDVfg== 2024-05-06T06:51:01.112 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.2] 2024-05-06T06:51:01.112 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQC/fThmFwpvCBAAh4HUCcRr8AYr/uE5aVKFKw== 2024-05-06T06:51:01.112 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.3] 2024-05-06T06:51:01.112 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDCfThmMWtxDhAApiiuPo8OGQQ6mwZCOohptg== 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout:[mgr.x] 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQC3fThmimycLxAAafI6ulr0XjN5buxzBwdwSw== 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.4] 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDIfThmJCRQCxAAqbb4tMnv2Sp0NWDp+xdW/g== 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.5] 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDLfThmNQAUDxAAbYlSpdbutAXaOoblD8JjSw== 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.6] 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDOfThmr32sFhAAlfE3gJLKZyoXxc9UnvBHYw== 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout:[osd.7] 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQDRfThmhCupHBAANVSJQid20r0ivw89DZEbCw== 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQC3fThmdt6aMhAAYg1CVMvvyhzw/0FX7pPkdw== 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout:[client.1] 2024-05-06T06:51:01.113 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQC3fThmkWHwNBAALB/HNDMnQ9cMXe91vidEgw== 2024-05-06T06:51:01.119 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2024-05-06T06:51:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC3fThmpbggLRAADE/AIAWK46GpY5In7WA1Iw== 2024-05-06T06:51:01.119 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2024-05-06T06:51:01.119 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC4fThm3wemORAA8XYTWS50O+ADVb1pLFDJkA== 2024-05-06T06:51:01.119 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC8fThmuW2zARAAnaHaoAUzdyWTquFlYoDVfg== 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC/fThmFwpvCBAAh4HUCcRr8AYr/uE5aVKFKw== 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDCfThmMWtxDhAApiiuPo8OGQQ6mwZCOohptg== 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC3fThmimycLxAAafI6ulr0XjN5buxzBwdwSw== 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDIfThmJCRQCxAAqbb4tMnv2Sp0NWDp+xdW/g== 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDLfThmNQAUDxAAbYlSpdbutAXaOoblD8JjSw== 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDOfThmr32sFhAAlfE3gJLKZyoXxc9UnvBHYw== 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQDRfThmhCupHBAANVSJQid20r0ivw89DZEbCw== 2024-05-06T06:51:01.120 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2024-05-06T06:51:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC3fThmdt6aMhAAYg1CVMvvyhzw/0FX7pPkdw== 2024-05-06T06:51:01.121 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2024-05-06T06:51:01.121 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQC3fThmkWHwNBAALB/HNDMnQ9cMXe91vidEgw== 2024-05-06T06:51:01.121 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-06T06:51:01.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-06T06:51:01.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.251 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.295 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.339 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.386 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.419 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.476 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.499 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.555 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-06T06:51:01.583 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-06T06:51:01.635 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.667 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.751 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.796 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.831 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.882 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.919 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-06T06:51:01.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-06T06:51:02.003 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-06T06:51:02.060 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-06T06:51:02.062 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-06T06:51:02.109 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-06T06:51:02.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-06T06:51:02.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-06T06:51:02.249 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-06T06:51:02.259 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-06T06:51:02.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-06T06:51:02.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-06T06:51:02.451 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-06T06:51:02.465 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-06T06:51:02.560 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-06T06:51:02.571 DEBUG:teuthology.orchestra.run.smithi070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:51:02.574 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-06T06:51:02.620 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-06T06:51:02.621 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-06T06:51:02.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-06T06:51:02.623 INFO:tasks.ceph.mon.a:Started 2024-05-06T06:51:02.623 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-06T06:51:02.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-06T06:51:02.626 INFO:tasks.ceph.mon.c:Started 2024-05-06T06:51:02.626 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-06T06:51:02.626 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-06T06:51:02.666 INFO:tasks.ceph.mon.b:Started 2024-05-06T06:51:02.666 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-06T06:51:02.667 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-06T06:51:02.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-06T06:51:02.669 INFO:tasks.ceph.mgr.y:Started 2024-05-06T06:51:02.669 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-06T06:51:02.669 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-06T06:51:02.671 INFO:tasks.ceph.mgr.x:Started 2024-05-06T06:51:02.671 INFO:tasks.ceph:Setting crush tunables to default 2024-05-06T06:51:02.671 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd crush tunables default 2024-05-06T06:51:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:02.782+0000 7fe0ead61640 1 Processor -- start 2024-05-06T06:51:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:02.782+0000 7fe0ead61640 1 -- start start 2024-05-06T06:51:02.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:02.782+0000 7fe0ead61640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e40b2650 con 0x7fe0e40aa840 2024-05-06T06:51:02.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:02.782+0000 7fe0ead61640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e40b2b30 con 0x7fe0e40aa460 2024-05-06T06:51:02.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:02.782+0000 7fe0ead61640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e40b3050 con 0x7fe0e40ab220 2024-05-06T06:51:02.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:02.782+0000 7fe0e3fff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fe0e40ab220 0x7fe0e40b5e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:49468/0 (socket says 172.21.15.70:49468) 2024-05-06T06:51:02.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:02.782+0000 7fe0e3fff640 1 -- 172.21.15.70:0/1221274552 learned_addr learned my addr 172.21.15.70:0/1221274552 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:05.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:05.782+0000 7fe0e27fc640 1 -- 172.21.15.70:0/1221274552 >> v1:172.21.15.70:6790/0 conn(0x7fe0e40ab220 legacy=0x7fe0e40b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:05.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:05.782+0000 7fe0e27fc640 1 -- 172.21.15.70:0/1221274552 >> v1:172.21.15.184:6789/0 conn(0x7fe0e40aa460 legacy=0x7fe0e41433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:05.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:05.782+0000 7fe0e27fc640 1 -- 172.21.15.70:0/1221274552 >> v1:172.21.15.70:6789/0 conn(0x7fe0e40aa840 legacy=0x7fe0e40b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:05.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:05.782+0000 7fe0e27fc640 1 -- 172.21.15.70:0/1221274552 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e40b3220 con 0x7fe0c80036f0 2024-05-06T06:51:05.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:05.782+0000 7fe0e27fc640 1 -- 172.21.15.70:0/1221274552 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c800f3a0 con 0x7fe0e40aa460 2024-05-06T06:51:05.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:05.782+0000 7fe0e27fc640 1 -- 172.21.15.70:0/1221274552 --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c8010640 con 0x7fe0e40ab220 2024-05-06T06:51:08.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.054+0000 7fe0e37fe640 1 -- 172.21.15.70:0/1221274552 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1185787517 0 0) 0x7fe0e40b3220 con 0x7fe0c80036f0 2024-05-06T06:51:08.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.054+0000 7fe0e37fe640 1 -- 172.21.15.70:0/1221274552 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0d4003530 con 0x7fe0c80036f0 2024-05-06T06:51:08.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.054+0000 7fe0e37fe640 1 -- 172.21.15.70:0/1221274552 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756462809 0 0) 0x7fe0c8010640 con 0x7fe0e40ab220 2024-05-06T06:51:08.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.054+0000 7fe0e37fe640 1 -- 172.21.15.70:0/1221274552 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0e40b3220 con 0x7fe0e40ab220 2024-05-06T06:51:08.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.054+0000 7fe0e37fe640 1 -- 172.21.15.70:0/1221274552 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3526959557 0 0) 0x7fe0e40b3220 con 0x7fe0e40ab220 2024-05-06T06:51:08.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.054+0000 7fe0e37fe640 1 -- 172.21.15.70:0/1221274552 >> v1:172.21.15.184:6789/0 conn(0x7fe0e40aa460 legacy=0x7fe0c80093b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.054+0000 7fe0e37fe640 1 -- 172.21.15.70:0/1221274552 >> v1:172.21.15.70:6789/0 conn(0x7fe0c80036f0 legacy=0x7fe0c8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.054+0000 7fe0e37fe640 1 -- 172.21.15.70:0/1221274552 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c80118e0 con 0x7fe0e40ab220 2024-05-06T06:51:08.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.054+0000 7fe0e37fe640 1 -- 172.21.15.70:0/1221274552 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe0dc0019a0 con 0x7fe0e40ab220 2024-05-06T06:51:08.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.058+0000 7fe0e37fe640 1 -- 172.21.15.70:0/1221274552 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0dc001b60 con 0x7fe0e40ab220 2024-05-06T06:51:08.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.058+0000 7fe0e37fe640 1 -- 172.21.15.70:0/1221274552 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe0dc001fb0 con 0x7fe0e40ab220 2024-05-06T06:51:08.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.058+0000 7fe0ead61640 1 -- 172.21.15.70:0/1221274552 >> v1:172.21.15.70:6790/0 conn(0x7fe0e40ab220 legacy=0x7fe0c800cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.058+0000 7fe0ead61640 1 -- 172.21.15.70:0/1221274552 shutdown_connections 2024-05-06T06:51:08.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.058+0000 7fe0ead61640 1 -- 172.21.15.70:0/1221274552 >> 172.21.15.70:0/1221274552 conn(0x7fe0e4073c80 msgr2=0x7fe0e4074090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:08.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.058+0000 7fe0ead61640 1 -- 172.21.15.70:0/1221274552 shutdown_connections 2024-05-06T06:51:08.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.058+0000 7fe0ead61640 1 -- 172.21.15.70:0/1221274552 wait complete. 2024-05-06T06:51:08.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.062+0000 7fe0ead61640 1 Processor -- start 2024-05-06T06:51:08.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.062+0000 7fe0ead61640 1 -- start start 2024-05-06T06:51:08.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.062+0000 7fe0ead61640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e40aeda0 con 0x7fe0e40ab220 2024-05-06T06:51:08.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.062+0000 7fe0ead61640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e40ae9c0 con 0x7fe0e40aa460 2024-05-06T06:51:08.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.062+0000 7fe0ead61640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e40b11b0 con 0x7fe0c80036f0 2024-05-06T06:51:08.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.062+0000 7fe0e8afd640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fe0c80036f0 0x7fe0e40b0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:34296/0 (socket says 172.21.15.70:34296) 2024-05-06T06:51:08.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.062+0000 7fe0e8afd640 1 -- 172.21.15.70:0/428027953 learned_addr learned my addr 172.21.15.70:0/428027953 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:08.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917458382 0 0) 0x7fe0e40b11b0 con 0x7fe0c80036f0 2024-05-06T06:51:08.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c800e9f0 con 0x7fe0c80036f0 2024-05-06T06:51:08.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3654618051 0 0) 0x7fe0c800e9f0 con 0x7fe0c80036f0 2024-05-06T06:51:08.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0e40b11b0 con 0x7fe0c80036f0 2024-05-06T06:51:08.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe0d0001a60 con 0x7fe0c80036f0 2024-05-06T06:51:08.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3048306600 0 0) 0x7fe0e40aeda0 con 0x7fe0e40ab220 2024-05-06T06:51:08.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c800e9f0 con 0x7fe0e40ab220 2024-05-06T06:51:08.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3606286836 0 0) 0x7fe0c800e9f0 con 0x7fe0e40ab220 2024-05-06T06:51:08.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0e40aeda0 con 0x7fe0e40ab220 2024-05-06T06:51:08.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe0dc001eb0 con 0x7fe0e40ab220 2024-05-06T06:51:08.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2063543956 0 0) 0x7fe0e40aeda0 con 0x7fe0e40ab220 2024-05-06T06:51:08.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 >> v1:172.21.15.70:6790/0 conn(0x7fe0c80036f0 legacy=0x7fe0e40b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 >> v1:172.21.15.184:6789/0 conn(0x7fe0e40aa460 legacy=0x7fe0e413bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e40b1380 con 0x7fe0e40ab220 2024-05-06T06:51:08.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0ead61640 1 -- 172.21.15.70:0/428027953 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e40adfb0 con 0x7fe0e40ab220 2024-05-06T06:51:08.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0ead61640 1 -- 172.21.15.70:0/428027953 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe0e40af490 con 0x7fe0e40ab220 2024-05-06T06:51:08.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0ead61640 1 -- 172.21.15.70:0/428027953 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e40640c0 con 0x7fe0e40ab220 2024-05-06T06:51:08.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.066+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0dc0020b0 con 0x7fe0e40ab220 2024-05-06T06:51:08.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.070+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe0dc003c30 con 0x7fe0e40ab220 2024-05-06T06:51:08.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.070+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7fe0dc004160 con 0x7fe0e40ab220 2024-05-06T06:51:08.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.070+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 1803594661 0 0) 0x7fe0dc0055a0 con 0x7fe0e40ab220 2024-05-06T06:51:08.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.070+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (unknown 1092875540 0 534071502) 0x7fe0dc0059e0 con 0x7fe0e40ab220 2024-05-06T06:51:08.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.158+0000 7fe0ead61640 1 -- 172.21.15.70:0/428027953 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe0e406c400 con 0x7fe0e40ab220 2024-05-06T06:51:08.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.162+0000 7fe0e17fa640 1 -- 172.21.15.70:0/428027953 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7fe0dc004450 con 0x7fe0e40ab220 2024-05-06T06:51:08.162 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-05-06T06:51:08.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.162+0000 7fe0ead61640 1 -- 172.21.15.70:0/428027953 >> v1:172.21.15.70:6789/0 conn(0x7fe0e40ab220 legacy=0x7fe0e41e3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.162+0000 7fe0ead61640 1 -- 172.21.15.70:0/428027953 shutdown_connections 2024-05-06T06:51:08.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.162+0000 7fe0ead61640 1 -- 172.21.15.70:0/428027953 >> 172.21.15.70:0/428027953 conn(0x7fe0e4073c80 msgr2=0x7fe0e406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:08.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.162+0000 7fe0ead61640 1 -- 172.21.15.70:0/428027953 shutdown_connections 2024-05-06T06:51:08.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:08.162+0000 7fe0ead61640 1 -- 172.21.15.70:0/428027953 wait complete. 2024-05-06T06:51:08.186 INFO:tasks.ceph:check_enable_crimson: False 2024-05-06T06:51:08.187 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-06T06:51:08.187 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:51:08.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-06T06:51:08.198 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:51:08.199 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-06T06:51:08.252 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:51:08.252 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-06T06:51:08.259 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:08.256+0000 7f36fb9b1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T06:51:08.273 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:08.270+0000 7f91fab30180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-06T06:51:08.284 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:51:08.284 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-06T06:51:08.340 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:51:08.341 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-06T06:51:08.354 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:51:08.354 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-06T06:51:08.409 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:51:08.409 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-06T06:51:08.464 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-05-06T06:51:08.464 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-06T06:51:08.516 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new e2c1f594-6b3c-49a9-b307-6b6284d59048 0 2024-05-06T06:51:08.680 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.676+0000 7f91d82d4640 1 Processor -- start 2024-05-06T06:51:08.680 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.676+0000 7f91d82d4640 1 -- start start 2024-05-06T06:51:08.681 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.676+0000 7f91d82d4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d0073ed0 con 0x7f91d00b1690 2024-05-06T06:51:08.681 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.676+0000 7f91d82d4640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d00741b0 con 0x7f91d0071f50 2024-05-06T06:51:08.681 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.676+0000 7f91d82d4640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d0072d90 con 0x7f91d0072330 2024-05-06T06:51:08.681 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.676+0000 7f91d6070640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f91d0071f50 0x7f91d0141930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43454/0 (socket says 172.21.15.184:43454) 2024-05-06T06:51:08.681 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.676+0000 7f91d6070640 1 -- 172.21.15.184:0/570722715 learned_addr learned my addr 172.21.15.184:0/570722715 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:08.682 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d506e640 1 -- 172.21.15.184:0/570722715 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547762148 0 0) 0x7f91d00741b0 con 0x7f91d0071f50 2024-05-06T06:51:08.682 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d506e640 1 -- 172.21.15.184:0/570722715 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91bc003530 con 0x7f91d0071f50 2024-05-06T06:51:08.682 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d506e640 1 -- 172.21.15.184:0/570722715 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3712876745 0 0) 0x7f91bc003530 con 0x7f91d0071f50 2024-05-06T06:51:08.682 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d506e640 1 -- 172.21.15.184:0/570722715 >> v1:172.21.15.70:6790/0 conn(0x7f91d0072330 legacy=0x7f91d014cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.682 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d506e640 1 -- 172.21.15.184:0/570722715 >> v1:172.21.15.70:6789/0 conn(0x7f91d00b1690 legacy=0x7f91d013e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.682 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d506e640 1 -- 172.21.15.184:0/570722715 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d0142040 con 0x7f91d0071f50 2024-05-06T06:51:08.682 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d506e640 1 -- 172.21.15.184:0/570722715 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f91c8001a20 con 0x7f91d0071f50 2024-05-06T06:51:08.682 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d506e640 1 -- 172.21.15.184:0/570722715 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91c8001c40 con 0x7f91d0071f50 2024-05-06T06:51:08.682 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d506e640 1 -- 172.21.15.184:0/570722715 <== mon.1 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f91c80020d0 con 0x7f91d0071f50 2024-05-06T06:51:08.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d82d4640 1 -- 172.21.15.184:0/570722715 >> v1:172.21.15.184:6789/0 conn(0x7f91d0071f50 legacy=0x7f91d0141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d82d4640 1 -- 172.21.15.184:0/570722715 shutdown_connections 2024-05-06T06:51:08.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d82d4640 1 -- 172.21.15.184:0/570722715 >> 172.21.15.184:0/570722715 conn(0x7f91d00b6c90 msgr2=0x7f91d00b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:08.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d82d4640 1 -- 172.21.15.184:0/570722715 shutdown_connections 2024-05-06T06:51:08.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d82d4640 1 -- 172.21.15.184:0/570722715 wait complete. 2024-05-06T06:51:08.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d82d4640 1 Processor -- start 2024-05-06T06:51:08.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d82d4640 1 -- start start 2024-05-06T06:51:08.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d82d4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d0144190 con 0x7f91d0072330 2024-05-06T06:51:08.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d82d4640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d00b4880 con 0x7f91d0071f50 2024-05-06T06:51:08.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d82d4640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91d0144f00 con 0x7f91d00b1690 2024-05-06T06:51:08.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d6070640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f91d0071f50 0x7f91d01439e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43462/0 (socket says 172.21.15.184:43462) 2024-05-06T06:51:08.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d6070640 1 -- 172.21.15.184:0/276445442 learned_addr learned my addr 172.21.15.184:0/276445442 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:08.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3700167410 0 0) 0x7f91d00b4880 con 0x7f91d0071f50 2024-05-06T06:51:08.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91b4003530 con 0x7f91d0071f50 2024-05-06T06:51:08.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3373435829 0 0) 0x7f91b4003530 con 0x7f91d0071f50 2024-05-06T06:51:08.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91d00b4880 con 0x7f91d0071f50 2024-05-06T06:51:08.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f91c8001f90 con 0x7f91d0071f50 2024-05-06T06:51:08.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3660798282 0 0) 0x7f91d0144f00 con 0x7f91d00b1690 2024-05-06T06:51:08.686 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91b4003530 con 0x7f91d00b1690 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836784990 0 0) 0x7f91d0144190 con 0x7f91d0072330 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91d0144f00 con 0x7f91d0072330 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 <== mon.1 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3964775638 0 0) 0x7f91d00b4880 con 0x7f91d0071f50 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 >> v1:172.21.15.70:6790/0 conn(0x7f91d00b1690 legacy=0x7f91d01d9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 >> v1:172.21.15.70:6789/0 conn(0x7f91d0072330 legacy=0x7f91d00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d01451e0 con 0x7f91d0071f50 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d82d4640 1 -- 172.21.15.184:0/276445442 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f91d00b02f0 con 0x7f91d0071f50 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91d82d4640 1 -- 172.21.15.184:0/276445442 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f91d0142fb0 con 0x7f91d0071f50 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 <== mon.1 v1:172.21.15.184:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91c8001ba0 con 0x7f91d0071f50 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.680+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 <== mon.1 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f91c80051e0 con 0x7f91d0071f50 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.684+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 <== mon.1 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f91c8005710 con 0x7f91d0071f50 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.684+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 <== mon.1 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (unknown 170191923 0 0) 0x7f91c8006b90 con 0x7f91d0071f50 2024-05-06T06:51:08.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.684+0000 7f91d82d4640 1 -- 172.21.15.184:0/276445442 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b8005090 con 0x7f91d0071f50 2024-05-06T06:51:08.688 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.684+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 <== mon.1 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (unknown 1092875540 0 534071502) 0x7f91c8005bb0 con 0x7f91d0071f50 2024-05-06T06:51:08.750 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:08.748+0000 7f36fb9b1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T06:51:08.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.752+0000 7f91d82d4640 1 -- 172.21.15.184:0/276445442 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd new", "uuid": "e2c1f594-6b3c-49a9-b307-6b6284d59048", "id": 0} v 0) -- 0x7f91b8005380 con 0x7f91d0071f50 2024-05-06T06:51:08.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.760+0000 7f91c6ffd640 1 -- 172.21.15.184:0/276445442 <== mon.1 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e2c1f594-6b3c-49a9-b307-6b6284d59048", "id": 0}]=0 v3) ==== 112+0+2 (unknown 3442829442 0 732707515) 0x7f91c8005e60 con 0x7f91d0071f50 2024-05-06T06:51:08.762 INFO:teuthology.orchestra.run.smithi184.stdout:0 2024-05-06T06:51:08.763 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.760+0000 7f91d82d4640 1 -- 172.21.15.184:0/276445442 >> v1:172.21.15.184:6789/0 conn(0x7f91d0071f50 legacy=0x7f91d01439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.764 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.760+0000 7f91d82d4640 1 -- 172.21.15.184:0/276445442 shutdown_connections 2024-05-06T06:51:08.764 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.760+0000 7f91d82d4640 1 -- 172.21.15.184:0/276445442 >> 172.21.15.184:0/276445442 conn(0x7f91d00b6c90 msgr2=0x7f91d00b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:08.764 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.760+0000 7f91d82d4640 1 -- 172.21.15.184:0/276445442 shutdown_connections 2024-05-06T06:51:08.764 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.760+0000 7f91d82d4640 1 -- 172.21.15.184:0/276445442 wait complete. 2024-05-06T06:51:08.764 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:08.762+0000 7f91fab30180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-06T06:51:08.779 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new fc494199-771b-4efe-85cf-edd309f73659 1 2024-05-06T06:51:08.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.888+0000 7f6183506640 1 Processor -- start 2024-05-06T06:51:08.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.888+0000 7f6183506640 1 -- start start 2024-05-06T06:51:08.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.888+0000 7f6183506640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f617c073ed0 con 0x7f617c071f50 2024-05-06T06:51:08.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.888+0000 7f6183506640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f617c0741b0 con 0x7f617c072330 2024-05-06T06:51:08.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.888+0000 7f6183506640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f617c072d90 con 0x7f617c0b1690 2024-05-06T06:51:08.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.888+0000 7f6181aa3640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f617c072330 0x7f617c14cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43468/0 (socket says 172.21.15.184:43468) 2024-05-06T06:51:08.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.888+0000 7f6181aa3640 1 -- 172.21.15.184:0/1049122185 learned_addr learned my addr 172.21.15.184:0/1049122185 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:08.894 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6173fff640 1 -- 172.21.15.184:0/1049122185 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 451757561 0 0) 0x7f617c0741b0 con 0x7f617c072330 2024-05-06T06:51:08.894 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6173fff640 1 -- 172.21.15.184:0/1049122185 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6168003530 con 0x7f617c072330 2024-05-06T06:51:08.894 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6173fff640 1 -- 172.21.15.184:0/1049122185 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1217683532 0 0) 0x7f6168003530 con 0x7f617c072330 2024-05-06T06:51:08.894 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6173fff640 1 -- 172.21.15.184:0/1049122185 >> v1:172.21.15.70:6790/0 conn(0x7f617c0b1690 legacy=0x7f617c13e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.894 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6173fff640 1 -- 172.21.15.184:0/1049122185 >> v1:172.21.15.70:6789/0 conn(0x7f617c071f50 legacy=0x7f617c141930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.894 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6173fff640 1 -- 172.21.15.184:0/1049122185 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617c142040 con 0x7f617c072330 2024-05-06T06:51:08.894 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6173fff640 1 -- 172.21.15.184:0/1049122185 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6174001a20 con 0x7f617c072330 2024-05-06T06:51:08.894 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6173fff640 1 -- 172.21.15.184:0/1049122185 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6174001c40 con 0x7f617c072330 2024-05-06T06:51:08.894 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6173fff640 1 -- 172.21.15.184:0/1049122185 <== mon.1 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f61740020d0 con 0x7f617c072330 2024-05-06T06:51:08.895 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6183506640 1 -- 172.21.15.184:0/1049122185 >> v1:172.21.15.184:6789/0 conn(0x7f617c072330 legacy=0x7f617c14cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.895 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6183506640 1 -- 172.21.15.184:0/1049122185 shutdown_connections 2024-05-06T06:51:08.895 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6183506640 1 -- 172.21.15.184:0/1049122185 >> 172.21.15.184:0/1049122185 conn(0x7f617c0b6c90 msgr2=0x7f617c0b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:08.895 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6183506640 1 -- 172.21.15.184:0/1049122185 shutdown_connections 2024-05-06T06:51:08.895 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6183506640 1 -- 172.21.15.184:0/1049122185 wait complete. 2024-05-06T06:51:08.895 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6183506640 1 Processor -- start 2024-05-06T06:51:08.896 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6183506640 1 -- start start 2024-05-06T06:51:08.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6183506640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f617c0aec80 con 0x7f617c071f50 2024-05-06T06:51:08.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6183506640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f617c06c400 con 0x7f617c0b1690 2024-05-06T06:51:08.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6183506640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f617c1d9370 con 0x7f617c072330 2024-05-06T06:51:08.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6181aa3640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f617c0b1690 0x7f617c133d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43472/0 (socket says 172.21.15.184:43472) 2024-05-06T06:51:08.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6181aa3640 1 -- 172.21.15.184:0/3905058046 learned_addr learned my addr 172.21.15.184:0/3905058046 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:08.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564400719 0 0) 0x7f617c06c400 con 0x7f617c0b1690 2024-05-06T06:51:08.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6160003530 con 0x7f617c0b1690 2024-05-06T06:51:08.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3211501219 0 0) 0x7f6160003530 con 0x7f617c0b1690 2024-05-06T06:51:08.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f617c06c400 con 0x7f617c0b1690 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6174001f90 con 0x7f617c0b1690 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224061731 0 0) 0x7f617c1d9370 con 0x7f617c072330 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6160003530 con 0x7f617c072330 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043418248 0 0) 0x7f617c0aec80 con 0x7f617c071f50 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f617c1d9370 con 0x7f617c071f50 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 <== mon.1 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4095495067 0 0) 0x7f617c06c400 con 0x7f617c0b1690 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 >> v1:172.21.15.70:6790/0 conn(0x7f617c072330 legacy=0x7f617c0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 >> v1:172.21.15.70:6789/0 conn(0x7f617c071f50 legacy=0x7f617c1d8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617c1d9540 con 0x7f617c0b1690 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6183506640 1 -- 172.21.15.184:0/3905058046 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f617c0af8b0 con 0x7f617c0b1690 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6183506640 1 -- 172.21.15.184:0/3905058046 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f617c13af10 con 0x7f617c0b1690 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 <== mon.1 v1:172.21.15.184:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6174005040 con 0x7f617c0b1690 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 <== mon.1 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6174005390 con 0x7f617c0b1690 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.892+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 <== mon.1 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f61740058c0 con 0x7f617c0b1690 2024-05-06T06:51:08.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.896+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 <== mon.1 v1:172.21.15.184:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (unknown 784433289 0 0) 0x7f6174006b70 con 0x7f617c0b1690 2024-05-06T06:51:08.900 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.896+0000 7f6183506640 1 -- 172.21.15.184:0/3905058046 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f615c005090 con 0x7f617c0b1690 2024-05-06T06:51:08.900 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.896+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 <== mon.1 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (unknown 1092875540 0 534071502) 0x7f6174005bb0 con 0x7f617c0b1690 2024-05-06T06:51:08.941 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:08.938+0000 7f91fab30180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T06:51:08.959 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:08.956+0000 7f36fb9b1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-06T06:51:08.968 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.964+0000 7f6183506640 1 -- 172.21.15.184:0/3905058046 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd new", "uuid": "fc494199-771b-4efe-85cf-edd309f73659", "id": 1} v 0) -- 0x7f615c005380 con 0x7f617c0b1690 2024-05-06T06:51:08.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.968+0000 7f6171ffb640 1 -- 172.21.15.184:0/3905058046 <== mon.1 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc494199-771b-4efe-85cf-edd309f73659", "id": 1}]=0 v4) ==== 112+0+2 (unknown 4032079369 0 940483276) 0x7f6174005e60 con 0x7f617c0b1690 2024-05-06T06:51:08.973 INFO:teuthology.orchestra.run.smithi184.stdout:1 2024-05-06T06:51:08.974 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.972+0000 7f6183506640 1 -- 172.21.15.184:0/3905058046 >> v1:172.21.15.184:6789/0 conn(0x7f617c0b1690 legacy=0x7f617c133d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:08.974 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.972+0000 7f6183506640 1 -- 172.21.15.184:0/3905058046 shutdown_connections 2024-05-06T06:51:08.974 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.972+0000 7f6183506640 1 -- 172.21.15.184:0/3905058046 >> 172.21.15.184:0/3905058046 conn(0x7f617c0b6c90 msgr2=0x7f617c0b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:08.974 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.972+0000 7f6183506640 1 -- 172.21.15.184:0/3905058046 shutdown_connections 2024-05-06T06:51:08.974 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:08.972+0000 7f6183506640 1 -- 172.21.15.184:0/3905058046 wait complete. 2024-05-06T06:51:08.989 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 5f691dc1-d6f0-4c85-9544-86c9b7cfa3b3 2 2024-05-06T06:51:09.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.100+0000 7f1272125640 1 Processor -- start 2024-05-06T06:51:09.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.100+0000 7f1272125640 1 -- start start 2024-05-06T06:51:09.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.100+0000 7f1272125640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126c071070 con 0x7f126c06ffe0 2024-05-06T06:51:09.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.100+0000 7f1272125640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126c0af250 con 0x7f126c147060 2024-05-06T06:51:09.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.100+0000 7f1272125640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126c071350 con 0x7f126c075d80 2024-05-06T06:51:09.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.100+0000 7f126bfff640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f126c147060 0x7f126c14eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43486/0 (socket says 172.21.15.184:43486) 2024-05-06T06:51:09.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.100+0000 7f126bfff640 1 -- 172.21.15.184:0/3836625649 learned_addr learned my addr 172.21.15.184:0/3836625649 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:09.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f126a7fc640 1 -- 172.21.15.184:0/3836625649 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439194637 0 0) 0x7f126c0af250 con 0x7f126c147060 2024-05-06T06:51:09.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f126a7fc640 1 -- 172.21.15.184:0/3836625649 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1254003530 con 0x7f126c147060 2024-05-06T06:51:09.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f126a7fc640 1 -- 172.21.15.184:0/3836625649 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2915098003 0 0) 0x7f1254003530 con 0x7f126c147060 2024-05-06T06:51:09.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f126a7fc640 1 -- 172.21.15.184:0/3836625649 >> v1:172.21.15.70:6790/0 conn(0x7f126c075d80 legacy=0x7f126c140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f126a7fc640 1 -- 172.21.15.184:0/3836625649 >> v1:172.21.15.70:6789/0 conn(0x7f126c06ffe0 legacy=0x7f126c146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f126a7fc640 1 -- 172.21.15.184:0/3836625649 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c0704c0 con 0x7f126c147060 2024-05-06T06:51:09.107 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f126a7fc640 1 -- 172.21.15.184:0/3836625649 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f1264001a20 con 0x7f126c147060 2024-05-06T06:51:09.107 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f126a7fc640 1 -- 172.21.15.184:0/3836625649 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1264001c40 con 0x7f126c147060 2024-05-06T06:51:09.107 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f126a7fc640 1 -- 172.21.15.184:0/3836625649 <== mon.1 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f12640020d0 con 0x7f126c147060 2024-05-06T06:51:09.107 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1272125640 1 -- 172.21.15.184:0/3836625649 >> v1:172.21.15.184:6789/0 conn(0x7f126c147060 legacy=0x7f126c14eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.107 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1272125640 1 -- 172.21.15.184:0/3836625649 shutdown_connections 2024-05-06T06:51:09.107 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1272125640 1 -- 172.21.15.184:0/3836625649 >> 172.21.15.184:0/3836625649 conn(0x7f126c0b1c40 msgr2=0x7f126c0b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:09.107 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1272125640 1 -- 172.21.15.184:0/3836625649 shutdown_connections 2024-05-06T06:51:09.107 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1272125640 1 -- 172.21.15.184:0/3836625649 wait complete. 2024-05-06T06:51:09.110 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1272125640 1 Processor -- start 2024-05-06T06:51:09.110 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1272125640 1 -- start start 2024-05-06T06:51:09.110 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1272125640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126c136920 con 0x7f126c075d80 2024-05-06T06:51:09.110 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1272125640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126c143d30 con 0x7f126c06ffe0 2024-05-06T06:51:09.110 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1272125640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126c136b90 con 0x7f126c147060 2024-05-06T06:51:09.110 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f126b7fe640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f126c06ffe0 0x7f126c137570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43498/0 (socket says 172.21.15.184:43498) 2024-05-06T06:51:09.110 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f126b7fe640 1 -- 172.21.15.184:0/2835308988 learned_addr learned my addr 172.21.15.184:0/2835308988 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 826439624 0 0) 0x7f126c143d30 con 0x7f126c06ffe0 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1258003530 con 0x7f126c06ffe0 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 306528258 0 0) 0x7f1258003530 con 0x7f126c06ffe0 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f126c143d30 con 0x7f126c06ffe0 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f125c0019e0 con 0x7f126c06ffe0 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315182797 0 0) 0x7f126c136b90 con 0x7f126c147060 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1258003530 con 0x7f126c147060 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537096479 0 0) 0x7f126c136920 con 0x7f126c075d80 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f126c136b90 con 0x7f126c075d80 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 <== mon.1 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3266816083 0 0) 0x7f126c143d30 con 0x7f126c06ffe0 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 >> v1:172.21.15.70:6790/0 conn(0x7f126c147060 legacy=0x7f126c1e3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 >> v1:172.21.15.70:6789/0 conn(0x7f126c075d80 legacy=0x7f126c1421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c136e70 con 0x7f126c06ffe0 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1272125640 1 -- 172.21.15.184:0/2835308988 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f126c137150 con 0x7f126c06ffe0 2024-05-06T06:51:09.111 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1272125640 1 -- 172.21.15.184:0/2835308988 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f126c1357d0 con 0x7f126c06ffe0 2024-05-06T06:51:09.112 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 <== mon.1 v1:172.21.15.184:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f125c001d20 con 0x7f126c06ffe0 2024-05-06T06:51:09.112 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 <== mon.1 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f125c003a70 con 0x7f126c06ffe0 2024-05-06T06:51:09.112 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 <== mon.1 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f125c004020 con 0x7f126c06ffe0 2024-05-06T06:51:09.112 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.104+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 <== mon.1 v1:172.21.15.184:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (unknown 3912149664 0 0) 0x7f125c006880 con 0x7f126c06ffe0 2024-05-06T06:51:09.112 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.108+0000 7f1272125640 1 -- 172.21.15.184:0/2835308988 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f124c005090 con 0x7f126c06ffe0 2024-05-06T06:51:09.112 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.108+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 <== mon.1 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (unknown 1092875540 0 534071502) 0x7f125c005c90 con 0x7f126c06ffe0 2024-05-06T06:51:09.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.176+0000 7f1272125640 1 -- 172.21.15.184:0/2835308988 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd new", "uuid": "5f691dc1-d6f0-4c85-9544-86c9b7cfa3b3", "id": 2} v 0) -- 0x7f124c005380 con 0x7f126c06ffe0 2024-05-06T06:51:09.185 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.184+0000 7f1253fff640 1 -- 172.21.15.184:0/2835308988 <== mon.1 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f691dc1-d6f0-4c85-9544-86c9b7cfa3b3", "id": 2}]=0 v5) ==== 112+0+2 (unknown 2236867637 0 216599125) 0x7f125c006460 con 0x7f126c06ffe0 2024-05-06T06:51:09.185 INFO:teuthology.orchestra.run.smithi184.stdout:2 2024-05-06T06:51:09.186 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.184+0000 7f1272125640 1 -- 172.21.15.184:0/2835308988 >> v1:172.21.15.184:6789/0 conn(0x7f126c06ffe0 legacy=0x7f126c137570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.186 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.184+0000 7f1272125640 1 -- 172.21.15.184:0/2835308988 shutdown_connections 2024-05-06T06:51:09.186 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.184+0000 7f1272125640 1 -- 172.21.15.184:0/2835308988 >> 172.21.15.184:0/2835308988 conn(0x7f126c0b1c40 msgr2=0x7f126c14fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:09.186 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.184+0000 7f1272125640 1 -- 172.21.15.184:0/2835308988 shutdown_connections 2024-05-06T06:51:09.186 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.184+0000 7f1272125640 1 -- 172.21.15.184:0/2835308988 wait complete. 2024-05-06T06:51:09.201 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 36920237-b28f-4955-ab5a-c6fd2e74e74e 3 2024-05-06T06:51:09.313 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff6800de640 1 Processor -- start 2024-05-06T06:51:09.314 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff6800de640 1 -- start start 2024-05-06T06:51:09.315 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff6800de640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff678074ac0 con 0x7ff678144de0 2024-05-06T06:51:09.315 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff6800de640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff678145250 con 0x7ff67806b5b0 2024-05-06T06:51:09.315 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff6800de640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff678072a10 con 0x7ff67806b990 2024-05-06T06:51:09.315 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff67de7a640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7ff67806b5b0 0x7ff67813af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43506/0 (socket says 172.21.15.184:43506) 2024-05-06T06:51:09.315 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff67de7a640 1 -- 172.21.15.184:0/3649597746 learned_addr learned my addr 172.21.15.184:0/3649597746 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:09.315 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff67ce78640 1 -- 172.21.15.184:0/3649597746 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266006632 0 0) 0x7ff678145250 con 0x7ff67806b5b0 2024-05-06T06:51:09.315 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff67ce78640 1 -- 172.21.15.184:0/3649597746 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff664003530 con 0x7ff67806b5b0 2024-05-06T06:51:09.315 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff67ce78640 1 -- 172.21.15.184:0/3649597746 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3317913846 0 0) 0x7ff664003530 con 0x7ff67806b5b0 2024-05-06T06:51:09.315 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff67ce78640 1 -- 172.21.15.184:0/3649597746 >> v1:172.21.15.70:6790/0 conn(0x7ff67806b990 legacy=0x7ff6781446d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.316 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff67ce78640 1 -- 172.21.15.184:0/3649597746 >> v1:172.21.15.70:6789/0 conn(0x7ff678144de0 legacy=0x7ff67814ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.316 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff67ce78640 1 -- 172.21.15.184:0/3649597746 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff678073790 con 0x7ff67806b5b0 2024-05-06T06:51:09.316 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff67ce78640 1 -- 172.21.15.184:0/3649597746 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff66c0016a0 con 0x7ff67806b5b0 2024-05-06T06:51:09.316 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff67ce78640 1 -- 172.21.15.184:0/3649597746 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff66c0018c0 con 0x7ff67806b5b0 2024-05-06T06:51:09.316 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff67ce78640 1 -- 172.21.15.184:0/3649597746 <== mon.1 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff66c001d10 con 0x7ff67806b5b0 2024-05-06T06:51:09.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff6800de640 1 -- 172.21.15.184:0/3649597746 >> v1:172.21.15.184:6789/0 conn(0x7ff67806b5b0 legacy=0x7ff67813af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff6800de640 1 -- 172.21.15.184:0/3649597746 shutdown_connections 2024-05-06T06:51:09.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff6800de640 1 -- 172.21.15.184:0/3649597746 >> 172.21.15.184:0/3649597746 conn(0x7ff6780b55b0 msgr2=0x7ff6780b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:09.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff6800de640 1 -- 172.21.15.184:0/3649597746 shutdown_connections 2024-05-06T06:51:09.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff6800de640 1 -- 172.21.15.184:0/3649597746 wait complete. 2024-05-06T06:51:09.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff6800de640 1 Processor -- start 2024-05-06T06:51:09.317 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.312+0000 7ff6800de640 1 -- start start 2024-05-06T06:51:09.319 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff6800de640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6780ac580 con 0x7ff678144de0 2024-05-06T06:51:09.319 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff6800de640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6780ac860 con 0x7ff6780ab000 2024-05-06T06:51:09.319 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff6800de640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6781d95d0 con 0x7ff67806b5b0 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff67e67b640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7ff6780ab000 0x7ff6781e32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43516/0 (socket says 172.21.15.184:43516) 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff67e67b640 1 -- 172.21.15.184:0/3037652579 learned_addr learned my addr 172.21.15.184:0/3037652579 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711375097 0 0) 0x7ff6780ac860 con 0x7ff6780ab000 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff65c003530 con 0x7ff6780ab000 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3492894851 0 0) 0x7ff6781d95d0 con 0x7ff67806b5b0 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6780ac860 con 0x7ff67806b5b0 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 375160525 0 0) 0x7ff65c003530 con 0x7ff6780ab000 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6781d95d0 con 0x7ff6780ab000 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff670001ce0 con 0x7ff6780ab000 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2702903129 0 0) 0x7ff6780ac580 con 0x7ff678144de0 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff65c003530 con 0x7ff678144de0 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 <== mon.1 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1992942992 0 0) 0x7ff6781d95d0 con 0x7ff6780ab000 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 >> v1:172.21.15.70:6790/0 conn(0x7ff67806b5b0 legacy=0x7ff6781d8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 >> v1:172.21.15.70:6789/0 conn(0x7ff678144de0 legacy=0x7ff6780aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6780acf60 con 0x7ff6780ab000 2024-05-06T06:51:09.321 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff6800de640 1 -- 172.21.15.184:0/3037652579 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff6780ad1f0 con 0x7ff6780ab000 2024-05-06T06:51:09.321 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff6800de640 1 -- 172.21.15.184:0/3037652579 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff6781e4bc0 con 0x7ff6780ab000 2024-05-06T06:51:09.321 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 <== mon.1 v1:172.21.15.184:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff6700039a0 con 0x7ff6780ab000 2024-05-06T06:51:09.321 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 <== mon.1 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff670003df0 con 0x7ff6780ab000 2024-05-06T06:51:09.321 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 <== mon.1 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7ff6700043a0 con 0x7ff6780ab000 2024-05-06T06:51:09.321 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 <== mon.1 v1:172.21.15.184:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (unknown 2499630880 0 0) 0x7ff670004690 con 0x7ff6780ab000 2024-05-06T06:51:09.321 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.316+0000 7ff6800de640 1 -- 172.21.15.184:0/3037652579 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6780640c0 con 0x7ff6780ab000 2024-05-06T06:51:09.321 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.320+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 <== mon.1 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (unknown 1092875540 0 534071502) 0x7ff670005b50 con 0x7ff6780ab000 2024-05-06T06:51:09.389 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.388+0000 7ff6800de640 1 -- 172.21.15.184:0/3037652579 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd new", "uuid": "36920237-b28f-4955-ab5a-c6fd2e74e74e", "id": 3} v 0) -- 0x7ff678074620 con 0x7ff6780ab000 2024-05-06T06:51:09.394 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.392+0000 7ff66a7fc640 1 -- 172.21.15.184:0/3037652579 <== mon.1 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "36920237-b28f-4955-ab5a-c6fd2e74e74e", "id": 3}]=0 v6) ==== 112+0+2 (unknown 456447735 0 525046306) 0x7ff670005e70 con 0x7ff6780ab000 2024-05-06T06:51:09.394 INFO:teuthology.orchestra.run.smithi184.stdout:3 2024-05-06T06:51:09.395 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.392+0000 7ff6800de640 1 -- 172.21.15.184:0/3037652579 >> v1:172.21.15.184:6789/0 conn(0x7ff6780ab000 legacy=0x7ff6781e32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.392+0000 7ff6800de640 1 -- 172.21.15.184:0/3037652579 shutdown_connections 2024-05-06T06:51:09.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.392+0000 7ff6800de640 1 -- 172.21.15.184:0/3037652579 >> 172.21.15.184:0/3037652579 conn(0x7ff6780b55b0 msgr2=0x7ff6780b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:09.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.392+0000 7ff6800de640 1 -- 172.21.15.184:0/3037652579 shutdown_connections 2024-05-06T06:51:09.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.392+0000 7ff6800de640 1 -- 172.21.15.184:0/3037652579 wait complete. 2024-05-06T06:51:09.411 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 00e3095d-4ffd-4184-a8e4-1a14d09e3e3a 4 2024-05-06T06:51:09.492 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:09.490+0000 7f91fab30180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T06:51:09.523 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:09.520+0000 7f36fb9b1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-06T06:51:09.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.524+0000 7efcd7d55640 1 Processor -- start 2024-05-06T06:51:09.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.524+0000 7efcd7d55640 1 -- start start 2024-05-06T06:51:09.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.524+0000 7efcd7d55640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd013fd40 con 0x7efcd00b0f30 2024-05-06T06:51:09.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.524+0000 7efcd7d55640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd0073b20 con 0x7efcd00b0b50 2024-05-06T06:51:09.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.524+0000 7efcd7d55640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd0071de0 con 0x7efcd013f790 2024-05-06T06:51:09.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.524+0000 7efcd5af1640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7efcd00b0b50 0x7efcd00744e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43520/0 (socket says 172.21.15.184:43520) 2024-05-06T06:51:09.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.524+0000 7efcd5af1640 1 -- 172.21.15.184:0/804814486 learned_addr learned my addr 172.21.15.184:0/804814486 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:09.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd4aef640 1 -- 172.21.15.184:0/804814486 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605071979 0 0) 0x7efcd0073b20 con 0x7efcd00b0b50 2024-05-06T06:51:09.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd4aef640 1 -- 172.21.15.184:0/804814486 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcbc003530 con 0x7efcd00b0b50 2024-05-06T06:51:09.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd4aef640 1 -- 172.21.15.184:0/804814486 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1546535396 0 0) 0x7efcbc003530 con 0x7efcd00b0b50 2024-05-06T06:51:09.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd4aef640 1 -- 172.21.15.184:0/804814486 >> v1:172.21.15.70:6790/0 conn(0x7efcd013f790 legacy=0x7efcd014b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd4aef640 1 -- 172.21.15.184:0/804814486 >> v1:172.21.15.70:6789/0 conn(0x7efcd00b0f30 legacy=0x7efcd0073410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd4aef640 1 -- 172.21.15.184:0/804814486 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd00b18e0 con 0x7efcd00b0b50 2024-05-06T06:51:09.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd4aef640 1 -- 172.21.15.184:0/804814486 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7efcc8001a20 con 0x7efcd00b0b50 2024-05-06T06:51:09.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd4aef640 1 -- 172.21.15.184:0/804814486 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcc8001c40 con 0x7efcd00b0b50 2024-05-06T06:51:09.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd4aef640 1 -- 172.21.15.184:0/804814486 <== mon.1 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7efcc8002090 con 0x7efcd00b0b50 2024-05-06T06:51:09.533 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd7d55640 1 -- 172.21.15.184:0/804814486 >> v1:172.21.15.184:6789/0 conn(0x7efcd00b0b50 legacy=0x7efcd00744e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.533 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd7d55640 1 -- 172.21.15.184:0/804814486 shutdown_connections 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd7d55640 1 -- 172.21.15.184:0/804814486 >> 172.21.15.184:0/804814486 conn(0x7efcd00b1c40 msgr2=0x7efcd00b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd7d55640 1 -- 172.21.15.184:0/804814486 shutdown_connections 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd7d55640 1 -- 172.21.15.184:0/804814486 wait complete. 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd7d55640 1 Processor -- start 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd7d55640 1 -- start start 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd7d55640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd01ce3d0 con 0x7efcd00b0b50 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd7d55640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd01dc6d0 con 0x7efcd013f790 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd7d55640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd01cfc10 con 0x7efcd013a2a0 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd52f0640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7efcd013f790 0x7efcd01d86a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43528/0 (socket says 172.21.15.184:43528) 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd52f0640 1 -- 172.21.15.184:0/3026965951 learned_addr learned my addr 172.21.15.184:0/3026965951 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2424237534 0 0) 0x7efcd01dc6d0 con 0x7efcd013f790 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcb4003530 con 0x7efcd013f790 2024-05-06T06:51:09.534 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3269712218 0 0) 0x7efcd01cfc10 con 0x7efcd013a2a0 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcd01dc6d0 con 0x7efcd013a2a0 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3776636570 0 0) 0x7efcb4003530 con 0x7efcd013f790 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcd01cfc10 con 0x7efcd013f790 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7efcc0001a40 con 0x7efcd013f790 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 820595994 0 0) 0x7efcd01ce3d0 con 0x7efcd00b0b50 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcb4003530 con 0x7efcd00b0b50 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 <== mon.1 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2294369525 0 0) 0x7efcd01cfc10 con 0x7efcd013f790 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 >> v1:172.21.15.70:6790/0 conn(0x7efcd013a2a0 legacy=0x7efcd01e3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 >> v1:172.21.15.70:6789/0 conn(0x7efcd00b0b50 legacy=0x7efcd0139b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd01cfde0 con 0x7efcd013f790 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd7d55640 1 -- 172.21.15.184:0/3026965951 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efcd01cea60 con 0x7efcd013f790 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcd7d55640 1 -- 172.21.15.184:0/3026965951 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efcd01dc080 con 0x7efcd013f790 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 <== mon.1 v1:172.21.15.184:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcc0001cc0 con 0x7efcd013f790 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 <== mon.1 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7efcc0003a70 con 0x7efcd013f790 2024-05-06T06:51:09.535 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 <== mon.1 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7efcc0004060 con 0x7efcd013f790 2024-05-06T06:51:09.536 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.528+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 <== mon.1 v1:172.21.15.184:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (unknown 3662033183 0 0) 0x7efcc0004350 con 0x7efcd013f790 2024-05-06T06:51:09.536 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.532+0000 7efcd7d55640 1 -- 172.21.15.184:0/3026965951 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb8005090 con 0x7efcd013f790 2024-05-06T06:51:09.536 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.532+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 <== mon.1 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (unknown 1092875540 0 534071502) 0x7efcc00058e0 con 0x7efcd013f790 2024-05-06T06:51:09.547 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:09.546+0000 7f91fab30180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T06:51:09.579 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:09.576+0000 7f36fb9b1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-06T06:51:09.599 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:09.598+0000 7f91fab30180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T06:51:09.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.600+0000 7efcd7d55640 1 -- 172.21.15.184:0/3026965951 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd new", "uuid": "00e3095d-4ffd-4184-a8e4-1a14d09e3e3a", "id": 4} v 0) -- 0x7efcb8005380 con 0x7efcd013f790 2024-05-06T06:51:09.610 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.608+0000 7efcc67fc640 1 -- 172.21.15.184:0/3026965951 <== mon.1 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00e3095d-4ffd-4184-a8e4-1a14d09e3e3a", "id": 4}]=0 v7) ==== 112+0+2 (unknown 119725880 0 1697012583) 0x7efcc0005c10 con 0x7efcd013f790 2024-05-06T06:51:09.610 INFO:teuthology.orchestra.run.smithi184.stdout:4 2024-05-06T06:51:09.611 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.608+0000 7efcd7d55640 1 -- 172.21.15.184:0/3026965951 >> v1:172.21.15.184:6789/0 conn(0x7efcd013f790 legacy=0x7efcd01d86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.611 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.608+0000 7efcd7d55640 1 -- 172.21.15.184:0/3026965951 shutdown_connections 2024-05-06T06:51:09.612 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.608+0000 7efcd7d55640 1 -- 172.21.15.184:0/3026965951 >> 172.21.15.184:0/3026965951 conn(0x7efcd00b1c40 msgr2=0x7efcd006fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:09.612 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.608+0000 7efcd7d55640 1 -- 172.21.15.184:0/3026965951 shutdown_connections 2024-05-06T06:51:09.612 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.608+0000 7efcd7d55640 1 -- 172.21.15.184:0/3026965951 wait complete. 2024-05-06T06:51:09.626 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 091d4702-30c5-4c63-8529-92059782009a 5 2024-05-06T06:51:09.634 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:09.632+0000 7f36fb9b1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-06T06:51:09.675 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:09.674+0000 7f91fab30180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T06:51:09.714 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:09.712+0000 7f36fb9b1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-06T06:51:09.727 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:09.726+0000 7f91fab30180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T06:51:09.745 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.740+0000 7eff1fa67640 1 Processor -- start 2024-05-06T06:51:09.745 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.740+0000 7eff1fa67640 1 -- start start 2024-05-06T06:51:09.746 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff18071070 con 0x7eff18147060 2024-05-06T06:51:09.746 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff180af250 con 0x7eff1806ffe0 2024-05-06T06:51:09.746 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff18071350 con 0x7eff18075d80 2024-05-06T06:51:09.746 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1d002640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7eff1806ffe0 0x7eff18146950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43530/0 (socket says 172.21.15.184:43530) 2024-05-06T06:51:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1d002640 1 -- 172.21.15.184:0/2156005523 learned_addr learned my addr 172.21.15.184:0/2156005523 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1c801640 1 -- 172.21.15.184:0/2156005523 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276697746 0 0) 0x7eff180af250 con 0x7eff1806ffe0 2024-05-06T06:51:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1c801640 1 -- 172.21.15.184:0/2156005523 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff04003530 con 0x7eff1806ffe0 2024-05-06T06:51:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1c801640 1 -- 172.21.15.184:0/2156005523 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3104474671 0 0) 0x7eff04003530 con 0x7eff1806ffe0 2024-05-06T06:51:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1c801640 1 -- 172.21.15.184:0/2156005523 >> v1:172.21.15.70:6790/0 conn(0x7eff18075d80 legacy=0x7eff18140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1c801640 1 -- 172.21.15.184:0/2156005523 >> v1:172.21.15.70:6789/0 conn(0x7eff18147060 legacy=0x7eff1814eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1c801640 1 -- 172.21.15.184:0/2156005523 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff180704c0 con 0x7eff1806ffe0 2024-05-06T06:51:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1c801640 1 -- 172.21.15.184:0/2156005523 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7eff080016a0 con 0x7eff1806ffe0 2024-05-06T06:51:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1c801640 1 -- 172.21.15.184:0/2156005523 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff080018c0 con 0x7eff1806ffe0 2024-05-06T06:51:09.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1c801640 1 -- 172.21.15.184:0/2156005523 <== mon.1 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7eff08001d10 con 0x7eff1806ffe0 2024-05-06T06:51:09.748 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 -- 172.21.15.184:0/2156005523 >> v1:172.21.15.184:6789/0 conn(0x7eff1806ffe0 legacy=0x7eff18146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.748 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 -- 172.21.15.184:0/2156005523 shutdown_connections 2024-05-06T06:51:09.748 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 -- 172.21.15.184:0/2156005523 >> 172.21.15.184:0/2156005523 conn(0x7eff180b1c40 msgr2=0x7eff180b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:09.748 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 -- 172.21.15.184:0/2156005523 shutdown_connections 2024-05-06T06:51:09.748 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 -- 172.21.15.184:0/2156005523 wait complete. 2024-05-06T06:51:09.748 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 Processor -- start 2024-05-06T06:51:09.748 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 -- start start 2024-05-06T06:51:09.750 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff18139400 con 0x7eff18075d80 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1813a210 con 0x7eff1806ffe0 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1fa67640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1813a4f0 con 0x7eff18147060 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1d803640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7eff1806ffe0 0x7eff18138cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43546/0 (socket says 172.21.15.184:43546) 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.744+0000 7eff1d803640 1 -- 172.21.15.184:0/2849827182 learned_addr learned my addr 172.21.15.184:0/2849827182 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2579150563 0 0) 0x7eff1813a210 con 0x7eff1806ffe0 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efefc003530 con 0x7eff1806ffe0 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 504875278 0 0) 0x7efefc003530 con 0x7eff1806ffe0 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff1813a210 con 0x7eff1806ffe0 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7eff140019e0 con 0x7eff1806ffe0 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402441545 0 0) 0x7eff1813a4f0 con 0x7eff18147060 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efefc003530 con 0x7eff18147060 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 <== mon.1 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3690792536 0 0) 0x7eff1813a210 con 0x7eff1806ffe0 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 >> v1:172.21.15.70:6790/0 conn(0x7eff18147060 legacy=0x7eff181e3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.751 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 >> v1:172.21.15.70:6789/0 conn(0x7eff18075d80 legacy=0x7eff181355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1813a7d0 con 0x7eff1806ffe0 2024-05-06T06:51:09.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff1fa67640 1 -- 172.21.15.184:0/2849827182 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7eff18137f60 con 0x7eff1806ffe0 2024-05-06T06:51:09.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff1fa67640 1 -- 172.21.15.184:0/2849827182 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7eff1813adc0 con 0x7eff1806ffe0 2024-05-06T06:51:09.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 <== mon.1 v1:172.21.15.184:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff14001ca0 con 0x7eff1806ffe0 2024-05-06T06:51:09.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 <== mon.1 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7eff14003a70 con 0x7eff1806ffe0 2024-05-06T06:51:09.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 <== mon.1 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7eff14004060 con 0x7eff1806ffe0 2024-05-06T06:51:09.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 <== mon.1 v1:172.21.15.184:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (unknown 3908433133 0 0) 0x7eff140069d0 con 0x7eff1806ffe0 2024-05-06T06:51:09.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.748+0000 7eff1fa67640 1 -- 172.21.15.184:0/2849827182 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff00005090 con 0x7eff1806ffe0 2024-05-06T06:51:09.768 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:09.764+0000 7f36fb9b1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-06T06:51:09.769 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.768+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 <== mon.1 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (unknown 1092875540 0 534071502) 0x7eff14006450 con 0x7eff1806ffe0 2024-05-06T06:51:09.803 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:09.802+0000 7f91fab30180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T06:51:09.837 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.836+0000 7eff1fa67640 1 -- 172.21.15.184:0/2849827182 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd new", "uuid": "091d4702-30c5-4c63-8529-92059782009a", "id": 5} v 0) -- 0x7eff00005380 con 0x7eff1806ffe0 2024-05-06T06:51:09.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.840+0000 7eff0e7fc640 1 -- 172.21.15.184:0/2849827182 <== mon.1 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "091d4702-30c5-4c63-8529-92059782009a", "id": 5}]=0 v8) ==== 112+0+2 (unknown 2858868706 0 1988412176) 0x7eff14006730 con 0x7eff1806ffe0 2024-05-06T06:51:09.844 INFO:teuthology.orchestra.run.smithi184.stdout:5 2024-05-06T06:51:09.845 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.844+0000 7eff1fa67640 1 -- 172.21.15.184:0/2849827182 >> v1:172.21.15.184:6789/0 conn(0x7eff1806ffe0 legacy=0x7eff18138cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:09.845 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.844+0000 7eff1fa67640 1 -- 172.21.15.184:0/2849827182 shutdown_connections 2024-05-06T06:51:09.845 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.844+0000 7eff1fa67640 1 -- 172.21.15.184:0/2849827182 >> 172.21.15.184:0/2849827182 conn(0x7eff180b1c40 msgr2=0x7eff180b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:09.845 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.844+0000 7eff1fa67640 1 -- 172.21.15.184:0/2849827182 shutdown_connections 2024-05-06T06:51:09.845 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:09.844+0000 7eff1fa67640 1 -- 172.21.15.184:0/2849827182 wait complete. 2024-05-06T06:51:09.846 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:09.844+0000 7f36fb9b1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-06T06:51:09.856 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:09.854+0000 7f91fab30180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T06:51:09.859 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 8067e1b6-71d1-4924-881b-4a38fe446858 6 2024-05-06T06:51:09.900 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:09.896+0000 7f36fb9b1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-06T06:51:10.006 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:10.006+0000 7f91fab30180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T06:51:10.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.008+0000 7fe69ffc6640 1 Processor -- start 2024-05-06T06:51:10.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.008+0000 7fe69ffc6640 1 -- start start 2024-05-06T06:51:10.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.008+0000 7fe69ffc6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6980b0b80 con 0x7fe698068420 2024-05-06T06:51:10.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.008+0000 7fe69ffc6640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe69813ebd0 con 0x7fe69813e2f0 2024-05-06T06:51:10.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.008+0000 7fe69ffc6640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe698074480 con 0x7fe69813e780 2024-05-06T06:51:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.008+0000 7fe69d561640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe69813e2f0 0x7fe698144630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43556/0 (socket says 172.21.15.184:43556) 2024-05-06T06:51:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.008+0000 7fe69d561640 1 -- 172.21.15.184:0/2145857888 learned_addr learned my addr 172.21.15.184:0/2145857888 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69cd60640 1 -- 172.21.15.184:0/2145857888 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705679719 0 0) 0x7fe69813ebd0 con 0x7fe69813e2f0 2024-05-06T06:51:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69cd60640 1 -- 172.21.15.184:0/2145857888 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe684003530 con 0x7fe69813e2f0 2024-05-06T06:51:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69cd60640 1 -- 172.21.15.184:0/2145857888 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3208351616 0 0) 0x7fe684003530 con 0x7fe69813e2f0 2024-05-06T06:51:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69cd60640 1 -- 172.21.15.184:0/2145857888 >> v1:172.21.15.70:6790/0 conn(0x7fe69813e780 legacy=0x7fe698144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69cd60640 1 -- 172.21.15.184:0/2145857888 >> v1:172.21.15.70:6789/0 conn(0x7fe698068420 legacy=0x7fe6980b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69cd60640 1 -- 172.21.15.184:0/2145857888 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe698150980 con 0x7fe69813e2f0 2024-05-06T06:51:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69cd60640 1 -- 172.21.15.184:0/2145857888 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe6940016a0 con 0x7fe69813e2f0 2024-05-06T06:51:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69cd60640 1 -- 172.21.15.184:0/2145857888 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe694001840 con 0x7fe69813e2f0 2024-05-06T06:51:10.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69cd60640 1 -- 172.21.15.184:0/2145857888 <== mon.1 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe694001c90 con 0x7fe69813e2f0 2024-05-06T06:51:10.015 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69ffc6640 1 -- 172.21.15.184:0/2145857888 >> v1:172.21.15.184:6789/0 conn(0x7fe69813e2f0 legacy=0x7fe698144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.015 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69ffc6640 1 -- 172.21.15.184:0/2145857888 shutdown_connections 2024-05-06T06:51:10.015 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69ffc6640 1 -- 172.21.15.184:0/2145857888 >> 172.21.15.184:0/2145857888 conn(0x7fe6980b5a70 msgr2=0x7fe6980b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:10.015 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69ffc6640 1 -- 172.21.15.184:0/2145857888 shutdown_connections 2024-05-06T06:51:10.015 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69ffc6640 1 -- 172.21.15.184:0/2145857888 wait complete. 2024-05-06T06:51:10.016 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69ffc6640 1 Processor -- start 2024-05-06T06:51:10.016 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69ffc6640 1 -- start start 2024-05-06T06:51:10.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69ffc6640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe69813ee40 con 0x7fe69813e2f0 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69ffc6640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe698142030 con 0x7fe698068420 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69ffc6640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe698140f10 con 0x7fe69813e780 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69dd62640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe698068420 0x7fe69813fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43566/0 (socket says 172.21.15.184:43566) 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe69dd62640 1 -- 172.21.15.184:0/624789557 learned_addr learned my addr 172.21.15.184:0/624789557 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156989744 0 0) 0x7fe698142030 con 0x7fe698068420 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.012+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe67c003530 con 0x7fe698068420 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2820095364 0 0) 0x7fe67c003530 con 0x7fe698068420 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe698142030 con 0x7fe698068420 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe68c001a40 con 0x7fe698068420 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388922721 0 0) 0x7fe69813ee40 con 0x7fe69813e2f0 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe67c003530 con 0x7fe69813e2f0 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3989499035 0 0) 0x7fe698140f10 con 0x7fe69813e780 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe69813ee40 con 0x7fe69813e780 2024-05-06T06:51:10.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 <== mon.1 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2007798216 0 0) 0x7fe698142030 con 0x7fe698068420 2024-05-06T06:51:10.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 >> v1:172.21.15.70:6790/0 conn(0x7fe69813e780 legacy=0x7fe6981d9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 >> v1:172.21.15.70:6789/0 conn(0x7fe69813e2f0 legacy=0x7fe6980aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6980af140 con 0x7fe698068420 2024-05-06T06:51:10.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe69ffc6640 1 -- 172.21.15.184:0/624789557 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe6980af390 con 0x7fe698068420 2024-05-06T06:51:10.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe69ffc6640 1 -- 172.21.15.184:0/624789557 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe698140b00 con 0x7fe698068420 2024-05-06T06:51:10.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 <== mon.1 v1:172.21.15.184:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe68c0038d0 con 0x7fe698068420 2024-05-06T06:51:10.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 <== mon.1 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe68c003d20 con 0x7fe698068420 2024-05-06T06:51:10.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 <== mon.1 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7fe68c004310 con 0x7fe698068420 2024-05-06T06:51:10.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 <== mon.1 v1:172.21.15.184:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 182064836 0 0) 0x7fe68c0069b0 con 0x7fe698068420 2024-05-06T06:51:10.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe69ffc6640 1 -- 172.21.15.184:0/624789557 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe680005090 con 0x7fe698068420 2024-05-06T06:51:10.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.016+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 <== mon.1 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (unknown 1092875540 0 534071502) 0x7fe68c0063c0 con 0x7fe698068420 2024-05-06T06:51:10.057 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:10.056+0000 7f36fb9b1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-06T06:51:10.068 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:10.066+0000 7f91fab30180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T06:51:10.089 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.088+0000 7fe69ffc6640 1 -- 172.21.15.184:0/624789557 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd new", "uuid": "8067e1b6-71d1-4924-881b-4a38fe446858", "id": 6} v 0) -- 0x7fe680005380 con 0x7fe698068420 2024-05-06T06:51:10.094 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.092+0000 7fe68a7fc640 1 -- 172.21.15.184:0/624789557 <== mon.1 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8067e1b6-71d1-4924-881b-4a38fe446858", "id": 6}]=0 v9) ==== 112+0+2 (unknown 1484766801 0 1113811849) 0x7fe68c0066f0 con 0x7fe698068420 2024-05-06T06:51:10.094 INFO:teuthology.orchestra.run.smithi184.stdout:6 2024-05-06T06:51:10.095 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.092+0000 7fe69ffc6640 1 -- 172.21.15.184:0/624789557 >> v1:172.21.15.184:6789/0 conn(0x7fe698068420 legacy=0x7fe69813fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.095 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.092+0000 7fe69ffc6640 1 -- 172.21.15.184:0/624789557 shutdown_connections 2024-05-06T06:51:10.095 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.092+0000 7fe69ffc6640 1 -- 172.21.15.184:0/624789557 >> 172.21.15.184:0/624789557 conn(0x7fe6980b5a70 msgr2=0x7fe6980b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:10.095 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.092+0000 7fe69ffc6640 1 -- 172.21.15.184:0/624789557 shutdown_connections 2024-05-06T06:51:10.095 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.092+0000 7fe69ffc6640 1 -- 172.21.15.184:0/624789557 wait complete. 2024-05-06T06:51:10.109 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new dae86a11-8868-45b5-927f-f4233d632bb4 7 2024-05-06T06:51:10.122 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:10.120+0000 7f36fb9b1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-06T06:51:10.220 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.216+0000 7f2e87476640 1 Processor -- start 2024-05-06T06:51:10.220 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.216+0000 7f2e87476640 1 -- start start 2024-05-06T06:51:10.223 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.216+0000 7f2e87476640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e800707a0 con 0x7f2e800685a0 2024-05-06T06:51:10.223 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.216+0000 7f2e87476640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e800b2270 con 0x7f2e800b0930 2024-05-06T06:51:10.223 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.216+0000 7f2e87476640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e800b0de0 con 0x7f2e800681c0 2024-05-06T06:51:10.223 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e85a13640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2e800b0930 0x7f2e80140880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43568/0 (socket says 172.21.15.184:43568) 2024-05-06T06:51:10.223 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e85a13640 1 -- 172.21.15.184:0/1349445914 learned_addr learned my addr 172.21.15.184:0/1349445914 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:10.223 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7ffff640 1 -- 172.21.15.184:0/1349445914 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494687435 0 0) 0x7f2e800b2270 con 0x7f2e800b0930 2024-05-06T06:51:10.223 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7ffff640 1 -- 172.21.15.184:0/1349445914 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e68003530 con 0x7f2e800b0930 2024-05-06T06:51:10.223 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7ffff640 1 -- 172.21.15.184:0/1349445914 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2241313660 0 0) 0x7f2e68003530 con 0x7f2e800b0930 2024-05-06T06:51:10.223 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7ffff640 1 -- 172.21.15.184:0/1349445914 >> v1:172.21.15.70:6790/0 conn(0x7f2e800681c0 legacy=0x7f2e80073dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.223 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7ffff640 1 -- 172.21.15.184:0/1349445914 >> v1:172.21.15.70:6789/0 conn(0x7f2e800685a0 legacy=0x7f2e801467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.224 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7ffff640 1 -- 172.21.15.184:0/1349445914 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e80152b90 con 0x7f2e800b0930 2024-05-06T06:51:10.224 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7ffff640 1 -- 172.21.15.184:0/1349445914 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2e700016a0 con 0x7f2e800b0930 2024-05-06T06:51:10.224 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7ffff640 1 -- 172.21.15.184:0/1349445914 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e700018c0 con 0x7f2e800b0930 2024-05-06T06:51:10.224 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7ffff640 1 -- 172.21.15.184:0/1349445914 <== mon.1 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2e70001c90 con 0x7f2e800b0930 2024-05-06T06:51:10.224 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e87476640 1 -- 172.21.15.184:0/1349445914 >> v1:172.21.15.184:6789/0 conn(0x7f2e800b0930 legacy=0x7f2e80140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.224 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e87476640 1 -- 172.21.15.184:0/1349445914 shutdown_connections 2024-05-06T06:51:10.224 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e87476640 1 -- 172.21.15.184:0/1349445914 >> 172.21.15.184:0/1349445914 conn(0x7f2e800b5a70 msgr2=0x7f2e800b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:10.224 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e87476640 1 -- 172.21.15.184:0/1349445914 shutdown_connections 2024-05-06T06:51:10.224 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e87476640 1 -- 172.21.15.184:0/1349445914 wait complete. 2024-05-06T06:51:10.226 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e87476640 1 Processor -- start 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e87476640 1 -- start start 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e87476640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8013a0a0 con 0x7f2e800681c0 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e87476640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8013a380 con 0x7f2e8013b720 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e87476640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8013aaf0 con 0x7f2e800b0930 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e85a13640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2e8013b720 0x7f2e801e3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43572/0 (socket says 172.21.15.184:43572) 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e85a13640 1 -- 172.21.15.184:0/2312169620 learned_addr learned my addr 172.21.15.184:0/2312169620 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440153365 0 0) 0x7f2e8013a380 con 0x7f2e8013b720 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e6c003530 con 0x7f2e8013b720 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1482736386 0 0) 0x7f2e6c003530 con 0x7f2e8013b720 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e8013a380 con 0x7f2e8013b720 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2e70001c10 con 0x7f2e8013b720 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1377212322 0 0) 0x7f2e8013a0a0 con 0x7f2e800681c0 2024-05-06T06:51:10.227 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e6c003530 con 0x7f2e800681c0 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356926588 0 0) 0x7f2e8013aaf0 con 0x7f2e800b0930 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e8013a0a0 con 0x7f2e800b0930 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 <== mon.1 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1898093880 0 0) 0x7f2e8013a380 con 0x7f2e8013b720 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 >> v1:172.21.15.70:6790/0 conn(0x7f2e800b0930 legacy=0x7f2e8013b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 >> v1:172.21.15.70:6789/0 conn(0x7f2e800681c0 legacy=0x7f2e800717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8013a7a0 con 0x7f2e8013b720 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e87476640 1 -- 172.21.15.184:0/2312169620 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e80144270 con 0x7f2e8013b720 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.220+0000 7f2e87476640 1 -- 172.21.15.184:0/2312169620 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e8013bbb0 con 0x7f2e8013b720 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.224+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 <== mon.1 v1:172.21.15.184:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e70004aa0 con 0x7f2e8013b720 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.224+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 <== mon.1 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2e70004df0 con 0x7f2e8013b720 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.224+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 <== mon.1 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f2e70005320 con 0x7f2e8013b720 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.224+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 <== mon.1 v1:172.21.15.184:6789/0 8 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (unknown 3559472651 0 0) 0x7f2e70005c50 con 0x7f2e8013b720 2024-05-06T06:51:10.228 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.224+0000 7f2e87476640 1 -- 172.21.15.184:0/2312169620 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e60005090 con 0x7f2e8013b720 2024-05-06T06:51:10.229 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.224+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 <== mon.1 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (unknown 1092875540 0 534071502) 0x7f2e70005610 con 0x7f2e8013b720 2024-05-06T06:51:10.295 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.292+0000 7f2e87476640 1 -- 172.21.15.184:0/2312169620 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd new", "uuid": "dae86a11-8868-45b5-927f-f4233d632bb4", "id": 7} v 0) -- 0x7f2e60005380 con 0x7f2e8013b720 2024-05-06T06:51:10.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.296+0000 7f2e7dffb640 1 -- 172.21.15.184:0/2312169620 <== mon.1 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dae86a11-8868-45b5-927f-f4233d632bb4", "id": 7}]=0 v10) ==== 112+0+2 (unknown 1857409525 0 1371665406) 0x7f2e70005910 con 0x7f2e8013b720 2024-05-06T06:51:10.301 INFO:teuthology.orchestra.run.smithi184.stdout:7 2024-05-06T06:51:10.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.300+0000 7f2e87476640 1 -- 172.21.15.184:0/2312169620 >> v1:172.21.15.184:6789/0 conn(0x7f2e8013b720 legacy=0x7f2e801e3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.300+0000 7f2e87476640 1 -- 172.21.15.184:0/2312169620 shutdown_connections 2024-05-06T06:51:10.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.300+0000 7f2e87476640 1 -- 172.21.15.184:0/2312169620 >> 172.21.15.184:0/2312169620 conn(0x7f2e800b5a70 msgr2=0x7f2e801389e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:10.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.300+0000 7f2e87476640 1 -- 172.21.15.184:0/2312169620 shutdown_connections 2024-05-06T06:51:10.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-05-06T06:51:10.300+0000 7f2e87476640 1 -- 172.21.15.184:0/2312169620 wait complete. 2024-05-06T06:51:10.317 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-06T06:51:10.318 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-06T06:51:10.320 INFO:tasks.ceph.osd.0:Started 2024-05-06T06:51:10.320 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-06T06:51:10.320 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-06T06:51:10.323 INFO:tasks.ceph.osd.1:Started 2024-05-06T06:51:10.323 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-06T06:51:10.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-06T06:51:10.325 INFO:tasks.ceph.osd.2:Started 2024-05-06T06:51:10.326 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-06T06:51:10.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-06T06:51:10.328 INFO:tasks.ceph.osd.3:Started 2024-05-06T06:51:10.328 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-06T06:51:10.328 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-06T06:51:10.362 INFO:tasks.ceph.osd.4:Started 2024-05-06T06:51:10.363 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-06T06:51:10.363 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-06T06:51:10.365 INFO:tasks.ceph.osd.5:Started 2024-05-06T06:51:10.365 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-06T06:51:10.365 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-06T06:51:10.367 INFO:tasks.ceph.osd.6:Started 2024-05-06T06:51:10.367 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-06T06:51:10.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-06T06:51:10.370 INFO:tasks.ceph.osd.7:Started 2024-05-06T06:51:10.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-06T06:51:10.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.550+0000 7f522e078640 1 Processor -- start 2024-05-06T06:51:10.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.550+0000 7f522e078640 1 -- start start 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.550+0000 7f522e078640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5228073cd0 con 0x7f5228071d50 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.550+0000 7f522e078640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5228073fb0 con 0x7f5228072130 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.550+0000 7f522e078640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5228074290 con 0x7f522813e770 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52277fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5228071d50 0x7f522813e060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50334/0 (socket says 172.21.15.70:50334) 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52277fe640 1 -- 172.21.15.70:0/1005480479 learned_addr learned my addr 172.21.15.70:0/1005480479 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782372632 0 0) 0x7f5228074290 con 0x7f522813e770 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5210003530 con 0x7f522813e770 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744866255 0 0) 0x7f5228073cd0 con 0x7f5228071d50 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5228074290 con 0x7f5228071d50 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3938672081 0 0) 0x7f5228073fb0 con 0x7f5228072130 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5228073cd0 con 0x7f5228072130 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1109213232 0 0) 0x7f5228074290 con 0x7f5228071d50 2024-05-06T06:51:10.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 >> v1:172.21.15.70:6790/0 conn(0x7f522813e770 legacy=0x7f5228141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 >> v1:172.21.15.184:6789/0 conn(0x7f5228072130 legacy=0x7f522814c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52280730f0 con 0x7f5228071d50 2024-05-06T06:51:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5218001680 con 0x7f5228071d50 2024-05-06T06:51:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5218001820 con 0x7f5228071d50 2024-05-06T06:51:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52267fc640 1 -- 172.21.15.70:0/1005480479 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5218001c30 con 0x7f5228071d50 2024-05-06T06:51:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f522e078640 1 -- 172.21.15.70:0/1005480479 >> v1:172.21.15.70:6789/0 conn(0x7f5228071d50 legacy=0x7f522813e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f522e078640 1 -- 172.21.15.70:0/1005480479 shutdown_connections 2024-05-06T06:51:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f522e078640 1 -- 172.21.15.70:0/1005480479 >> 172.21.15.70:0/1005480479 conn(0x7f52280b6a80 msgr2=0x7f52280b6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f522e078640 1 -- 172.21.15.70:0/1005480479 shutdown_connections 2024-05-06T06:51:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f522e078640 1 -- 172.21.15.70:0/1005480479 wait complete. 2024-05-06T06:51:10.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f522e078640 1 Processor -- start 2024-05-06T06:51:10.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f522e078640 1 -- start start 2024-05-06T06:51:10.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f522e078640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f522813a9f0 con 0x7f5228071d50 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f522e078640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f522813acd0 con 0x7f522813e770 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f522e078640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f522813afb0 con 0x7f5228072130 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52277fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5228071d50 0x7f52281394d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50338/0 (socket says 172.21.15.70:50338) 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f52277fe640 1 -- 172.21.15.70:0/3735672628 learned_addr learned my addr 172.21.15.70:0/3735672628 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317396102 0 0) 0x7f522813a9f0 con 0x7f5228071d50 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5214003530 con 0x7f5228071d50 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444971050 0 0) 0x7f522813afb0 con 0x7f5228072130 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f522813a9f0 con 0x7f5228072130 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944597269 0 0) 0x7f522813acd0 con 0x7f522813e770 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f522813afb0 con 0x7f522813e770 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 789819555 0 0) 0x7f5214003530 con 0x7f5228071d50 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f522813acd0 con 0x7f5228071d50 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3627481440 0 0) 0x7f522813a9f0 con 0x7f5228072130 2024-05-06T06:51:10.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5214003530 con 0x7f5228072130 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5218001640 con 0x7f5228071d50 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f521c001650 con 0x7f5228072130 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2315363750 0 0) 0x7f522813afb0 con 0x7f522813e770 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f522813a9f0 con 0x7f522813e770 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.554+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5220001c80 con 0x7f522813e770 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.558+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3141137934 0 0) 0x7f522813acd0 con 0x7f5228071d50 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.558+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 >> v1:172.21.15.70:6790/0 conn(0x7f5228072130 legacy=0x7f52281ddfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.558+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 >> v1:172.21.15.184:6789/0 conn(0x7f522813e770 legacy=0x7f52281e1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.558+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5228138950 con 0x7f5228071d50 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.558+0000 7f522e078640 1 -- 172.21.15.70:0/3735672628 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f522813b3d0 con 0x7f5228071d50 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.558+0000 7f522e078640 1 -- 172.21.15.70:0/3735672628 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5228139be0 con 0x7f5228071d50 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.558+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5218004aa0 con 0x7f5228071d50 2024-05-06T06:51:10.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.558+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5218004e70 con 0x7f5228071d50 2024-05-06T06:51:10.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.558+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f5218005420 con 0x7f5228071d50 2024-05-06T06:51:10.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.558+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (unknown 1431123548 0 0) 0x7f52180066e0 con 0x7f5228071d50 2024-05-06T06:51:10.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.558+0000 7f522e078640 1 -- 172.21.15.70:0/3735672628 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5208005090 con 0x7f5228071d50 2024-05-06T06:51:10.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.558+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (unknown 1092875540 0 534071502) 0x7f52180017e0 con 0x7f5228071d50 2024-05-06T06:51:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.614+0000 7f522e078640 1 -- 172.21.15.70:0/3735672628 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5208005380 con 0x7f5228071d50 2024-05-06T06:51:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.618+0000 7f520ffff640 1 -- 172.21.15.70:0/3735672628 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (unknown 4040575075 0 1930146889) 0x7f52180068e0 con 0x7f5228071d50 2024-05-06T06:51:10.618 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:51:10.619 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":10,"fsid":"90193adb-e1e1-4e06-9c0d-7abb14f25fc6","created":"2024-05-06T06:51:08.019705+0000","modified":"2024-05-06T06:51:10.302012+0000","last_up_change":"0.000000","last_in_change":"2024-05-06T06:51:10.302012+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e2c1f594-6b3c-49a9-b307-6b6284d59048","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fc494199-771b-4efe-85cf-edd309f73659","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5f691dc1-d6f0-4c85-9544-86c9b7cfa3b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"36920237-b28f-4955-ab5a-c6fd2e74e74e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e3095d-4ffd-4184-a8e4-1a14d09e3e3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"091d4702-30c5-4c63-8529-92059782009a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8067e1b6-71d1-4924-881b-4a38fe446858","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dae86a11-8868-45b5-927f-f4233d632bb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T06:51:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.618+0000 7f522e078640 1 -- 172.21.15.70:0/3735672628 >> v1:172.21.15.70:6789/0 conn(0x7f5228071d50 legacy=0x7f52281394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.618+0000 7f522e078640 1 -- 172.21.15.70:0/3735672628 shutdown_connections 2024-05-06T06:51:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.618+0000 7f522e078640 1 -- 172.21.15.70:0/3735672628 >> 172.21.15.70:0/3735672628 conn(0x7f52280b6a80 msgr2=0x7f52280b6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.618+0000 7f522e078640 1 -- 172.21.15.70:0/3735672628 shutdown_connections 2024-05-06T06:51:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:10.618+0000 7f522e078640 1 -- 172.21.15.70:0/3735672628 wait complete. 2024-05-06T06:51:10.635 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-06T06:51:10.635 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-06T06:51:10.694 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-05-06T06:51:10.694+0000 7f762391c7c0 -1 Falling back to public interface 2024-05-06T06:51:10.710 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-05-06T06:51:10.710+0000 7f57f01777c0 -1 Falling back to public interface 2024-05-06T06:51:10.722 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-05-06T06:51:10.722+0000 7fdb625a37c0 -1 Falling back to public interface 2024-05-06T06:51:10.725 INFO:tasks.ceph.mgr.y.smithi070.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-06T06:51:10.726 INFO:tasks.ceph.mgr.y.smithi070.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-06T06:51:10.726 INFO:tasks.ceph.mgr.y.smithi070.stderr: from numpy import show_config as show_numpy_config 2024-05-06T06:51:10.746 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-05-06T06:51:10.744+0000 7fb28158b7c0 -1 Falling back to public interface 2024-05-06T06:51:10.746 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-05-06T06:51:10.744+0000 7f0887da77c0 -1 Falling back to public interface 2024-05-06T06:51:10.768 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:10.766+0000 7f91fab30180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T06:51:10.800 INFO:tasks.ceph.mgr.x.smithi184.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-06T06:51:10.801 INFO:tasks.ceph.mgr.x.smithi184.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-06T06:51:10.801 INFO:tasks.ceph.mgr.x.smithi184.stderr: from numpy import show_config as show_numpy_config 2024-05-06T06:51:10.864 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:10.860+0000 7f36fb9b1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-06T06:51:10.911 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:10.910+0000 7f91fab30180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T06:51:10.958 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-05-06T06:51:10.958+0000 7f8ddc55e7c0 -1 Falling back to public interface 2024-05-06T06:51:11.010 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-05-06T06:51:11.008+0000 7f7181a677c0 -1 Falling back to public interface 2024-05-06T06:51:11.025 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:11.020+0000 7f36fb9b1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-06T06:51:11.038 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-05-06T06:51:11.036+0000 7fd5d4e167c0 -1 Falling back to public interface 2024-05-06T06:51:11.063 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:11.062+0000 7f91fab30180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T06:51:11.126 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:11.126+0000 7f91fab30180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T06:51:11.215 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:11.212+0000 7f36fb9b1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-06T06:51:11.259 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:11.258+0000 7f91fab30180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T06:51:11.284 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:11.280+0000 7f36fb9b1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-06T06:51:11.432 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:11.428+0000 7f36fb9b1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-06T06:51:11.442 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-06T06:51:11.549 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.546+0000 7fecd97f5640 1 Processor -- start 2024-05-06T06:51:11.549 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.546+0000 7fecd97f5640 1 -- start start 2024-05-06T06:51:11.552 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd97f5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd40b24b0 con 0x7fecd406c480 2024-05-06T06:51:11.552 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd97f5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd4074580 con 0x7fecd406c860 2024-05-06T06:51:11.552 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd97f5640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd4073830 con 0x7fecd4073420 2024-05-06T06:51:11.552 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd37fe640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fecd4073420 0x7fecd4073e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:34382/0 (socket says 172.21.15.70:34382) 2024-05-06T06:51:11.552 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd37fe640 1 -- 172.21.15.70:0/1724526889 learned_addr learned my addr 172.21.15.70:0/1724526889 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:11.552 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 189488983 0 0) 0x7fecd4073830 con 0x7fecd4073420 2024-05-06T06:51:11.552 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecbc003530 con 0x7fecd4073420 2024-05-06T06:51:11.552 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479631925 0 0) 0x7fecd40b24b0 con 0x7fecd406c480 2024-05-06T06:51:11.552 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecd4073830 con 0x7fecd406c480 2024-05-06T06:51:11.552 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3053691478 0 0) 0x7fecd4074580 con 0x7fecd406c860 2024-05-06T06:51:11.552 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecd40b24b0 con 0x7fecd406c860 2024-05-06T06:51:11.553 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2082744786 0 0) 0x7fecd4073830 con 0x7fecd406c480 2024-05-06T06:51:11.553 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 >> v1:172.21.15.70:6790/0 conn(0x7fecd4073420 legacy=0x7fecd4073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:11.553 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 >> v1:172.21.15.184:6789/0 conn(0x7fecd406c860 legacy=0x7fecd40b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:11.553 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd4073a00 con 0x7fecd406c480 2024-05-06T06:51:11.553 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fecc8001680 con 0x7fecd406c480 2024-05-06T06:51:11.553 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fecc80018a0 con 0x7fecd406c480 2024-05-06T06:51:11.553 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd1ffb640 1 -- 172.21.15.70:0/1724526889 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fecc8001c70 con 0x7fecd406c480 2024-05-06T06:51:11.553 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd97f5640 1 -- 172.21.15.70:0/1724526889 >> v1:172.21.15.70:6789/0 conn(0x7fecd406c480 legacy=0x7fecd4143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:11.553 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd97f5640 1 -- 172.21.15.70:0/1724526889 shutdown_connections 2024-05-06T06:51:11.553 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd97f5640 1 -- 172.21.15.70:0/1724526889 >> 172.21.15.70:0/1724526889 conn(0x7fecd40b5bd0 msgr2=0x7fecd40b5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:11.553 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd97f5640 1 -- 172.21.15.70:0/1724526889 shutdown_connections 2024-05-06T06:51:11.553 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd97f5640 1 -- 172.21.15.70:0/1724526889 wait complete. 2024-05-06T06:51:11.556 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd97f5640 1 Processor -- start 2024-05-06T06:51:11.556 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd97f5640 1 -- start start 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.550+0000 7fecd97f5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd413ef20 con 0x7fecd4073420 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecd97f5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd413f700 con 0x7fecd406c480 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecd97f5640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd413f8d0 con 0x7fecd41d8fc0 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecd27fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fecd4073420 0x7fecd413fd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50358/0 (socket says 172.21.15.70:50358) 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecd27fc640 1 -- 172.21.15.70:0/183894747 learned_addr learned my addr 172.21.15.70:0/183894747 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840761424 0 0) 0x7fecd413f8d0 con 0x7fecd41d8fc0 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecc0003530 con 0x7fecd41d8fc0 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477694215 0 0) 0x7fecd413ef20 con 0x7fecd4073420 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecd413f8d0 con 0x7fecd4073420 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192274108 0 0) 0x7fecd413f700 con 0x7fecd406c480 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecd413ef20 con 0x7fecd406c480 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 569681371 0 0) 0x7fecc0003530 con 0x7fecd41d8fc0 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fecd413f700 con 0x7fecd41d8fc0 2024-05-06T06:51:11.557 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7feccc001b00 con 0x7fecd41d8fc0 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2918475799 0 0) 0x7fecd413f8d0 con 0x7fecd4073420 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fecc0003530 con 0x7fecd4073420 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fecc4001980 con 0x7fecd4073420 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2777109939 0 0) 0x7fecd413ef20 con 0x7fecd406c480 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fecd413f8d0 con 0x7fecd406c480 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fecc8001bf0 con 0x7fecd406c480 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 564942060 0 0) 0x7fecd413f700 con 0x7fecd41d8fc0 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 >> v1:172.21.15.184:6789/0 conn(0x7fecd406c480 legacy=0x7fecd41d88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 >> v1:172.21.15.70:6789/0 conn(0x7fecd4073420 legacy=0x7fecd413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd4140470 con 0x7fecd41d8fc0 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecd97f5640 1 -- 172.21.15.70:0/183894747 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fecd4140760 con 0x7fecd41d8fc0 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feccc001ff0 con 0x7fecd41d8fc0 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7feccc004d10 con 0x7fecd41d8fc0 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecd97f5640 1 -- 172.21.15.70:0/183894747 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fecd413dd50 con 0x7fecd41d8fc0 2024-05-06T06:51:11.558 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7feccc0050a0 con 0x7fecd41d8fc0 2024-05-06T06:51:11.559 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (unknown 1431123548 0 0) 0x7feccc0069b0 con 0x7fecd41d8fc0 2024-05-06T06:51:11.559 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.554+0000 7fecd97f5640 1 -- 172.21.15.70:0/183894747 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd406b920 con 0x7fecd41d8fc0 2024-05-06T06:51:11.571 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.570+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (unknown 1092875540 0 534071502) 0x7feccc0063f0 con 0x7fecd41d8fc0 2024-05-06T06:51:11.625 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.626+0000 7fecd97f5640 1 -- 172.21.15.70:0/183894747 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecd4077430 con 0x7fecd41d8fc0 2024-05-06T06:51:11.626 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.626+0000 7fecbb7fe640 1 -- 172.21.15.70:0/183894747 <== mon.2 v1:172.21.15.70:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (unknown 4040575075 0 1930146889) 0x7feccc006680 con 0x7fecd41d8fc0 2024-05-06T06:51:11.626 INFO:teuthology.misc.health.smithi070.stdout: 2024-05-06T06:51:11.626 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":10,"fsid":"90193adb-e1e1-4e06-9c0d-7abb14f25fc6","created":"2024-05-06T06:51:08.019705+0000","modified":"2024-05-06T06:51:10.302012+0000","last_up_change":"0.000000","last_in_change":"2024-05-06T06:51:10.302012+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e2c1f594-6b3c-49a9-b307-6b6284d59048","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fc494199-771b-4efe-85cf-edd309f73659","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5f691dc1-d6f0-4c85-9544-86c9b7cfa3b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"36920237-b28f-4955-ab5a-c6fd2e74e74e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00e3095d-4ffd-4184-a8e4-1a14d09e3e3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"091d4702-30c5-4c63-8529-92059782009a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8067e1b6-71d1-4924-881b-4a38fe446858","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dae86a11-8868-45b5-927f-f4233d632bb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T06:51:11.627 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.626+0000 7fecd97f5640 1 -- 172.21.15.70:0/183894747 >> v1:172.21.15.70:6790/0 conn(0x7fecd41d8fc0 legacy=0x7fecd413d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:11.627 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.626+0000 7fecd97f5640 1 -- 172.21.15.70:0/183894747 shutdown_connections 2024-05-06T06:51:11.627 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.626+0000 7fecd97f5640 1 -- 172.21.15.70:0/183894747 >> 172.21.15.70:0/183894747 conn(0x7fecd40b5bd0 msgr2=0x7fecd4135e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:11.627 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.626+0000 7fecd97f5640 1 -- 172.21.15.70:0/183894747 shutdown_connections 2024-05-06T06:51:11.627 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:11.626+0000 7fecd97f5640 1 -- 172.21.15.70:0/183894747 wait complete. 2024-05-06T06:51:11.640 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-06T06:51:11.881 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:11.878+0000 7f91fab30180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T06:51:11.956 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:11.954+0000 7f91fab30180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T06:51:12.082 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:12.080+0000 7f36fb9b1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-06T06:51:12.139 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:12.138+0000 7f91fab30180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T06:51:12.156 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:12.152+0000 7f36fb9b1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-06T06:51:12.212 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:12.210+0000 7f91fab30180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T06:51:12.337 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:12.336+0000 7f36fb9b1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-06T06:51:12.410 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:12.408+0000 7f36fb9b1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-06T06:51:12.498 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:12.498+0000 7f91fab30180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T06:51:12.560 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:12.558+0000 7f91fab30180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T06:51:12.699 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:12.696+0000 7f36fb9b1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-06T06:51:12.761 INFO:tasks.ceph.mgr.x.smithi184.stderr:2024-05-06T06:51:12.756+0000 7f36fb9b1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-06T06:51:13.598 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:13.598+0000 7f91a1778640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-06T06:51:13.601 INFO:tasks.ceph.mgr.y.smithi070.stderr:2024-05-06T06:51:13.598+0000 7f91a1778640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-06T06:51:14.582 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-05-06T06:51:14.582+0000 7f57f01777c0 -1 osd.0 0 log_to_monitors true 2024-05-06T06:51:14.583 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-05-06T06:51:14.582+0000 7f762391c7c0 -1 osd.2 0 log_to_monitors true 2024-05-06T06:51:14.614 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-05-06T06:51:14.612+0000 7fb28158b7c0 -1 osd.5 0 log_to_monitors true 2024-05-06T06:51:14.659 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-05-06T06:51:14.658+0000 7fdb625a37c0 -1 osd.3 0 log_to_monitors true 2024-05-06T06:51:14.702 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-05-06T06:51:14.700+0000 7f0887da77c0 -1 osd.6 0 log_to_monitors true 2024-05-06T06:51:14.756 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-05-06T06:51:14.752+0000 7f7181a677c0 -1 osd.4 0 log_to_monitors true 2024-05-06T06:51:14.872 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-05-06T06:51:14.870+0000 7f8ddc55e7c0 -1 osd.1 0 log_to_monitors true 2024-05-06T06:51:14.890 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-05-06T06:51:14.888+0000 7fd5d4e167c0 -1 osd.7 0 log_to_monitors true 2024-05-06T06:51:16.372 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-05-06T06:51:16.370+0000 7f57ec120640 -1 osd.0 0 waiting for initial osdmap 2024-05-06T06:51:16.383 INFO:tasks.ceph.osd.0.smithi070.stderr:2024-05-06T06:51:16.382+0000 7f57e3f54640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T06:51:16.617 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-05-06T06:51:16.614+0000 7f761f8c5640 -1 osd.2 0 waiting for initial osdmap 2024-05-06T06:51:16.618 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-05-06T06:51:16.618+0000 7f8dd8507640 -1 osd.1 0 waiting for initial osdmap 2024-05-06T06:51:16.618 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-05-06T06:51:16.618+0000 7fdb5e54c640 -1 osd.3 0 waiting for initial osdmap 2024-05-06T06:51:16.619 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-05-06T06:51:16.616+0000 7fb27d534640 -1 osd.5 0 waiting for initial osdmap 2024-05-06T06:51:16.620 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-05-06T06:51:16.616+0000 7f0883d50640 -1 osd.6 0 waiting for initial osdmap 2024-05-06T06:51:16.626 INFO:tasks.ceph.osd.1.smithi070.stderr:2024-05-06T06:51:16.626+0000 7f8dd4343640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T06:51:16.626 INFO:tasks.ceph.osd.2.smithi070.stderr:2024-05-06T06:51:16.626+0000 7f761b701640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T06:51:16.630 INFO:tasks.ceph.osd.3.smithi070.stderr:2024-05-06T06:51:16.630+0000 7fdb5a388640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T06:51:16.641 INFO:tasks.ceph.osd.6.smithi184.stderr:2024-05-06T06:51:16.640+0000 7f087fb8c640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T06:51:16.742 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-05-06T06:51:16.640+0000 7fb279370640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T06:51:18.012 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-05-06T06:51:18.008+0000 7f717e222640 -1 osd.4 0 waiting for initial osdmap 2024-05-06T06:51:18.020 INFO:tasks.ceph.osd.4.smithi184.stderr:2024-05-06T06:51:18.016+0000 7f7175844640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T06:51:18.050 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-05-06T06:51:18.048+0000 7fd5d0dbf640 -1 osd.7 0 waiting for initial osdmap 2024-05-06T06:51:18.057 INFO:tasks.ceph.osd.7.smithi184.stderr:2024-05-06T06:51:18.056+0000 7fd5c8bf3640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-06T06:51:18.448 DEBUG:teuthology.orchestra.run.smithi070:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-06T06:51:18.572 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.566+0000 7fe801890640 1 Processor -- start 2024-05-06T06:51:18.572 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.566+0000 7fe801890640 1 -- start start 2024-05-06T06:51:18.572 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7fc074560 con 0x7fe7fc0b1780 2024-05-06T06:51:18.572 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7fc0b1bd0 con 0x7fe7fc072020 2024-05-06T06:51:18.572 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7fc13eb90 con 0x7fe7fc072400 2024-05-06T06:51:18.572 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7fa7fc640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fe7fc072400 0x7fe7fc0b0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45710/0 (socket says 172.21.15.70:45710) 2024-05-06T06:51:18.572 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7fa7fc640 1 -- 172.21.15.70:0/654182064 learned_addr learned my addr 172.21.15.70:0/654182064 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:18.572 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7f9ffb640 1 -- 172.21.15.70:0/654182064 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565392920 0 0) 0x7fe7fc13eb90 con 0x7fe7fc072400 2024-05-06T06:51:18.572 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7f9ffb640 1 -- 172.21.15.70:0/654182064 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7e4003530 con 0x7fe7fc072400 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7f9ffb640 1 -- 172.21.15.70:0/654182064 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4049492324 0 0) 0x7fe7ec001120 con 0x7fe7fc0b1780 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7f9ffb640 1 -- 172.21.15.70:0/654182064 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7fc13eb90 con 0x7fe7fc0b1780 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7f9ffb640 1 -- 172.21.15.70:0/654182064 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4029866537 0 0) 0x7fe7e4003530 con 0x7fe7fc072400 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7f9ffb640 1 -- 172.21.15.70:0/654182064 >> v1:172.21.15.184:6789/0 conn(0x7fe7fc072020 legacy=0x7fe7fc1418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7f9ffb640 1 -- 172.21.15.70:0/654182064 >> v1:172.21.15.70:6789/0 conn(0x7fe7fc0b1780 legacy=0x7fe7fc14c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7f9ffb640 1 -- 172.21.15.70:0/654182064 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc141050 con 0x7fe7fc072400 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7f9ffb640 1 -- 172.21.15.70:0/654182064 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe7f4001a20 con 0x7fe7fc072400 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7f9ffb640 1 -- 172.21.15.70:0/654182064 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe7f4001c40 con 0x7fe7fc072400 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7f9ffb640 1 -- 172.21.15.70:0/654182064 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe7f40020d0 con 0x7fe7fc072400 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 -- 172.21.15.70:0/654182064 >> v1:172.21.15.70:6790/0 conn(0x7fe7fc072400 legacy=0x7fe7fc0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 -- 172.21.15.70:0/654182064 shutdown_connections 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 -- 172.21.15.70:0/654182064 >> 172.21.15.70:0/654182064 conn(0x7fe7fc0b6d80 msgr2=0x7fe7fc0b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 -- 172.21.15.70:0/654182064 shutdown_connections 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 -- 172.21.15.70:0/654182064 wait complete. 2024-05-06T06:51:18.573 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 Processor -- start 2024-05-06T06:51:18.574 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 -- start start 2024-05-06T06:51:18.576 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7fc12f880 con 0x7fe7fc072400 2024-05-06T06:51:18.576 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7fc139500 con 0x7fe7fc072020 2024-05-06T06:51:18.576 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe801890640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7fc1397e0 con 0x7fe7fc0b1780 2024-05-06T06:51:18.576 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7fb7fe640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fe7fc0b1780 0x7fe7fc1e1540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45716/0 (socket says 172.21.15.70:45716) 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7fb7fe640 1 -- 172.21.15.70:0/1426911270 learned_addr learned my addr 172.21.15.70:0/1426911270 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.570+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158434835 0 0) 0x7fe7fc1397e0 con 0x7fe7fc0b1780 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7e8003530 con 0x7fe7fc0b1780 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 36443945 0 0) 0x7fe7fc12f880 con 0x7fe7fc072400 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7fc1397e0 con 0x7fe7fc072400 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3271963765 0 0) 0x7fe7fc1397e0 con 0x7fe7fc072400 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7fc12f880 con 0x7fe7fc072400 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe7f4001df0 con 0x7fe7fc072400 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2970271572 0 0) 0x7fe7e8003530 con 0x7fe7fc0b1780 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7fc1397e0 con 0x7fe7fc0b1780 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699491472 0 0) 0x7fe7fc139500 con 0x7fe7fc072020 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7e8003530 con 0x7fe7fc072020 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe7ec001910 con 0x7fe7fc0b1780 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1357978640 0 0) 0x7fe7fc12f880 con 0x7fe7fc072400 2024-05-06T06:51:18.577 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 >> v1:172.21.15.70:6790/0 conn(0x7fe7fc0b1780 legacy=0x7fe7fc1e1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:18.578 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 >> v1:172.21.15.184:6789/0 conn(0x7fe7fc072020 legacy=0x7fe7fc12ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:18.578 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc139ac0 con 0x7fe7fc072400 2024-05-06T06:51:18.578 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe801890640 1 -- 172.21.15.70:0/1426911270 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe7fc1438c0 con 0x7fe7fc072400 2024-05-06T06:51:18.578 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe801890640 1 -- 172.21.15.70:0/1426911270 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe7fc138870 con 0x7fe7fc072400 2024-05-06T06:51:18.578 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe7f4001ba0 con 0x7fe7fc072400 2024-05-06T06:51:18.578 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fe7f4005000 con 0x7fe7fc072400 2024-05-06T06:51:18.578 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe801890640 1 -- 172.21.15.70:0/1426911270 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7dc005090 con 0x7fe7fc072400 2024-05-06T06:51:18.578 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 4) ==== 93116+0+0 (unknown 3006460084 0 0) 0x7fe7f401bd70 con 0x7fe7fc072400 2024-05-06T06:51:18.578 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.574+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 3071+0+0 (unknown 1233004653 0 0) 0x7fe7f408a480 con 0x7fe7fc072400 2024-05-06T06:51:18.580 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.578+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fe7f4057e20 con 0x7fe7fc072400 2024-05-06T06:51:18.749 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.750+0000 7fe801890640 1 -- 172.21.15.70:0/1426911270 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7dc005380 con 0x7fe7fc072400 2024-05-06T06:51:18.750 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.750+0000 7fe7e3fff640 1 -- 172.21.15.70:0/1426911270 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10895 (unknown 4221056075 0 1845183423) 0x7fe7f4057720 con 0x7fe7fc072400 2024-05-06T06:51:18.750 INFO:teuthology.misc.health.smithi070.stdout: 2024-05-06T06:51:18.750 INFO:teuthology.misc.health.smithi070.stdout:{"epoch":15,"fsid":"90193adb-e1e1-4e06-9c0d-7abb14f25fc6","created":"2024-05-06T06:51:08.019705+0000","modified":"2024-05-06T06:51:18.638703+0000","last_up_change":"2024-05-06T06:51:18.638703+0000","last_in_change":"2024-05-06T06:51:10.302012+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T06:51:18.627852+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2c1f594-6b3c-49a9-b307-6b6284d59048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6804","nonce":3977328488}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6805","nonce":3977328488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6807","nonce":3977328488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6806","nonce":3977328488}]},"public_addr":"172.21.15.70:6804/3977328488","cluster_addr":"172.21.15.70:6805/3977328488","heartbeat_back_addr":"172.21.15.70:6807/3977328488","heartbeat_front_addr":"172.21.15.70:6806/3977328488","state":["exists","up"]},{"osd":1,"uuid":"fc494199-771b-4efe-85cf-edd309f73659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6812","nonce":1567593695}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6813","nonce":1567593695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6815","nonce":1567593695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6814","nonce":1567593695}]},"public_addr":"172.21.15.70:6812/1567593695","cluster_addr":"172.21.15.70:6813/1567593695","heartbeat_back_addr":"172.21.15.70:6815/1567593695","heartbeat_front_addr":"172.21.15.70:6814/1567593695","state":["exists","up"]},{"osd":2,"uuid":"5f691dc1-d6f0-4c85-9544-86c9b7cfa3b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6800","nonce":1610479439}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6801","nonce":1610479439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6803","nonce":1610479439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6802","nonce":1610479439}]},"public_addr":"172.21.15.70:6800/1610479439","cluster_addr":"172.21.15.70:6801/1610479439","heartbeat_back_addr":"172.21.15.70:6803/1610479439","heartbeat_front_addr":"172.21.15.70:6802/1610479439","state":["exists","up"]},{"osd":3,"uuid":"36920237-b28f-4955-ab5a-c6fd2e74e74e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6808","nonce":3320203314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6809","nonce":3320203314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6811","nonce":3320203314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6810","nonce":3320203314}]},"public_addr":"172.21.15.70:6808/3320203314","cluster_addr":"172.21.15.70:6809/3320203314","heartbeat_back_addr":"172.21.15.70:6811/3320203314","heartbeat_front_addr":"172.21.15.70:6810/3320203314","state":["exists","up"]},{"osd":4,"uuid":"00e3095d-4ffd-4184-a8e4-1a14d09e3e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6808","nonce":1828934695}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6809","nonce":1828934695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6811","nonce":1828934695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6810","nonce":1828934695}]},"public_addr":"172.21.15.184:6808/1828934695","cluster_addr":"172.21.15.184:6809/1828934695","heartbeat_back_addr":"172.21.15.184:6811/1828934695","heartbeat_front_addr":"172.21.15.184:6810/1828934695","state":["exists","up"]},{"osd":5,"uuid":"091d4702-30c5-4c63-8529-92059782009a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6800","nonce":1533654869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6801","nonce":1533654869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6803","nonce":1533654869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6802","nonce":1533654869}]},"public_addr":"172.21.15.184:6800/1533654869","cluster_addr":"172.21.15.184:6801/1533654869","heartbeat_back_addr":"172.21.15.184:6803/1533654869","heartbeat_front_addr":"172.21.15.184:6802/1533654869","state":["exists","up"]},{"osd":6,"uuid":"8067e1b6-71d1-4924-881b-4a38fe446858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6804","nonce":3136453628}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6805","nonce":3136453628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6807","nonce":3136453628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6806","nonce":3136453628}]},"public_addr":"172.21.15.184:6804/3136453628","cluster_addr":"172.21.15.184:6805/3136453628","heartbeat_back_addr":"172.21.15.184:6807/3136453628","heartbeat_front_addr":"172.21.15.184:6806/3136453628","state":["exists","up"]},{"osd":7,"uuid":"dae86a11-8868-45b5-927f-f4233d632bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6812","nonce":1421504082}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6813","nonce":1421504082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6815","nonce":1421504082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6814","nonce":1421504082}]},"public_addr":"172.21.15.184:6812/1421504082","cluster_addr":"172.21.15.184:6813/1421504082","heartbeat_back_addr":"172.21.15.184:6815/1421504082","heartbeat_front_addr":"172.21.15.184:6814/1421504082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:16.376779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.832124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.688562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.572410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.703574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T06:51:18.752 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.750+0000 7fe801890640 1 -- 172.21.15.70:0/1426911270 >> v1:172.21.15.70:6816/2757942729 conn(0x7fe7e8070000 legacy=0x7fe7e80724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:18.752 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.750+0000 7fe801890640 1 -- 172.21.15.70:0/1426911270 >> v1:172.21.15.70:6789/0 conn(0x7fe7fc072400 legacy=0x7fe7fc12f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:18.753 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.750+0000 7fe801890640 1 -- 172.21.15.70:0/1426911270 shutdown_connections 2024-05-06T06:51:18.753 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.750+0000 7fe801890640 1 -- 172.21.15.70:0/1426911270 >> 172.21.15.70:0/1426911270 conn(0x7fe7fc0b6d80 msgr2=0x7fe7fc0682e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:18.753 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.750+0000 7fe801890640 1 -- 172.21.15.70:0/1426911270 shutdown_connections 2024-05-06T06:51:18.753 INFO:teuthology.misc.health.smithi070.stderr:2024-05-06T06:51:18.750+0000 7fe801890640 1 -- 172.21.15.70:0/1426911270 wait complete. 2024-05-06T06:51:18.768 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-06T06:51:18.769 INFO:tasks.ceph:Creating RBD pool 2024-05-06T06:51:18.769 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-06T06:51:18.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e729f640 1 Processor -- start 2024-05-06T06:51:18.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e729f640 1 -- start start 2024-05-06T06:51:18.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e729f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e00742f0 con 0x7f38e00acea0 2024-05-06T06:51:18.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e729f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e00af170 con 0x7f38e00ad280 2024-05-06T06:51:18.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e729f640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e00ae250 con 0x7f38e00af4d0 2024-05-06T06:51:18.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e483a640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f38e00af4d0 0x7f38e01418e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45722/0 (socket says 172.21.15.70:45722) 2024-05-06T06:51:18.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e503b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f38e00acea0 0x7f38e013e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60226/0 (socket says 172.21.15.70:60226) 2024-05-06T06:51:18.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e483a640 1 -- 172.21.15.70:0/2243645173 learned_addr learned my addr 172.21.15.70:0/2243645173 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:18.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38d7fff640 1 -- 172.21.15.70:0/2243645173 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204263281 0 0) 0x7f38e00ae250 con 0x7f38e00af4d0 2024-05-06T06:51:18.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38d7fff640 1 -- 172.21.15.70:0/2243645173 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38cc003530 con 0x7f38e00af4d0 2024-05-06T06:51:18.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38d7fff640 1 -- 172.21.15.70:0/2243645173 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1939262916 0 0) 0x7f38e00742f0 con 0x7f38e00acea0 2024-05-06T06:51:18.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38d7fff640 1 -- 172.21.15.70:0/2243645173 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38e00ae250 con 0x7f38e00acea0 2024-05-06T06:51:18.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38d7fff640 1 -- 172.21.15.70:0/2243645173 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3420263498 0 0) 0x7f38cc003530 con 0x7f38e00af4d0 2024-05-06T06:51:18.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38d7fff640 1 -- 172.21.15.70:0/2243645173 >> v1:172.21.15.184:6789/0 conn(0x7f38e00ad280 legacy=0x7f38e014caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:18.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38d7fff640 1 -- 172.21.15.70:0/2243645173 >> v1:172.21.15.70:6789/0 conn(0x7f38e00acea0 legacy=0x7f38e013e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:18.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38d7fff640 1 -- 172.21.15.70:0/2243645173 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e013ed30 con 0x7f38e00af4d0 2024-05-06T06:51:18.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38d7fff640 1 -- 172.21.15.70:0/2243645173 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f38dc0016a0 con 0x7f38e00af4d0 2024-05-06T06:51:18.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38d7fff640 1 -- 172.21.15.70:0/2243645173 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f38dc0018c0 con 0x7f38e00af4d0 2024-05-06T06:51:18.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38d7fff640 1 -- 172.21.15.70:0/2243645173 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f38dc001d10 con 0x7f38e00af4d0 2024-05-06T06:51:18.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e729f640 1 -- 172.21.15.70:0/2243645173 >> v1:172.21.15.70:6790/0 conn(0x7f38e00af4d0 legacy=0x7f38e01418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:18.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e729f640 1 -- 172.21.15.70:0/2243645173 shutdown_connections 2024-05-06T06:51:18.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e729f640 1 -- 172.21.15.70:0/2243645173 >> 172.21.15.70:0/2243645173 conn(0x7f38e00b4ad0 msgr2=0x7f38e00b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:18.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e729f640 1 -- 172.21.15.70:0/2243645173 shutdown_connections 2024-05-06T06:51:18.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e729f640 1 -- 172.21.15.70:0/2243645173 wait complete. 2024-05-06T06:51:18.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e729f640 1 Processor -- start 2024-05-06T06:51:18.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.890+0000 7f38e729f640 1 -- start start 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38e729f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e013f020 con 0x7f38e00acea0 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38e729f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e0140c70 con 0x7f38e00af4d0 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38e729f640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e0138630 con 0x7f38e00ad280 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38e503b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f38e00acea0 0x7f38e013ffc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60230/0 (socket says 172.21.15.70:60230) 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38e503b640 1 -- 172.21.15.70:0/2348524968 learned_addr learned my addr 172.21.15.70:0/2348524968 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458684429 0 0) 0x7f38e013f020 con 0x7f38e00acea0 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38c4003530 con 0x7f38e00acea0 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347717952 0 0) 0x7f38e0138630 con 0x7f38e00ad280 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38e013f020 con 0x7f38e00ad280 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1295753706 0 0) 0x7f38c4003530 con 0x7f38e00acea0 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f38e0138630 con 0x7f38e00acea0 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f38d0001960 con 0x7f38e00acea0 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3695636999 0 0) 0x7f38e013f020 con 0x7f38e00ad280 2024-05-06T06:51:18.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f38c4003530 con 0x7f38e00ad280 2024-05-06T06:51:18.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f38dc001c10 con 0x7f38e00ad280 2024-05-06T06:51:18.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3000819770 0 0) 0x7f38e0138630 con 0x7f38e00acea0 2024-05-06T06:51:18.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 >> v1:172.21.15.70:6790/0 conn(0x7f38e00ad280 legacy=0x7f38e013c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:18.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 >> v1:172.21.15.184:6789/0 conn(0x7f38e00af4d0 legacy=0x7f38e01e1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:18.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e013a680 con 0x7f38e00acea0 2024-05-06T06:51:18.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38e729f640 1 -- 172.21.15.70:0/2348524968 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f38e01406d0 con 0x7f38e00acea0 2024-05-06T06:51:18.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38e729f640 1 -- 172.21.15.70:0/2348524968 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f38e013c990 con 0x7f38e00acea0 2024-05-06T06:51:18.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f38d0001ca0 con 0x7f38e00acea0 2024-05-06T06:51:18.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f38d0004c40 con 0x7f38e00acea0 2024-05-06T06:51:18.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38e729f640 1 -- 172.21.15.70:0/2348524968 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c0005090 con 0x7f38e00acea0 2024-05-06T06:51:18.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 4) ==== 93116+0+0 (unknown 3006460084 0 0) 0x7f38d001b9b0 con 0x7f38e00acea0 2024-05-06T06:51:18.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.894+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3726+0+0 (unknown 1077455389 0 0) 0x7f38d008a460 con 0x7f38e00acea0 2024-05-06T06:51:18.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:18.898+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f38d0057b10 con 0x7f38e00acea0 2024-05-06T06:51:19.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.062+0000 7f38e729f640 1 -- 172.21.15.70:0/2348524968 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f38c0005c50 con 0x7f38e00acea0 2024-05-06T06:51:19.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.646+0000 7f38d5ffb640 1 -- 172.21.15.70:0/2348524968 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) ==== 109+0+0 (unknown 231814880 0 0) 0x7f38d0057410 con 0x7f38e00acea0 2024-05-06T06:51:19.646 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'rbd' created 2024-05-06T06:51:19.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.650+0000 7f38e729f640 1 -- 172.21.15.70:0/2348524968 >> v1:172.21.15.70:6816/2757942729 conn(0x7f38c406fef0 legacy=0x7f38c40723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:19.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.650+0000 7f38e729f640 1 -- 172.21.15.70:0/2348524968 >> v1:172.21.15.70:6789/0 conn(0x7f38e00acea0 legacy=0x7f38e013ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:19.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.650+0000 7f38e729f640 1 -- 172.21.15.70:0/2348524968 shutdown_connections 2024-05-06T06:51:19.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.650+0000 7f38e729f640 1 -- 172.21.15.70:0/2348524968 >> 172.21.15.70:0/2348524968 conn(0x7f38e00b4ad0 msgr2=0x7f38e013e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:19.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.650+0000 7f38e729f640 1 -- 172.21.15.70:0/2348524968 shutdown_connections 2024-05-06T06:51:19.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.650+0000 7f38e729f640 1 -- 172.21.15.70:0/2348524968 wait complete. 2024-05-06T06:51:19.675 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-06T06:51:19.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.790+0000 7f5bd24c0640 1 Processor -- start 2024-05-06T06:51:19.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.790+0000 7f5bd24c0640 1 -- start start 2024-05-06T06:51:19.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bcc0b2220 con 0x7f5bcc0685a0 2024-05-06T06:51:19.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bcc0affb0 con 0x7f5bcc0681c0 2024-05-06T06:51:19.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bcc141090 con 0x7f5bcc073f60 2024-05-06T06:51:19.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bc3fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5bcc0685a0 0x7f5bcc0ae870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60268/0 (socket says 172.21.15.70:60268) 2024-05-06T06:51:19.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bc3fff640 1 -- 172.21.15.70:0/2174834212 learned_addr learned my addr 172.21.15.70:0/2174834212 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:19.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd0a5d640 1 --1- 172.21.15.70:0/2174834212 >> v1:172.21.15.70:6790/0 conn(0x7f5bcc073f60 0x7f5bcc140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45770/0 (socket says 172.21.15.70:45770) 2024-05-06T06:51:19.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcb7fe640 1 -- 172.21.15.70:0/2174834212 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543017037 0 0) 0x7f5bcc0b2220 con 0x7f5bcc0685a0 2024-05-06T06:51:19.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcb7fe640 1 -- 172.21.15.70:0/2174834212 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bb8003530 con 0x7f5bcc0685a0 2024-05-06T06:51:19.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcb7fe640 1 -- 172.21.15.70:0/2174834212 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1554103163 0 0) 0x7f5bcc141090 con 0x7f5bcc073f60 2024-05-06T06:51:19.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcb7fe640 1 -- 172.21.15.70:0/2174834212 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bcc0b2220 con 0x7f5bcc073f60 2024-05-06T06:51:19.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcb7fe640 1 -- 172.21.15.70:0/2174834212 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 837299770 0 0) 0x7f5bb8003530 con 0x7f5bcc0685a0 2024-05-06T06:51:19.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcb7fe640 1 -- 172.21.15.70:0/2174834212 >> v1:172.21.15.70:6790/0 conn(0x7f5bcc073f60 legacy=0x7f5bcc140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:19.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcb7fe640 1 -- 172.21.15.70:0/2174834212 >> v1:172.21.15.184:6789/0 conn(0x7f5bcc0681c0 legacy=0x7f5bcc0b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:19.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcb7fe640 1 -- 172.21.15.70:0/2174834212 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bcc0b10a0 con 0x7f5bcc0685a0 2024-05-06T06:51:19.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcb7fe640 1 -- 172.21.15.70:0/2174834212 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5bb40016a0 con 0x7f5bcc0685a0 2024-05-06T06:51:19.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcb7fe640 1 -- 172.21.15.70:0/2174834212 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5bb40018c0 con 0x7f5bcc0685a0 2024-05-06T06:51:19.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcb7fe640 1 -- 172.21.15.70:0/2174834212 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5bb4001d50 con 0x7f5bcc0685a0 2024-05-06T06:51:19.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 -- 172.21.15.70:0/2174834212 >> v1:172.21.15.70:6789/0 conn(0x7f5bcc0685a0 legacy=0x7f5bcc0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:19.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 -- 172.21.15.70:0/2174834212 shutdown_connections 2024-05-06T06:51:19.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 -- 172.21.15.70:0/2174834212 >> 172.21.15.70:0/2174834212 conn(0x7f5bcc0b5b70 msgr2=0x7f5bcc0b5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:19.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 -- 172.21.15.70:0/2174834212 shutdown_connections 2024-05-06T06:51:19.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 -- 172.21.15.70:0/2174834212 wait complete. 2024-05-06T06:51:19.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 Processor -- start 2024-05-06T06:51:19.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 -- start start 2024-05-06T06:51:19.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bcc14fba0 con 0x7f5bcc073f60 2024-05-06T06:51:19.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bcc1401b0 con 0x7f5bcc14f710 2024-05-06T06:51:19.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bd24c0640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bcc144810 con 0x7f5bcc0681c0 2024-05-06T06:51:19.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcbfff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f5bcc0681c0 0x7f5bcc14f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45786/0 (socket says 172.21.15.70:45786) 2024-05-06T06:51:19.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bc3fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5bcc073f60 0x7f5bcc13e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60274/0 (socket says 172.21.15.70:60274) 2024-05-06T06:51:19.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bcbfff640 1 -- 172.21.15.70:0/3216867470 learned_addr learned my addr 172.21.15.70:0/3216867470 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:19.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1415022013 0 0) 0x7f5bcc14fba0 con 0x7f5bcc073f60 2024-05-06T06:51:19.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bac003530 con 0x7f5bcc073f60 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213176539 0 0) 0x7f5bcc144810 con 0x7f5bcc0681c0 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bcc14fba0 con 0x7f5bcc0681c0 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1292300517 0 0) 0x7f5bac003530 con 0x7f5bcc073f60 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.794+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5bcc144810 con 0x7f5bcc073f60 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5bb4001a70 con 0x7f5bcc073f60 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2234327164 0 0) 0x7f5bcc14fba0 con 0x7f5bcc0681c0 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5bac003530 con 0x7f5bcc0681c0 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5bbc001a00 con 0x7f5bcc0681c0 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3860956874 0 0) 0x7f5bcc1401b0 con 0x7f5bcc14f710 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bcc14fba0 con 0x7f5bcc14f710 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 606385180 0 0) 0x7f5bac003530 con 0x7f5bcc0681c0 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 >> v1:172.21.15.184:6789/0 conn(0x7f5bcc14f710 legacy=0x7f5bcc13e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 >> v1:172.21.15.70:6789/0 conn(0x7f5bcc073f60 legacy=0x7f5bcc13e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:19.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bcc1dc250 con 0x7f5bcc0681c0 2024-05-06T06:51:19.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bd24c0640 1 -- 172.21.15.70:0/3216867470 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5bcc1dc540 con 0x7f5bcc0681c0 2024-05-06T06:51:19.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bd24c0640 1 -- 172.21.15.70:0/3216867470 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5bcc1dcaf0 con 0x7f5bcc0681c0 2024-05-06T06:51:19.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5bbc001d00 con 0x7f5bcc0681c0 2024-05-06T06:51:19.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5bbc003a70 con 0x7f5bcc0681c0 2024-05-06T06:51:19.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bd24c0640 1 -- 172.21.15.70:0/3216867470 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb0005090 con 0x7f5bcc0681c0 2024-05-06T06:51:19.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 4) ==== 93116+0+0 (unknown 3006460084 0 0) 0x7f5bbc003c10 con 0x7f5bcc0681c0 2024-05-06T06:51:19.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.798+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(16..16 src has 1..16) ==== 4079+0+0 (unknown 1478681655 0 0) 0x7f5bbc08a620 con 0x7f5bcc0681c0 2024-05-06T06:51:19.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.802+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f5bcc0affb0 con 0x7f5bcc0681c0 2024-05-06T06:51:19.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:19.966+0000 7f5bd24c0640 1 -- 172.21.15.70:0/3216867470 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f5bb0005380 con 0x7f5bcc0681c0 2024-05-06T06:51:20.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.674+0000 7f5bc97fa640 1 -- 172.21.15.70:0/3216867470 <== mon.2 v1:172.21.15.70:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) ==== 173+0+0 (unknown 2255673937 0 0) 0x7f5bbc057c30 con 0x7f5bcc0681c0 2024-05-06T06:51:20.675 INFO:teuthology.orchestra.run.smithi070.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-06T06:51:20.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.678+0000 7f5bd24c0640 1 -- 172.21.15.70:0/3216867470 >> v1:172.21.15.70:6816/2757942729 conn(0x7f5bac070030 legacy=0x7f5bac0724f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:20.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.678+0000 7f5bd24c0640 1 -- 172.21.15.70:0/3216867470 >> v1:172.21.15.70:6790/0 conn(0x7f5bcc0681c0 legacy=0x7f5bcc14f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:20.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.678+0000 7f5bd24c0640 1 -- 172.21.15.70:0/3216867470 shutdown_connections 2024-05-06T06:51:20.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.678+0000 7f5bd24c0640 1 -- 172.21.15.70:0/3216867470 >> 172.21.15.70:0/3216867470 conn(0x7f5bcc0b5b70 msgr2=0x7f5bcc140b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:20.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.678+0000 7f5bd24c0640 1 -- 172.21.15.70:0/3216867470 shutdown_connections 2024-05-06T06:51:20.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.678+0000 7f5bd24c0640 1 -- 172.21.15.70:0/3216867470 wait complete. 2024-05-06T06:51:20.701 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-06T06:51:20.701 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-06T06:51:20.701 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-06T06:51:20.701 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-06T06:51:20.702 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-06T06:51:20.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f652079c640 1 Processor -- start 2024-05-06T06:51:20.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f652079c640 1 -- start start 2024-05-06T06:51:20.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f652079c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65180aecf0 con 0x7f65180b21e0 2024-05-06T06:51:20.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f652079c640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65180aef60 con 0x7f651806ca30 2024-05-06T06:51:20.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f652079c640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65180af240 con 0x7f65181475b0 2024-05-06T06:51:20.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651dd37640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f65181475b0 0x7f65180b1ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45808/0 (socket says 172.21.15.70:45808) 2024-05-06T06:51:20.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651dd37640 1 -- 172.21.15.70:0/177152816 learned_addr learned my addr 172.21.15.70:0/177152816 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:20.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651d536640 1 -- 172.21.15.70:0/177152816 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326995309 0 0) 0x7f65180af240 con 0x7f65181475b0 2024-05-06T06:51:20.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651d536640 1 -- 172.21.15.70:0/177152816 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6500003530 con 0x7f65181475b0 2024-05-06T06:51:20.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651d536640 1 -- 172.21.15.70:0/177152816 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2710800326 0 0) 0x7f65180aecf0 con 0x7f65180b21e0 2024-05-06T06:51:20.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651d536640 1 -- 172.21.15.70:0/177152816 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65180af240 con 0x7f65180b21e0 2024-05-06T06:51:20.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651d536640 1 -- 172.21.15.70:0/177152816 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 318278550 0 0) 0x7f6500003530 con 0x7f65181475b0 2024-05-06T06:51:20.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651d536640 1 -- 172.21.15.70:0/177152816 >> v1:172.21.15.184:6789/0 conn(0x7f651806ca30 legacy=0x7f6518146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:20.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651d536640 1 -- 172.21.15.70:0/177152816 >> v1:172.21.15.70:6789/0 conn(0x7f65180b21e0 legacy=0x7f651814ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:20.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651d536640 1 -- 172.21.15.70:0/177152816 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651806d8e0 con 0x7f65181475b0 2024-05-06T06:51:20.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651d536640 1 -- 172.21.15.70:0/177152816 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f650c0016a0 con 0x7f65181475b0 2024-05-06T06:51:20.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651d536640 1 -- 172.21.15.70:0/177152816 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f650c0018c0 con 0x7f65181475b0 2024-05-06T06:51:20.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f651d536640 1 -- 172.21.15.70:0/177152816 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f650c001cd0 con 0x7f65181475b0 2024-05-06T06:51:20.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f652079c640 1 -- 172.21.15.70:0/177152816 >> v1:172.21.15.70:6790/0 conn(0x7f65181475b0 legacy=0x7f65180b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:20.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f652079c640 1 -- 172.21.15.70:0/177152816 shutdown_connections 2024-05-06T06:51:20.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f652079c640 1 -- 172.21.15.70:0/177152816 >> 172.21.15.70:0/177152816 conn(0x7f65180b6bf0 msgr2=0x7f65180b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:20.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f652079c640 1 -- 172.21.15.70:0/177152816 shutdown_connections 2024-05-06T06:51:20.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f652079c640 1 -- 172.21.15.70:0/177152816 wait complete. 2024-05-06T06:51:20.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f652079c640 1 Processor -- start 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.822+0000 7f652079c640 1 -- start start 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f652079c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6518149770 con 0x7f651806ca30 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f652079c640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65181499e0 con 0x7f65181475b0 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f652079c640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6518149cc0 con 0x7f65180b21e0 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f651dd37640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f65180b21e0 0x7f6518144210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45814/0 (socket says 172.21.15.70:45814) 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f651dd37640 1 -- 172.21.15.70:0/3937219783 learned_addr learned my addr 172.21.15.70:0/3937219783 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f651e538640 1 --1- 172.21.15.70:0/3937219783 >> v1:172.21.15.70:6789/0 conn(0x7f651806ca30 0x7f651814a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60302/0 (socket says 172.21.15.70:60302) 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1674561747 0 0) 0x7f6518149cc0 con 0x7f65180b21e0 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6504003530 con 0x7f65180b21e0 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 306743686 0 0) 0x7f6518149770 con 0x7f651806ca30 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6518149cc0 con 0x7f651806ca30 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4164642325 0 0) 0x7f6504003530 con 0x7f65180b21e0 2024-05-06T06:51:20.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6518149770 con 0x7f65180b21e0 2024-05-06T06:51:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f650c001cd0 con 0x7f65180b21e0 2024-05-06T06:51:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 855029268 0 0) 0x7f6518149cc0 con 0x7f651806ca30 2024-05-06T06:51:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6504003530 con 0x7f651806ca30 2024-05-06T06:51:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6508001cc0 con 0x7f651806ca30 2024-05-06T06:51:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1840322355 0 0) 0x7f6518149770 con 0x7f65180b21e0 2024-05-06T06:51:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 >> v1:172.21.15.184:6789/0 conn(0x7f65181475b0 legacy=0x7f65181e3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 >> v1:172.21.15.70:6789/0 conn(0x7f651806ca30 legacy=0x7f651814a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6518149fa0 con 0x7f65180b21e0 2024-05-06T06:51:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f652079c640 1 -- 172.21.15.70:0/3937219783 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6518148c10 con 0x7f65180b21e0 2024-05-06T06:51:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f652079c640 1 -- 172.21.15.70:0/3937219783 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6518147e90 con 0x7f65180b21e0 2024-05-06T06:51:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f650c0018c0 con 0x7f65180b21e0 2024-05-06T06:51:20.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f650c004aa0 con 0x7f65180b21e0 2024-05-06T06:51:20.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f652079c640 1 -- 172.21.15.70:0/3937219783 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f8005090 con 0x7f65180b21e0 2024-05-06T06:51:20.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 4) ==== 93116+0+0 (unknown 3006460084 0 0) 0x7f650c01b810 con 0x7f65180b21e0 2024-05-06T06:51:20.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.826+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (unknown 3045382083 0 0) 0x7f650c08a590 con 0x7f65180b21e0 2024-05-06T06:51:20.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:20.834+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f650c057ad0 con 0x7f65180b21e0 2024-05-06T06:51:21.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.034+0000 7f652079c640 1 -- 172.21.15.70:0/3937219783 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f64f8005380 con 0x7f65180b21e0 2024-05-06T06:51:21.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.038+0000 7f6516ffd640 1 -- 172.21.15.70:0/3937219783 <== mon.2 v1:172.21.15.70:6790/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) ==== 74+0+179392 (unknown 3797009233 0 1293475431) 0x7f650c0573d0 con 0x7f65180b21e0 2024-05-06T06:51:21.042 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:51:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.042+0000 7f652079c640 1 -- 172.21.15.70:0/3937219783 >> v1:172.21.15.70:6816/2757942729 conn(0x7f650406fef0 legacy=0x7f65040723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.042+0000 7f652079c640 1 -- 172.21.15.70:0/3937219783 >> v1:172.21.15.70:6790/0 conn(0x7f65180b21e0 legacy=0x7f6518144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.042+0000 7f652079c640 1 -- 172.21.15.70:0/3937219783 shutdown_connections 2024-05-06T06:51:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.042+0000 7f652079c640 1 -- 172.21.15.70:0/3937219783 >> 172.21.15.70:0/3937219783 conn(0x7f65180b6bf0 msgr2=0x7f6518146c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.042+0000 7f652079c640 1 -- 172.21.15.70:0/3937219783 shutdown_connections 2024-05-06T06:51:21.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.042+0000 7f652079c640 1 -- 172.21.15.70:0/3937219783 wait complete. 2024-05-06T06:51:21.059 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":4,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6816","nonce":2757942729}]},"active_addr":"172.21.15.70:6816/2757942729","active_change":"2024-05-06T06:51:12.583274+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2896093623}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":1317249039}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3192258400}]}]} 2024-05-06T06:51:21.063 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-06T06:51:21.063 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-06T06:51:21.063 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-06T06:51:21.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.182+0000 7f74e49b5640 1 Processor -- start 2024-05-06T06:51:21.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.182+0000 7f74e49b5640 1 -- start start 2024-05-06T06:51:21.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.182+0000 7f74e49b5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e006f4d0 con 0x7f74e00adfe0 2024-05-06T06:51:21.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.182+0000 7f74e49b5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e00740f0 con 0x7f74e00acd50 2024-05-06T06:51:21.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.182+0000 7f74e49b5640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e013ece0 con 0x7f74e00ad130 2024-05-06T06:51:21.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74ded9d640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f74e00ad130 0x7f74e014ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45816/0 (socket says 172.21.15.70:45816) 2024-05-06T06:51:21.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74ddd9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f74e00adfe0 0x7f74e013e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60304/0 (socket says 172.21.15.70:60304) 2024-05-06T06:51:21.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74ded9d640 1 -- 172.21.15.70:0/274099793 learned_addr learned my addr 172.21.15.70:0/274099793 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74dd59a640 1 -- 172.21.15.70:0/274099793 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417487576 0 0) 0x7f74e013ece0 con 0x7f74e00ad130 2024-05-06T06:51:21.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74dd59a640 1 -- 172.21.15.70:0/274099793 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74cc003530 con 0x7f74e00ad130 2024-05-06T06:51:21.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74dd59a640 1 -- 172.21.15.70:0/274099793 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807803744 0 0) 0x7f74e006f4d0 con 0x7f74e00adfe0 2024-05-06T06:51:21.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74dd59a640 1 -- 172.21.15.70:0/274099793 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74e013ece0 con 0x7f74e00adfe0 2024-05-06T06:51:21.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74ddd9b640 1 -- 172.21.15.70:0/274099793 >> v1:172.21.15.70:6789/0 conn(0x7f74e00adfe0 legacy=0x7f74e013e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74ddd9b640 1 -- 172.21.15.70:0/274099793 >> v1:172.21.15.70:6789/0 conn(0x7f74e00adfe0 legacy=0x7f74e013e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74ddd9b640 1 --1- 172.21.15.70:0/274099793 >> v1:172.21.15.70:6789/0 conn(0x7f74e00adfe0 0x7f74e013e5d0 :-1 s=OPENED pgs=88 cs=1 l=1).handle_message read tag failed 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74ddd9b640 1 --1- 172.21.15.70:0/274099793 >> v1:172.21.15.70:6789/0 conn(0x7f74e00adfe0 0x7f74e013e5d0 :-1 s=OPENED pgs=88 cs=1 l=1).fault on lossy channel, failing 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74dd59a640 1 -- 172.21.15.70:0/274099793 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 536384794 0 0) 0x7f74cc003530 con 0x7f74e00ad130 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74dd59a640 1 -- 172.21.15.70:0/274099793 >> v1:172.21.15.184:6789/0 conn(0x7f74e00acd50 legacy=0x7f74e0144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74dd59a640 1 -- 172.21.15.70:0/274099793 >> v1:172.21.15.70:6789/0 conn(0x7f74e00adfe0 legacy=0x7f74e013e5d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74dd59a640 1 -- 172.21.15.70:0/274099793 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e00af3f0 con 0x7f74e00ad130 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74dd59a640 1 -- 172.21.15.70:0/274099793 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f74d00016a0 con 0x7f74e00ad130 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74dd59a640 1 -- 172.21.15.70:0/274099793 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74d00018c0 con 0x7f74e00ad130 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74dd59a640 1 -- 172.21.15.70:0/274099793 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f74d0001d10 con 0x7f74e00ad130 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74e49b5640 1 -- 172.21.15.70:0/274099793 >> v1:172.21.15.70:6790/0 conn(0x7f74e00ad130 legacy=0x7f74e014ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74e49b5640 1 -- 172.21.15.70:0/274099793 shutdown_connections 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74e49b5640 1 -- 172.21.15.70:0/274099793 >> 172.21.15.70:0/274099793 conn(0x7f74e00b49f0 msgr2=0x7f74e00b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74e49b5640 1 -- 172.21.15.70:0/274099793 shutdown_connections 2024-05-06T06:51:21.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74e49b5640 1 -- 172.21.15.70:0/274099793 wait complete. 2024-05-06T06:51:21.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74e49b5640 1 Processor -- start 2024-05-06T06:51:21.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74e49b5640 1 -- start start 2024-05-06T06:51:21.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74e49b5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e00ac200 con 0x7f74e00ad130 2024-05-06T06:51:21.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74e49b5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e01443d0 con 0x7f74e00adfe0 2024-05-06T06:51:21.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74e49b5640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e0138130 con 0x7f74e00acd50 2024-05-06T06:51:21.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74ddd9b640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f74e00ad130 0x7f74e01d89d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60316/0 (socket says 172.21.15.70:60316) 2024-05-06T06:51:21.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74ddd9b640 1 -- 172.21.15.70:0/1342886601 learned_addr learned my addr 172.21.15.70:0/1342886601 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74de59c640 1 --1- 172.21.15.70:0/1342886601 >> v1:172.21.15.70:6790/0 conn(0x7f74e00acd50 0x7f74e00aaad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45832/0 (socket says 172.21.15.70:45832) 2024-05-06T06:51:21.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439732549 0 0) 0x7f74e00ac200 con 0x7f74e00ad130 2024-05-06T06:51:21.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74c0003530 con 0x7f74e00ad130 2024-05-06T06:51:21.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512235003 0 0) 0x7f74e0138130 con 0x7f74e00acd50 2024-05-06T06:51:21.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74e00ac200 con 0x7f74e00acd50 2024-05-06T06:51:21.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 128880702 0 0) 0x7f74c0003530 con 0x7f74e00ad130 2024-05-06T06:51:21.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74e0138130 con 0x7f74e00ad130 2024-05-06T06:51:21.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f74c8001900 con 0x7f74e00ad130 2024-05-06T06:51:21.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2284443324 0 0) 0x7f74e00ac200 con 0x7f74e00acd50 2024-05-06T06:51:21.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74c0003530 con 0x7f74e00acd50 2024-05-06T06:51:21.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.186+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f74d8001bc0 con 0x7f74e00acd50 2024-05-06T06:51:21.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.190+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4033580593 0 0) 0x7f74e0138130 con 0x7f74e00ad130 2024-05-06T06:51:21.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.190+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 >> v1:172.21.15.70:6790/0 conn(0x7f74e00acd50 legacy=0x7f74e00aaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.190+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 >> v1:172.21.15.184:6789/0 conn(0x7f74e00adfe0 legacy=0x7f74e01e3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.190+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e0138300 con 0x7f74e00ad130 2024-05-06T06:51:21.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.190+0000 7f74e49b5640 1 -- 172.21.15.70:0/1342886601 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f74e01d90e0 con 0x7f74e00ad130 2024-05-06T06:51:21.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.190+0000 7f74e49b5640 1 -- 172.21.15.70:0/1342886601 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f74e01e4920 con 0x7f74e00ad130 2024-05-06T06:51:21.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.190+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74c80047f0 con 0x7f74e00ad130 2024-05-06T06:51:21.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.190+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f74c8004b40 con 0x7f74e00ad130 2024-05-06T06:51:21.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.190+0000 7f74e49b5640 1 -- 172.21.15.70:0/1342886601 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c4005090 con 0x7f74e00ad130 2024-05-06T06:51:21.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.190+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 4) ==== 93116+0+0 (unknown 3006460084 0 0) 0x7f74c801b8b0 con 0x7f74e00ad130 2024-05-06T06:51:21.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.190+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (unknown 3045382083 0 0) 0x7f74c808a5d0 con 0x7f74e00ad130 2024-05-06T06:51:21.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.194+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f74c8057b50 con 0x7f74e00ad130 2024-05-06T06:51:21.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.354+0000 7f74e49b5640 1 -- 172.21.15.70:0/1342886601 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74c4005380 con 0x7f74e00ad130 2024-05-06T06:51:21.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.358+0000 7f74d6ffd640 1 -- 172.21.15.70:0/1342886601 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12792 (unknown 3225238715 0 2536402085) 0x7f74c8057450 con 0x7f74e00ad130 2024-05-06T06:51:21.358 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:51:21.358 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"fsid":"90193adb-e1e1-4e06-9c0d-7abb14f25fc6","created":"2024-05-06T06:51:08.019705+0000","modified":"2024-05-06T06:51:20.660418+0000","last_up_change":"2024-05-06T06:51:18.638703+0000","last_in_change":"2024-05-06T06:51:10.302012+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T06:51:18.627852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-06T06:51:19.074040+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2c1f594-6b3c-49a9-b307-6b6284d59048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6804","nonce":3977328488}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6805","nonce":3977328488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6807","nonce":3977328488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6806","nonce":3977328488}]},"public_addr":"172.21.15.70:6804/3977328488","cluster_addr":"172.21.15.70:6805/3977328488","heartbeat_back_addr":"172.21.15.70:6807/3977328488","heartbeat_front_addr":"172.21.15.70:6806/3977328488","state":["exists","up"]},{"osd":1,"uuid":"fc494199-771b-4efe-85cf-edd309f73659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6812","nonce":1567593695}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6813","nonce":1567593695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6815","nonce":1567593695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6814","nonce":1567593695}]},"public_addr":"172.21.15.70:6812/1567593695","cluster_addr":"172.21.15.70:6813/1567593695","heartbeat_back_addr":"172.21.15.70:6815/1567593695","heartbeat_front_addr":"172.21.15.70:6814/1567593695","state":["exists","up"]},{"osd":2,"uuid":"5f691dc1-d6f0-4c85-9544-86c9b7cfa3b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6800","nonce":1610479439}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6801","nonce":1610479439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6803","nonce":1610479439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6802","nonce":1610479439}]},"public_addr":"172.21.15.70:6800/1610479439","cluster_addr":"172.21.15.70:6801/1610479439","heartbeat_back_addr":"172.21.15.70:6803/1610479439","heartbeat_front_addr":"172.21.15.70:6802/1610479439","state":["exists","up"]},{"osd":3,"uuid":"36920237-b28f-4955-ab5a-c6fd2e74e74e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6808","nonce":3320203314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6809","nonce":3320203314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6811","nonce":3320203314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6810","nonce":3320203314}]},"public_addr":"172.21.15.70:6808/3320203314","cluster_addr":"172.21.15.70:6809/3320203314","heartbeat_back_addr":"172.21.15.70:6811/3320203314","heartbeat_front_addr":"172.21.15.70:6810/3320203314","state":["exists","up"]},{"osd":4,"uuid":"00e3095d-4ffd-4184-a8e4-1a14d09e3e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6808","nonce":1828934695}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6809","nonce":1828934695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6811","nonce":1828934695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6810","nonce":1828934695}]},"public_addr":"172.21.15.184:6808/1828934695","cluster_addr":"172.21.15.184:6809/1828934695","heartbeat_back_addr":"172.21.15.184:6811/1828934695","heartbeat_front_addr":"172.21.15.184:6810/1828934695","state":["exists","up"]},{"osd":5,"uuid":"091d4702-30c5-4c63-8529-92059782009a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6800","nonce":1533654869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6801","nonce":1533654869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6803","nonce":1533654869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6802","nonce":1533654869}]},"public_addr":"172.21.15.184:6800/1533654869","cluster_addr":"172.21.15.184:6801/1533654869","heartbeat_back_addr":"172.21.15.184:6803/1533654869","heartbeat_front_addr":"172.21.15.184:6802/1533654869","state":["exists","up"]},{"osd":6,"uuid":"8067e1b6-71d1-4924-881b-4a38fe446858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6804","nonce":3136453628}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6805","nonce":3136453628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6807","nonce":3136453628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6806","nonce":3136453628}]},"public_addr":"172.21.15.184:6804/3136453628","cluster_addr":"172.21.15.184:6805/3136453628","heartbeat_back_addr":"172.21.15.184:6807/3136453628","heartbeat_front_addr":"172.21.15.184:6806/3136453628","state":["exists","up"]},{"osd":7,"uuid":"dae86a11-8868-45b5-927f-f4233d632bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6812","nonce":1421504082}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6813","nonce":1421504082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6815","nonce":1421504082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6814","nonce":1421504082}]},"public_addr":"172.21.15.184:6812/1421504082","cluster_addr":"172.21.15.184:6813/1421504082","heartbeat_back_addr":"172.21.15.184:6815/1421504082","heartbeat_front_addr":"172.21.15.184:6814/1421504082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:16.376779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.832124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.560814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.688562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.803482+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.572410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.703574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.878350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T06:51:21.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.358+0000 7f74e49b5640 1 -- 172.21.15.70:0/1342886601 >> v1:172.21.15.70:6816/2757942729 conn(0x7f74c006ff30 legacy=0x7f74c00723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.358+0000 7f74e49b5640 1 -- 172.21.15.70:0/1342886601 >> v1:172.21.15.70:6789/0 conn(0x7f74e00ad130 legacy=0x7f74e01d89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.358+0000 7f74e49b5640 1 -- 172.21.15.70:0/1342886601 shutdown_connections 2024-05-06T06:51:21.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.358+0000 7f74e49b5640 1 -- 172.21.15.70:0/1342886601 >> 172.21.15.70:0/1342886601 conn(0x7f74e00b49f0 msgr2=0x7f74e00b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.358+0000 7f74e49b5640 1 -- 172.21.15.70:0/1342886601 shutdown_connections 2024-05-06T06:51:21.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.358+0000 7f74e49b5640 1 -- 172.21.15.70:0/1342886601 wait complete. 2024-05-06T06:51:21.376 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-06T06:51:21.377 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-06T06:51:21.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff276b24640 1 Processor -- start 2024-05-06T06:51:21.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff276b24640 1 -- start start 2024-05-06T06:51:21.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff276b24640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2700ab2e0 con 0x7ff2700b5f40 2024-05-06T06:51:21.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff276b24640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2700aa7d0 con 0x7ff2700b5b60 2024-05-06T06:51:21.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff276b24640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2700aa460 con 0x7ff2700b2b00 2024-05-06T06:51:21.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26ffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ff2700b5f40 0x7ff2700aabd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60318/0 (socket says 172.21.15.70:60318) 2024-05-06T06:51:21.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff2750c1640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7ff2700b2b00 0x7ff27014ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45848/0 (socket says 172.21.15.70:45848) 2024-05-06T06:51:21.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26ffff640 1 -- 172.21.15.70:0/3096872700 learned_addr learned my addr 172.21.15.70:0/3096872700 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26f7fe640 1 -- 172.21.15.70:0/3096872700 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 235887007 0 0) 0x7ff2700ab2e0 con 0x7ff2700b5f40 2024-05-06T06:51:21.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26f7fe640 1 -- 172.21.15.70:0/3096872700 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff25c003530 con 0x7ff2700b5f40 2024-05-06T06:51:21.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26f7fe640 1 -- 172.21.15.70:0/3096872700 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273952105 0 0) 0x7ff2700aa460 con 0x7ff2700b2b00 2024-05-06T06:51:21.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26f7fe640 1 -- 172.21.15.70:0/3096872700 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2700ab2e0 con 0x7ff2700b2b00 2024-05-06T06:51:21.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26f7fe640 1 -- 172.21.15.70:0/3096872700 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3072247302 0 0) 0x7ff2700ab2e0 con 0x7ff2700b2b00 2024-05-06T06:51:21.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26f7fe640 1 -- 172.21.15.70:0/3096872700 >> v1:172.21.15.184:6789/0 conn(0x7ff2700b5b60 legacy=0x7ff2700b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26f7fe640 1 -- 172.21.15.70:0/3096872700 >> v1:172.21.15.70:6789/0 conn(0x7ff2700b5f40 legacy=0x7ff2700aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26f7fe640 1 -- 172.21.15.70:0/3096872700 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2701432d0 con 0x7ff2700b2b00 2024-05-06T06:51:21.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26f7fe640 1 -- 172.21.15.70:0/3096872700 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff268001a00 con 0x7ff2700b2b00 2024-05-06T06:51:21.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26f7fe640 1 -- 172.21.15.70:0/3096872700 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff268001ba0 con 0x7ff2700b2b00 2024-05-06T06:51:21.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.498+0000 7ff26f7fe640 1 -- 172.21.15.70:0/3096872700 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff268001fb0 con 0x7ff2700b2b00 2024-05-06T06:51:21.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff276b24640 1 -- 172.21.15.70:0/3096872700 >> v1:172.21.15.70:6790/0 conn(0x7ff2700b2b00 legacy=0x7ff27014ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff276b24640 1 -- 172.21.15.70:0/3096872700 shutdown_connections 2024-05-06T06:51:21.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff276b24640 1 -- 172.21.15.70:0/3096872700 >> 172.21.15.70:0/3096872700 conn(0x7ff270068390 msgr2=0x7ff2700687a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff276b24640 1 -- 172.21.15.70:0/3096872700 shutdown_connections 2024-05-06T06:51:21.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff276b24640 1 -- 172.21.15.70:0/3096872700 wait complete. 2024-05-06T06:51:21.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff276b24640 1 Processor -- start 2024-05-06T06:51:21.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff276b24640 1 -- start start 2024-05-06T06:51:21.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff276b24640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff27013e1a0 con 0x7ff2700b2b00 2024-05-06T06:51:21.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff276b24640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff27013e430 con 0x7ff270136070 2024-05-06T06:51:21.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff276b24640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff27013d720 con 0x7ff2700b5b60 2024-05-06T06:51:21.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff2748c0640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ff2700b2b00 0x7ff27013da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60326/0 (socket says 172.21.15.70:60326) 2024-05-06T06:51:21.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26ffff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7ff2700b5b60 0x7ff270132020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45860/0 (socket says 172.21.15.70:45860) 2024-05-06T06:51:21.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff2748c0640 1 -- 172.21.15.70:0/457926443 learned_addr learned my addr 172.21.15.70:0/457926443 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4250982064 0 0) 0x7ff27013d720 con 0x7ff2700b5b60 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff250003530 con 0x7ff2700b5b60 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1967070918 0 0) 0x7ff27013e1a0 con 0x7ff2700b2b00 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff27013d720 con 0x7ff2700b2b00 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1094276451 0 0) 0x7ff27013d720 con 0x7ff2700b2b00 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff27013e1a0 con 0x7ff2700b2b00 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff260001a00 con 0x7ff2700b2b00 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 286586641 0 0) 0x7ff250003530 con 0x7ff2700b5b60 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff27013d720 con 0x7ff2700b5b60 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff2580010f0 con 0x7ff2700b5b60 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3195351851 0 0) 0x7ff27013e1a0 con 0x7ff2700b2b00 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 >> v1:172.21.15.70:6790/0 conn(0x7ff2700b5b60 legacy=0x7ff270132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 >> v1:172.21.15.184:6789/0 conn(0x7ff270136070 legacy=0x7ff27013fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff270132730 con 0x7ff2700b2b00 2024-05-06T06:51:21.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff276b24640 1 -- 172.21.15.70:0/457926443 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff2701329c0 con 0x7ff2700b2b00 2024-05-06T06:51:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff276b24640 1 -- 172.21.15.70:0/457926443 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff270140650 con 0x7ff2700b2b00 2024-05-06T06:51:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff260001d00 con 0x7ff2700b2b00 2024-05-06T06:51:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.502+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff260003a70 con 0x7ff2700b2b00 2024-05-06T06:51:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.506+0000 7ff276b24640 1 -- 172.21.15.70:0/457926443 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff254005090 con 0x7ff2700b2b00 2024-05-06T06:51:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.506+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 4) ==== 93116+0+0 (unknown 3006460084 0 0) 0x7ff260003c10 con 0x7ff2700b2b00 2024-05-06T06:51:21.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.506+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(17..17 src has 1..17) ==== 4090+0+0 (unknown 3045382083 0 0) 0x7ff26008a520 con 0x7ff2700b2b00 2024-05-06T06:51:21.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.510+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7ff260057ba0 con 0x7ff2700b2b00 2024-05-06T06:51:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.670+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7ff260052d80 con 0x7ff2700b2b00 2024-05-06T06:51:21.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.678+0000 7ff276b24640 1 -- 172.21.15.70:0/457926443 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff254005380 con 0x7ff2700b2b00 2024-05-06T06:51:21.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.682+0000 7ff26d7fa640 1 -- 172.21.15.70:0/457926443 <== mon.0 v1:172.21.15.70:6789/0 11 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12779 (unknown 3338201251 0 3910960933) 0x7ff26003b1f0 con 0x7ff2700b2b00 2024-05-06T06:51:21.684 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:51:21.684 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":18,"fsid":"90193adb-e1e1-4e06-9c0d-7abb14f25fc6","created":"2024-05-06T06:51:08.019705+0000","modified":"2024-05-06T06:51:21.676969+0000","last_up_change":"2024-05-06T06:51:18.638703+0000","last_in_change":"2024-05-06T06:51:10.302012+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T06:51:18.627852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-06T06:51:19.074040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2c1f594-6b3c-49a9-b307-6b6284d59048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6804","nonce":3977328488}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6805","nonce":3977328488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6807","nonce":3977328488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6806","nonce":3977328488}]},"public_addr":"172.21.15.70:6804/3977328488","cluster_addr":"172.21.15.70:6805/3977328488","heartbeat_back_addr":"172.21.15.70:6807/3977328488","heartbeat_front_addr":"172.21.15.70:6806/3977328488","state":["exists","up"]},{"osd":1,"uuid":"fc494199-771b-4efe-85cf-edd309f73659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6812","nonce":1567593695}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6813","nonce":1567593695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6815","nonce":1567593695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6814","nonce":1567593695}]},"public_addr":"172.21.15.70:6812/1567593695","cluster_addr":"172.21.15.70:6813/1567593695","heartbeat_back_addr":"172.21.15.70:6815/1567593695","heartbeat_front_addr":"172.21.15.70:6814/1567593695","state":["exists","up"]},{"osd":2,"uuid":"5f691dc1-d6f0-4c85-9544-86c9b7cfa3b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6800","nonce":1610479439}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6801","nonce":1610479439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6803","nonce":1610479439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6802","nonce":1610479439}]},"public_addr":"172.21.15.70:6800/1610479439","cluster_addr":"172.21.15.70:6801/1610479439","heartbeat_back_addr":"172.21.15.70:6803/1610479439","heartbeat_front_addr":"172.21.15.70:6802/1610479439","state":["exists","up"]},{"osd":3,"uuid":"36920237-b28f-4955-ab5a-c6fd2e74e74e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6808","nonce":3320203314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6809","nonce":3320203314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6811","nonce":3320203314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6810","nonce":3320203314}]},"public_addr":"172.21.15.70:6808/3320203314","cluster_addr":"172.21.15.70:6809/3320203314","heartbeat_back_addr":"172.21.15.70:6811/3320203314","heartbeat_front_addr":"172.21.15.70:6810/3320203314","state":["exists","up"]},{"osd":4,"uuid":"00e3095d-4ffd-4184-a8e4-1a14d09e3e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6808","nonce":1828934695}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6809","nonce":1828934695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6811","nonce":1828934695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6810","nonce":1828934695}]},"public_addr":"172.21.15.184:6808/1828934695","cluster_addr":"172.21.15.184:6809/1828934695","heartbeat_back_addr":"172.21.15.184:6811/1828934695","heartbeat_front_addr":"172.21.15.184:6810/1828934695","state":["exists","up"]},{"osd":5,"uuid":"091d4702-30c5-4c63-8529-92059782009a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6800","nonce":1533654869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6801","nonce":1533654869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6803","nonce":1533654869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6802","nonce":1533654869}]},"public_addr":"172.21.15.184:6800/1533654869","cluster_addr":"172.21.15.184:6801/1533654869","heartbeat_back_addr":"172.21.15.184:6803/1533654869","heartbeat_front_addr":"172.21.15.184:6802/1533654869","state":["exists","up"]},{"osd":6,"uuid":"8067e1b6-71d1-4924-881b-4a38fe446858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6804","nonce":3136453628}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6805","nonce":3136453628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6807","nonce":3136453628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6806","nonce":3136453628}]},"public_addr":"172.21.15.184:6804/3136453628","cluster_addr":"172.21.15.184:6805/3136453628","heartbeat_back_addr":"172.21.15.184:6807/3136453628","heartbeat_front_addr":"172.21.15.184:6806/3136453628","state":["exists","up"]},{"osd":7,"uuid":"dae86a11-8868-45b5-927f-f4233d632bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6812","nonce":1421504082}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6813","nonce":1421504082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6815","nonce":1421504082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6814","nonce":1421504082}]},"public_addr":"172.21.15.184:6812/1421504082","cluster_addr":"172.21.15.184:6813/1421504082","heartbeat_back_addr":"172.21.15.184:6815/1421504082","heartbeat_front_addr":"172.21.15.184:6814/1421504082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:16.376779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.832124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.560814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.688562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.803482+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.572410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.703574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.878350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T06:51:21.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.686+0000 7ff276b24640 1 -- 172.21.15.70:0/457926443 >> v1:172.21.15.70:6816/2757942729 conn(0x7ff25006ff90 legacy=0x7ff250072450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.686+0000 7ff276b24640 1 -- 172.21.15.70:0/457926443 >> v1:172.21.15.70:6789/0 conn(0x7ff2700b2b00 legacy=0x7ff27013da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.686+0000 7ff276b24640 1 -- 172.21.15.70:0/457926443 shutdown_connections 2024-05-06T06:51:21.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.686+0000 7ff276b24640 1 -- 172.21.15.70:0/457926443 >> 172.21.15.70:0/457926443 conn(0x7ff270068390 msgr2=0x7ff2700b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.686+0000 7ff276b24640 1 -- 172.21.15.70:0/457926443 shutdown_connections 2024-05-06T06:51:21.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.686+0000 7ff276b24640 1 -- 172.21.15.70:0/457926443 wait complete. 2024-05-06T06:51:21.703 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-06T06:51:21.703 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-06T06:51:21.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-06T06:51:21.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-06T06:51:21.705 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-06T06:51:21.705 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-06T06:51:21.705 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-06T06:51:21.706 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-06T06:51:21.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.878+0000 7f05128a4640 1 Processor -- start 2024-05-06T06:51:21.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.878+0000 7f05128a4640 1 -- start start 2024-05-06T06:51:21.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.878+0000 7f05128a4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0504035e10 con 0x7f05040c8e40 2024-05-06T06:51:21.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.878+0000 7f05128a4640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05040365c0 con 0x7f05040cf820 2024-05-06T06:51:21.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.878+0000 7f05128a4640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050402c470 con 0x7f05040371b0 2024-05-06T06:51:21.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.878+0000 7f05118a2640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f05040371b0 0x7f0504035700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45874/0 (socket says 172.21.15.70:45874) 2024-05-06T06:51:21.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.878+0000 7f05118a2640 1 -- 172.21.15.70:0/3162339112 learned_addr learned my addr 172.21.15.70:0/3162339112 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 124849412 0 0) 0x7f050402c470 con 0x7f05040371b0 2024-05-06T06:51:21.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5df90640 1 Processor -- start 2024-05-06T06:51:21.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04f8003530 con 0x7f05040371b0 2024-05-06T06:51:21.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610394407 0 0) 0x7f0504035e10 con 0x7f05040c8e40 2024-05-06T06:51:21.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f050402c470 con 0x7f05040c8e40 2024-05-06T06:51:21.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5df90640 1 -- start start 2024-05-06T06:51:21.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1144498966 0 0) 0x7f05040365c0 con 0x7f05040cf820 2024-05-06T06:51:21.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0504035e10 con 0x7f05040cf820 2024-05-06T06:51:21.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2482518155 0 0) 0x7f050402c470 con 0x7f05040c8e40 2024-05-06T06:51:21.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 >> v1:172.21.15.70:6790/0 conn(0x7f05040371b0 legacy=0x7f0504035700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 >> v1:172.21.15.184:6789/0 conn(0x7f05040cf820 legacy=0x7f05040d74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05040c92a0 con 0x7f05040c8e40 2024-05-06T06:51:21.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f0508001680 con 0x7f05040c8e40 2024-05-06T06:51:21.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05080018a0 con 0x7f05040c8e40 2024-05-06T06:51:21.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05108a0640 1 -- 172.21.15.70:0/3162339112 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f05080014e0 con 0x7f05040c8e40 2024-05-06T06:51:21.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8ea12ff640 1 Processor -- start 2024-05-06T06:51:21.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5df90640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a5002c630 con 0x7f3a5002a890 2024-05-06T06:51:21.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5df90640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a500c7640 con 0x7f3a50006420 2024-05-06T06:51:21.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5df90640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a50035490 con 0x7f3a500c11b0 2024-05-06T06:51:21.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5d78f640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f3a500c11b0 0x7f3a500cf860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45886/0 (socket says 172.21.15.70:45886) 2024-05-06T06:51:21.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5cf8e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3a5002a890 0x7f3a500c0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60352/0 (socket says 172.21.15.70:60352) 2024-05-06T06:51:21.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5d78f640 1 -- 172.21.15.70:0/3584253844 learned_addr learned my addr 172.21.15.70:0/3584253844 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05128a4640 1 -- 172.21.15.70:0/3162339112 >> v1:172.21.15.70:6789/0 conn(0x7f05040c8e40 legacy=0x7f05040cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05128a4640 1 -- 172.21.15.70:0/3162339112 shutdown_connections 2024-05-06T06:51:21.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05128a4640 1 -- 172.21.15.70:0/3162339112 >> 172.21.15.70:0/3162339112 conn(0x7f050403a530 msgr2=0x7f05040367f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152221902 0 0) 0x7f3a50035490 con 0x7f3a500c11b0 2024-05-06T06:51:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a48003530 con 0x7f3a500c11b0 2024-05-06T06:51:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1535938647 0 0) 0x7f3a5002c630 con 0x7f3a5002a890 2024-05-06T06:51:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05128a4640 1 -- 172.21.15.70:0/3162339112 shutdown_connections 2024-05-06T06:51:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05128a4640 1 -- 172.21.15.70:0/3162339112 wait complete. 2024-05-06T06:51:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a50035490 con 0x7f3a5002a890 2024-05-06T06:51:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990515851 0 0) 0x7f3a44001120 con 0x7f3a50006420 2024-05-06T06:51:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a5002c630 con 0x7f3a50006420 2024-05-06T06:51:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2450827025 0 0) 0x7f3a48003530 con 0x7f3a500c11b0 2024-05-06T06:51:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 >> v1:172.21.15.184:6789/0 conn(0x7f3a50006420 legacy=0x7f3a500cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 >> v1:172.21.15.70:6789/0 conn(0x7f3a5002a890 legacy=0x7f3a500c0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5002b710 con 0x7f3a500c11b0 2024-05-06T06:51:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f3a4c0016a0 con 0x7f3a500c11b0 2024-05-06T06:51:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8ea12ff640 1 -- start start 2024-05-06T06:51:21.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8ea12ff640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e9c0adab0 con 0x7f8e9c0aae80 2024-05-06T06:51:21.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8ea12ff640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e9c0ad0d0 con 0x7f8e9c0aba80 2024-05-06T06:51:21.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8ea12ff640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e9c0ad3b0 con 0x7f8e9c0abe60 2024-05-06T06:51:21.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8e9b7fe640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f8e9c0abe60 0x7f8e9c14ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45896/0 (socket says 172.21.15.70:45896) 2024-05-06T06:51:21.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8e9b7fe640 1 -- 172.21.15.70:0/2396016309 learned_addr learned my addr 172.21.15.70:0/2396016309 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7fd363fff640 1 Processor -- start 2024-05-06T06:51:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8e99ffb640 1 -- 172.21.15.70:0/2396016309 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385050772 0 0) 0x7f8e9c0ad0d0 con 0x7f8e9c0aba80 2024-05-06T06:51:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8e99ffb640 1 -- 172.21.15.70:0/2396016309 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e84003530 con 0x7f8e9c0aba80 2024-05-06T06:51:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a4c001840 con 0x7f3a500c11b0 2024-05-06T06:51:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a577fe640 1 -- 172.21.15.70:0/3584253844 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f3a4c001c90 con 0x7f3a500c11b0 2024-05-06T06:51:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5df90640 1 -- 172.21.15.70:0/3584253844 >> v1:172.21.15.70:6790/0 conn(0x7f3a500c11b0 legacy=0x7f3a500cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05128a4640 1 Processor -- start 2024-05-06T06:51:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5df90640 1 -- 172.21.15.70:0/3584253844 shutdown_connections 2024-05-06T06:51:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5df90640 1 -- 172.21.15.70:0/3584253844 >> 172.21.15.70:0/3584253844 conn(0x7f3a50005900 msgr2=0x7f3a50005d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5df90640 1 -- 172.21.15.70:0/3584253844 shutdown_connections 2024-05-06T06:51:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8e99ffb640 1 -- 172.21.15.70:0/2396016309 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 377763037 0 0) 0x7f8e84003530 con 0x7f8e9c0aba80 2024-05-06T06:51:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8e99ffb640 1 -- 172.21.15.70:0/2396016309 >> v1:172.21.15.70:6790/0 conn(0x7f8e9c0abe60 legacy=0x7f8e9c14ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8e99ffb640 1 -- 172.21.15.70:0/2396016309 >> v1:172.21.15.70:6789/0 conn(0x7f8e9c0aae80 legacy=0x7f8e9c0adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-06T06:51:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8e99ffb640 1 -- 172.21.15.70:0/2396016309 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e9c13cfc0 con 0x7f8e9c0aba80 2024-05-06T06:51:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f8e99ffb640 1 -- 172.21.15.70:0/2396016309 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f8e94001a20 con 0x7f8e9c0aba80 2024-05-06T06:51:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f8e99ffb640 1 -- 172.21.15.70:0/2396016309 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8e94001c30 con 0x7f8e9c0aba80 2024-05-06T06:51:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f8e99ffb640 1 -- 172.21.15.70:0/2396016309 <== mon.1 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f8e940020c0 con 0x7f8e9c0aba80 2024-05-06T06:51:21.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7fd363fff640 1 -- start start 2024-05-06T06:51:21.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd363fff640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3640ac590 con 0x7fd3640ad680 2024-05-06T06:51:21.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd363fff640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3640ac870 con 0x7fd3640ae840 2024-05-06T06:51:21.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd363fff640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3640acb50 con 0x7fd3640ab170 2024-05-06T06:51:21.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f451e32b640 1 Processor -- start 2024-05-06T06:51:21.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f451e32b640 1 -- start start 2024-05-06T06:51:21.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd362ffd640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fd3640ab170 0x7fd3640af0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45916/0 (socket says 172.21.15.70:45916) 2024-05-06T06:51:21.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd362ffd640 1 -- 172.21.15.70:0/1677674136 learned_addr learned my addr 172.21.15.70:0/1677674136 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f05128a4640 1 -- start start 2024-05-06T06:51:21.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05128a4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050402efd0 con 0x7f05040c8e40 2024-05-06T06:51:21.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05128a4640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050402f2b0 con 0x7f05040cf820 2024-05-06T06:51:21.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05128a4640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050402e010 con 0x7f05040371b0 2024-05-06T06:51:21.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05118a2640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f05040371b0 0x7f050402d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45924/0 (socket says 172.21.15.70:45924) 2024-05-06T06:51:21.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05118a2640 1 -- 172.21.15.70:0/2221015125 learned_addr learned my addr 172.21.15.70:0/2221015125 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f8ea12ff640 1 -- 172.21.15.70:0/2396016309 >> v1:172.21.15.184:6789/0 conn(0x7f8e9c0aba80 legacy=0x7f8e9c13c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f451e32b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45180aeb70 con 0x7f45180af0d0 2024-05-06T06:51:21.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f451e32b640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45180ad980 con 0x7f45180af4b0 2024-05-06T06:51:21.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f451e32b640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45180abd10 con 0x7f4518143430 2024-05-06T06:51:21.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f8ea12ff640 1 -- 172.21.15.70:0/2396016309 shutdown_connections 2024-05-06T06:51:21.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f8ea12ff640 1 -- 172.21.15.70:0/2396016309 >> 172.21.15.70:0/2396016309 conn(0x7f8e9c0b4ad0 msgr2=0x7f8e9c0b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f451d329640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f45180af0d0 0x7f451813d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60374/0 (socket says 172.21.15.70:60374) 2024-05-06T06:51:21.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f8ea12ff640 1 -- 172.21.15.70:0/2396016309 shutdown_connections 2024-05-06T06:51:21.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f451d329640 1 -- 172.21.15.70:0/1774318544 learned_addr learned my addr 172.21.15.70:0/1774318544 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399452790 0 0) 0x7f050402e010 con 0x7f05040371b0 2024-05-06T06:51:21.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd361ffb640 1 -- 172.21.15.70:0/1677674136 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115977140 0 0) 0x7fd3640acb50 con 0x7fd3640ab170 2024-05-06T06:51:21.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd361ffb640 1 -- 172.21.15.70:0/1677674136 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd34c003530 con 0x7fd3640ab170 2024-05-06T06:51:21.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04f0003530 con 0x7f05040371b0 2024-05-06T06:51:21.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1359858963 0 0) 0x7f050402f2b0 con 0x7f05040cf820 2024-05-06T06:51:21.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f050402e010 con 0x7f05040cf820 2024-05-06T06:51:21.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd361ffb640 1 -- 172.21.15.70:0/1677674136 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2366117758 0 0) 0x7fd3640ac870 con 0x7fd3640ae840 2024-05-06T06:51:21.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd361ffb640 1 -- 172.21.15.70:0/1677674136 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3640acb50 con 0x7fd3640ae840 2024-05-06T06:51:21.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd361ffb640 1 -- 172.21.15.70:0/1677674136 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3610776441 0 0) 0x7fd34c003530 con 0x7fd3640ab170 2024-05-06T06:51:21.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd361ffb640 1 -- 172.21.15.70:0/1677674136 >> v1:172.21.15.184:6789/0 conn(0x7fd3640ae840 legacy=0x7fd3640acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd361ffb640 1 -- 172.21.15.70:0/1677674136 >> v1:172.21.15.70:6789/0 conn(0x7fd3640ad680 legacy=0x7fd3640adb30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-06T06:51:21.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd361ffb640 1 -- 172.21.15.70:0/1677674136 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3640af7e0 con 0x7fd3640ab170 2024-05-06T06:51:21.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd361ffb640 1 -- 172.21.15.70:0/1677674136 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd35c001a20 con 0x7fd3640ab170 2024-05-06T06:51:21.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f3a5df90640 1 -- 172.21.15.70:0/3584253844 wait complete. 2024-05-06T06:51:21.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f3a5df90640 1 Processor -- start 2024-05-06T06:51:21.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 929039485 0 0) 0x7f04f0003530 con 0x7f05040371b0 2024-05-06T06:51:21.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f73d6b18640 1 Processor -- start 2024-05-06T06:51:21.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.882+0000 7f73d6b18640 1 -- start start 2024-05-06T06:51:21.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d6b18640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d008ccb0 con 0x7f73d00b0340 2024-05-06T06:51:21.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d6b18640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d006f4e0 con 0x7f73d0153150 2024-05-06T06:51:21.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d6b18640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d00b0ee0 con 0x7f73d01543c0 2024-05-06T06:51:21.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d6317640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f73d0153150 0x7f73d015bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.70:37496/0 (socket says 172.21.15.70:37496) 2024-05-06T06:51:21.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d6317640 1 -- 172.21.15.70:0/595853679 learned_addr learned my addr 172.21.15.70:0/595853679 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d4b14640 1 -- 172.21.15.70:0/595853679 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 110271677 0 0) 0x7f73d006f4e0 con 0x7f73d0153150 2024-05-06T06:51:21.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d4b14640 1 -- 172.21.15.70:0/595853679 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73bc003530 con 0x7f73d0153150 2024-05-06T06:51:21.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f050402f2b0 con 0x7f05040371b0 2024-05-06T06:51:21.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d4b14640 1 -- 172.21.15.70:0/595853679 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 785640394 0 0) 0x7f73bc003530 con 0x7f73d0153150 2024-05-06T06:51:21.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d4b14640 1 -- 172.21.15.70:0/595853679 >> v1:172.21.15.70:6790/0 conn(0x7f73d01543c0 legacy=0x7f73d0152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d4b14640 1 -- 172.21.15.70:0/595853679 >> v1:172.21.15.70:6789/0 conn(0x7f73d00b0340 legacy=0x7f73d0153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-06T06:51:21.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d4b14640 1 -- 172.21.15.70:0/595853679 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d00b0ac0 con 0x7f73d0153150 2024-05-06T06:51:21.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d4b14640 1 -- 172.21.15.70:0/595853679 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f73c8001a20 con 0x7f73d0153150 2024-05-06T06:51:21.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f04fc001890 con 0x7f05040371b0 2024-05-06T06:51:21.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f8ea12ff640 1 -- 172.21.15.70:0/2396016309 wait complete. 2024-05-06T06:51:21.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f8ea12ff640 1 Processor -- start 2024-05-06T06:51:21.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd361ffb640 1 -- 172.21.15.70:0/1677674136 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd35c001bc0 con 0x7fd3640ab170 2024-05-06T06:51:21.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7fd361ffb640 1 -- 172.21.15.70:0/1677674136 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd35c002010 con 0x7fd3640ab170 2024-05-06T06:51:21.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1270048948 0 0) 0x7f050402e010 con 0x7f05040cf820 2024-05-06T06:51:21.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04f0003530 con 0x7f05040cf820 2024-05-06T06:51:21.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f050c076df0 con 0x7f05040cf820 2024-05-06T06:51:21.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318690621 0 0) 0x7f45180aeb70 con 0x7f45180af0d0 2024-05-06T06:51:21.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4504003530 con 0x7f45180af0d0 2024-05-06T06:51:21.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721428470 0 0) 0x7f45180ad980 con 0x7f45180af4b0 2024-05-06T06:51:21.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45180aeb70 con 0x7f45180af4b0 2024-05-06T06:51:21.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3831472967 0 0) 0x7f050402f2b0 con 0x7f05040371b0 2024-05-06T06:51:21.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 >> v1:172.21.15.184:6789/0 conn(0x7f05040cf820 legacy=0x7f0504161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 >> v1:172.21.15.70:6789/0 conn(0x7f05040c8e40 legacy=0x7f05040c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722135833 0 0) 0x7f45180abd10 con 0x7f4518143430 2024-05-06T06:51:21.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45180ad980 con 0x7f4518143430 2024-05-06T06:51:21.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3401112674 0 0) 0x7f45180aeb70 con 0x7f45180af4b0 2024-05-06T06:51:21.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 >> v1:172.21.15.70:6790/0 conn(0x7f4518143430 legacy=0x7f451814b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 >> v1:172.21.15.70:6789/0 conn(0x7f45180af0d0 legacy=0x7f451813d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45180ac9b0 con 0x7f45180af4b0 2024-05-06T06:51:21.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f4508001580 con 0x7f45180af4b0 2024-05-06T06:51:21.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f8ea12ff640 1 -- start start 2024-05-06T06:51:21.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8ea12ff640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e9c1cd940 con 0x7f8e9c0aae80 2024-05-06T06:51:21.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8ea12ff640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e9c1ceb60 con 0x7f8e9c0abe60 2024-05-06T06:51:21.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8ea12ff640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e9c1cde60 con 0x7f8e9c0aba80 2024-05-06T06:51:21.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4508001720 con 0x7f45180af4b0 2024-05-06T06:51:21.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f450ffff640 1 -- 172.21.15.70:0/1774318544 <== mon.1 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f4508001bb0 con 0x7f45180af4b0 2024-05-06T06:51:21.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e9affd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f8e9c0aae80 0x7f8e9c1cca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60400/0 (socket says 172.21.15.70:60400) 2024-05-06T06:51:21.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e9affd640 1 -- 172.21.15.70:0/3940290507 learned_addr learned my addr 172.21.15.70:0/3940290507 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f3a5df90640 1 -- start start 2024-05-06T06:51:21.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7fd363fff640 1 -- 172.21.15.70:0/1677674136 >> v1:172.21.15.70:6790/0 conn(0x7fd3640ab170 legacy=0x7fd3640af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d4b14640 1 -- 172.21.15.70:0/595853679 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f73c8001c30 con 0x7f73d0153150 2024-05-06T06:51:21.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.886+0000 7f73d4b14640 1 -- 172.21.15.70:0/595853679 <== mon.1 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f73c80020c0 con 0x7f73d0153150 2024-05-06T06:51:21.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f73d6b18640 1 -- 172.21.15.70:0/595853679 >> v1:172.21.15.184:6789/0 conn(0x7f73d0153150 legacy=0x7f73d015bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556973722 0 0) 0x7f8e9c1cd940 con 0x7f8e9c0aae80 2024-05-06T06:51:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e88003530 con 0x7f8e9c0aae80 2024-05-06T06:51:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 254744206 0 0) 0x7f8e9c1cde60 con 0x7f8e9c0aba80 2024-05-06T06:51:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e9c1cd940 con 0x7f8e9c0aba80 2024-05-06T06:51:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f3a5df90640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a500ca200 con 0x7f3a5002a890 2024-05-06T06:51:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f3a5df90640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a500ca4e0 con 0x7f3a500c11b0 2024-05-06T06:51:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f3a5df90640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a5002ee30 con 0x7f3a50006420 2024-05-06T06:51:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2774086199 0 0) 0x7f8e88003530 con 0x7f8e9c0aae80 2024-05-06T06:51:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8e9c1cde60 con 0x7f8e9c0aae80 2024-05-06T06:51:21.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050402e1e0 con 0x7f05040371b0 2024-05-06T06:51:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f8e940019a0 con 0x7f8e9c0aae80 2024-05-06T06:51:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f3a57fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f3a5002a890 0x7f3a500c87f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60410/0 (socket says 172.21.15.70:60410) 2024-05-06T06:51:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f3a57fff640 1 -- 172.21.15.70:0/1292753106 learned_addr learned my addr 172.21.15.70:0/1292753106 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f05128a4640 1 -- 172.21.15.70:0/2221015125 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f05040c2e10 con 0x7f05040371b0 2024-05-06T06:51:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f05128a4640 1 -- 172.21.15.70:0/2221015125 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0504161c40 con 0x7f05040371b0 2024-05-06T06:51:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1360035391 0 0) 0x7f8e9c1cde60 con 0x7f8e9c0aae80 2024-05-06T06:51:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 >> v1:172.21.15.70:6790/0 conn(0x7f8e9c0aba80 legacy=0x7f8e9c13e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 >> v1:172.21.15.184:6789/0 conn(0x7f8e9c0abe60 legacy=0x7f8e9c1efd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e9c13f050 con 0x7f8e9c0aae80 2024-05-06T06:51:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8ea12ff640 1 -- 172.21.15.70:0/3940290507 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8e9c1cd320 con 0x7f8e9c0aae80 2024-05-06T06:51:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8ea12ff640 1 -- 172.21.15.70:0/3940290507 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8e9c1f1450 con 0x7f8e9c0aae80 2024-05-06T06:51:21.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7fd363fff640 1 -- 172.21.15.70:0/1677674136 shutdown_connections 2024-05-06T06:51:21.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7fd363fff640 1 -- 172.21.15.70:0/1677674136 >> 172.21.15.70:0/1677674136 conn(0x7fd3640b46d0 msgr2=0x7fd3640b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f451e32b640 1 -- 172.21.15.70:0/1774318544 >> v1:172.21.15.184:6789/0 conn(0x7f45180af4b0 legacy=0x7f45180ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f451e32b640 1 -- 172.21.15.70:0/1774318544 shutdown_connections 2024-05-06T06:51:21.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f451e32b640 1 -- 172.21.15.70:0/1774318544 >> 172.21.15.70:0/1774318544 conn(0x7f45180b46d0 msgr2=0x7f45180b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7fd363fff640 1 -- 172.21.15.70:0/1677674136 shutdown_connections 2024-05-06T06:51:21.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8e94001c30 con 0x7f8e9c0aae80 2024-05-06T06:51:21.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f8e94003ef0 con 0x7f8e9c0aae80 2024-05-06T06:51:21.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4268687339 0 0) 0x7f3a500ca200 con 0x7f3a5002a890 2024-05-06T06:51:21.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a3c003530 con 0x7f3a5002a890 2024-05-06T06:51:21.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250124951 0 0) 0x7f3a500ca4e0 con 0x7f3a500c11b0 2024-05-06T06:51:21.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a500ca200 con 0x7f3a500c11b0 2024-05-06T06:51:21.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1094589690 0 0) 0x7f3a500ca200 con 0x7f3a500c11b0 2024-05-06T06:51:21.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a500ca4e0 con 0x7f3a500c11b0 2024-05-06T06:51:21.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f3a4c001b90 con 0x7f3a500c11b0 2024-05-06T06:51:21.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7fd363fff640 1 -- 172.21.15.70:0/1677674136 wait complete. 2024-05-06T06:51:21.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f451e32b640 1 -- 172.21.15.70:0/1774318544 shutdown_connections 2024-05-06T06:51:21.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f73d6b18640 1 -- 172.21.15.70:0/595853679 shutdown_connections 2024-05-06T06:51:21.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f73d6b18640 1 -- 172.21.15.70:0/595853679 >> 172.21.15.70:0/595853679 conn(0x7f73d00b11d0 msgr2=0x7f73d00b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f73d6b18640 1 -- 172.21.15.70:0/595853679 shutdown_connections 2024-05-06T06:51:21.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f73d6b18640 1 -- 172.21.15.70:0/595853679 wait complete. 2024-05-06T06:51:21.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f73d6b18640 1 Processor -- start 2024-05-06T06:51:21.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04fc0047f0 con 0x7f05040371b0 2024-05-06T06:51:21.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f04fc004c00 con 0x7f05040371b0 2024-05-06T06:51:21.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f04fc004e60 con 0x7f05040371b0 2024-05-06T06:51:21.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 <== mon.1 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1581349220 0 0) 0x7f3a500ca4e0 con 0x7f3a500c11b0 2024-05-06T06:51:21.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 >> v1:172.21.15.70:6790/0 conn(0x7f3a50006420 legacy=0x7f3a50169fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 >> v1:172.21.15.70:6789/0 conn(0x7f3a5002a890 legacy=0x7f3a500c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5016a6e0 con 0x7f3a500c11b0 2024-05-06T06:51:21.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda8c99640 1 Processor -- start 2024-05-06T06:51:21.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f8e94004090 con 0x7f8e9c0aae80 2024-05-06T06:51:21.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f8e9408a9f0 con 0x7f8e9c0aae80 2024-05-06T06:51:21.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f05128a4640 1 -- 172.21.15.70:0/2221015125 --> v1:172.21.15.70:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f04f4000f90 con 0x7f05040371b0 2024-05-06T06:51:21.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f04fc08a780 con 0x7f05040371b0 2024-05-06T06:51:21.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 --> v1:172.21.15.184:6800/1533654869 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f050c076df0 con 0x7f04f0077060 2024-05-06T06:51:21.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd363fff640 1 Processor -- start 2024-05-06T06:51:21.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd363fff640 1 -- start start 2024-05-06T06:51:21.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda8c99640 1 -- start start 2024-05-06T06:51:21.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda8c99640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda40b0d10 con 0x7fdda4148300 2024-05-06T06:51:21.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda8c99640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda40b0ee0 con 0x7fdda40ad560 2024-05-06T06:51:21.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda8c99640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda4144ec0 con 0x7fdda40aa6c0 2024-05-06T06:51:21.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.890+0000 7f451e32b640 1 -- 172.21.15.70:0/1774318544 wait complete. 2024-05-06T06:51:21.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f451e32b640 1 Processor -- start 2024-05-06T06:51:21.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f73d6b18640 1 -- start start 2024-05-06T06:51:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 <== mon.1 v1:172.21.15.184:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a4c001090 con 0x7f3a500c11b0 2024-05-06T06:51:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 <== mon.1 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f3a4c004c40 con 0x7f3a500c11b0 2024-05-06T06:51:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd363fff640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd364148250 con 0x7fd3640ab170 2024-05-06T06:51:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd363fff640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3641484c0 con 0x7fd3640ad680 2024-05-06T06:51:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd363fff640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd364072720 con 0x7fd3640ae840 2024-05-06T06:51:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd362ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd3640ab170 0x7fd364141280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60416/0 (socket says 172.21.15.70:60416) 2024-05-06T06:51:21.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd362ffd640 1 -- 172.21.15.70:0/3777199217 learned_addr learned my addr 172.21.15.70:0/3777199217 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda37fe640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fdda40aa6c0 0x7fdda4147bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45958/0 (socket says 172.21.15.70:45958) 2024-05-06T06:51:21.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda37fe640 1 -- 172.21.15.70:0/1462240139 learned_addr learned my addr 172.21.15.70:0/1462240139 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda27fc640 1 -- 172.21.15.70:0/1462240139 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961523979 0 0) 0x7fdda4144ec0 con 0x7fdda40aa6c0 2024-05-06T06:51:21.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda27fc640 1 -- 172.21.15.70:0/1462240139 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd8c003530 con 0x7fdda40aa6c0 2024-05-06T06:51:21.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f04fc053310 con 0x7f05040371b0 2024-05-06T06:51:21.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3871935494 0 0) 0x7fd364148250 con 0x7fd3640ab170 2024-05-06T06:51:21.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd350003530 con 0x7fd3640ab170 2024-05-06T06:51:21.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 246874400 0 0) 0x7fd364072720 con 0x7fd3640ae840 2024-05-06T06:51:21.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd364148250 con 0x7fd3640ae840 2024-05-06T06:51:21.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517637048 0 0) 0x7fd3640acb50 con 0x7fd3640ad680 2024-05-06T06:51:21.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd364072720 con 0x7fd3640ad680 2024-05-06T06:51:21.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2422288356 0 0) 0x7fd350003530 con 0x7fd3640ab170 2024-05-06T06:51:21.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f3a5df90640 1 -- 172.21.15.70:0/1292753106 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5016a9d0 con 0x7f3a500c11b0 2024-05-06T06:51:21.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f3a5df90640 1 -- 172.21.15.70:0/1292753106 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3a500c90d0 con 0x7f3a500c11b0 2024-05-06T06:51:21.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd3640acb50 con 0x7fd3640ab170 2024-05-06T06:51:21.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd35c001f10 con 0x7fd3640ab170 2024-05-06T06:51:21.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f73d6b18640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d00acf20 con 0x7f73d0153150 2024-05-06T06:51:21.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f73d6b18640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d00ad200 con 0x7f73d00b0340 2024-05-06T06:51:21.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f73d6b18640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73d00ad4e0 con 0x7f73d01543c0 2024-05-06T06:51:21.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f3a5df90640 1 -- 172.21.15.70:0/1292753106 --> v1:172.21.15.184:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3a50004ce0 con 0x7f3a500c11b0 2024-05-06T06:51:21.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f73d5315640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f73d0153150 0x7f73d01f5ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60434/0 (socket says 172.21.15.70:60434) 2024-05-06T06:51:21.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f73d5315640 1 -- 172.21.15.70:0/3271511804 learned_addr learned my addr 172.21.15.70:0/3271511804 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f8ea12ff640 1 -- 172.21.15.70:0/3940290507 --> v1:172.21.15.184:6804/3136453628 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e7c0053b0 con 0x7f8e7c001640 2024-05-06T06:51:21.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1210822562 0 0) 0x7fd364072720 con 0x7fd3640ad680 2024-05-06T06:51:21.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd350003530 con 0x7fd3640ad680 2024-05-06T06:51:21.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd3540018e0 con 0x7fd3640ad680 2024-05-06T06:51:21.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda27fc640 1 -- 172.21.15.70:0/1462240139 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4014635639 0 0) 0x7fdda40b0d10 con 0x7fdda4148300 2024-05-06T06:51:21.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda27fc640 1 -- 172.21.15.70:0/1462240139 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdda4144ec0 con 0x7fdda4148300 2024-05-06T06:51:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda27fc640 1 -- 172.21.15.70:0/1462240139 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3883487556 0 0) 0x7fdd8c003530 con 0x7fdda40aa6c0 2024-05-06T06:51:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda27fc640 1 -- 172.21.15.70:0/1462240139 >> v1:172.21.15.184:6789/0 conn(0x7fdda40ad560 legacy=0x7fdda4152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda27fc640 1 -- 172.21.15.70:0/1462240139 >> v1:172.21.15.70:6789/0 conn(0x7fdda4148300 legacy=0x7fdda41447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda27fc640 1 -- 172.21.15.70:0/1462240139 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda4145090 con 0x7fdda40aa6c0 2024-05-06T06:51:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda27fc640 1 -- 172.21.15.70:0/1462240139 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdd9c001a20 con 0x7fdda40aa6c0 2024-05-06T06:51:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 669174268 0 0) 0x7fd3640acb50 con 0x7fd3640ab170 2024-05-06T06:51:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 >> v1:172.21.15.70:6790/0 conn(0x7fd3640ae840 legacy=0x7fd3641e7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 >> v1:172.21.15.184:6789/0 conn(0x7fd3640ad680 legacy=0x7fd364141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd364147580 con 0x7fd3640ab170 2024-05-06T06:51:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd363fff640 1 -- 172.21.15.70:0/3777199217 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd3641e08d0 con 0x7fd3640ab170 2024-05-06T06:51:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fd363fff640 1 -- 172.21.15.70:0/3777199217 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd3641e92d0 con 0x7fd3640ab170 2024-05-06T06:51:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fd363fff640 1 -- 172.21.15.70:0/3777199217 --> v1:172.21.15.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd3641e1560 con 0x7fd3640ab170 2024-05-06T06:51:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd3641e1560 con 0x7fd3640ab170 2024-05-06T06:51:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd35c004f80 con 0x7fd3640ab170 2024-05-06T06:51:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f451e32b640 1 -- start start 2024-05-06T06:51:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f451cb28640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f4518143430 0x7f45181e1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.70:37556/0 (socket says 172.21.15.70:37556) 2024-05-06T06:51:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f451db2a640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f451813dcf0 0x7f4518071b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:45988/0 (socket says 172.21.15.70:45988) 2024-05-06T06:51:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f451cb28640 1 -- 172.21.15.70:0/811234955 learned_addr learned my addr 172.21.15.70:0/811234955 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681041009 0 0) 0x7f73d00ad4e0 con 0x7f73d01543c0 2024-05-06T06:51:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73b4003530 con 0x7f73d01543c0 2024-05-06T06:51:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4139157712 0 0) 0x7f73b4003530 con 0x7f73d01543c0 2024-05-06T06:51:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73d00ad4e0 con 0x7f73d01543c0 2024-05-06T06:51:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f73c8001740 con 0x7f73d01543c0 2024-05-06T06:51:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3915666105 0 0) 0x7f73d00ad4e0 con 0x7f73d01543c0 2024-05-06T06:51:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 >> v1:172.21.15.184:6789/0 conn(0x7f73d00b0340 legacy=0x7f73d00abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 >> v1:172.21.15.70:6789/0 conn(0x7f73d0153150 legacy=0x7f73d01f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d00ad7c0 con 0x7f73d01543c0 2024-05-06T06:51:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda27fc640 1 -- 172.21.15.70:0/1462240139 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd9c001bc0 con 0x7fdda40aa6c0 2024-05-06T06:51:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7fdda27fc640 1 -- 172.21.15.70:0/1462240139 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdd9c002050 con 0x7fdda40aa6c0 2024-05-06T06:51:21.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fdda8c99640 1 -- 172.21.15.70:0/1462240139 >> v1:172.21.15.70:6790/0 conn(0x7fdda40aa6c0 legacy=0x7fdda4147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.894+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== osd.5 v1:172.21.15.184:6800/1533654869 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f050c076df0 con 0x7f04f0077060 2024-05-06T06:51:21.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f451813fb50 con 0x7f45180af0d0 2024-05-06T06:51:21.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4518071650 con 0x7f4518143430 2024-05-06T06:51:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fd35c01bb80 con 0x7fd3640ab170 2024-05-06T06:51:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f451813f7e0 con 0x7f451813dcf0 2024-05-06T06:51:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797204502 0 0) 0x7f451813f7e0 con 0x7f451813dcf0 2024-05-06T06:51:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44fc003530 con 0x7f451813dcf0 2024-05-06T06:51:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60362511 0 0) 0x7f4518071650 con 0x7f4518143430 2024-05-06T06:51:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f451813f7e0 con 0x7f4518143430 2024-05-06T06:51:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2485293042 0 0) 0x7f44fc003530 con 0x7f451813dcf0 2024-05-06T06:51:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4518071650 con 0x7f451813dcf0 2024-05-06T06:51:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f4514001ad0 con 0x7f451813dcf0 2024-05-06T06:51:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3262755291 0 0) 0x7f4518071650 con 0x7f451813dcf0 2024-05-06T06:51:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 >> v1:172.21.15.184:6789/0 conn(0x7f4518143430 legacy=0x7f45181e1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 >> v1:172.21.15.70:6789/0 conn(0x7f45180af0d0 legacy=0x7f451813f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45181e2600 con 0x7f451813dcf0 2024-05-06T06:51:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f45181e2890 con 0x7f451813dcf0 2024-05-06T06:51:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4518072450 con 0x7f451813dcf0 2024-05-06T06:51:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f73d6b18640 1 -- 172.21.15.70:0/3271511804 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f73d00ae490 con 0x7f73d01543c0 2024-05-06T06:51:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f73d6b18640 1 -- 172.21.15.70:0/3271511804 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f73d00ac4f0 con 0x7f73d01543c0 2024-05-06T06:51:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fdda8c99640 1 -- 172.21.15.70:0/1462240139 shutdown_connections 2024-05-06T06:51:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fdda8c99640 1 -- 172.21.15.70:0/1462240139 >> 172.21.15.70:0/1462240139 conn(0x7fdda40b47a0 msgr2=0x7fdda40b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fdda8c99640 1 -- 172.21.15.70:0/1462240139 shutdown_connections 2024-05-06T06:51:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 <== osd.6 v1:172.21.15.184:6804/3136453628 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f8e7c0053b0 con 0x7f8e7c001640 2024-05-06T06:51:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fdda8c99640 1 -- 172.21.15.70:0/1462240139 wait complete. 2024-05-06T06:51:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fdda8c99640 1 Processor -- start 2024-05-06T06:51:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7fd35c053930 con 0x7fd3640ab170 2024-05-06T06:51:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 --> v1:172.21.15.70:6812/1567593695 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd35007aba0 con 0x7fd350076f30 2024-05-06T06:51:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7fd35c053200 con 0x7fd3640ab170 2024-05-06T06:51:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7f73d6b18640 1 -- 172.21.15.70:0/3271511804 --> v1:172.21.15.70:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f73d00640c0 con 0x7f73d01543c0 2024-05-06T06:51:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fdda8c99640 1 -- start start 2024-05-06T06:51:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fdda8c99640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda40731c0 con 0x7fdda40ad560 2024-05-06T06:51:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fdda8c99640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda41e2d50 con 0x7fdda4148300 2024-05-06T06:51:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fdda8c99640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda40720b0 con 0x7fdda40aa6c0 2024-05-06T06:51:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fdda2ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fdda40ad560 0x7fdda41e1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60448/0 (socket says 172.21.15.70:60448) 2024-05-06T06:51:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.898+0000 7fdda2ffd640 1 -- 172.21.15.70:0/1765174093 learned_addr learned my addr 172.21.15.70:0/1765174093 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.902+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f73c80018e0 con 0x7f73d01543c0 2024-05-06T06:51:21.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.902+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== osd.1 v1:172.21.15.70:6812/1567593695 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fd35007aba0 con 0x7fd350076f30 2024-05-06T06:51:21.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.902+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4514002000 con 0x7f451813dcf0 2024-05-06T06:51:21.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.902+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f4514003b40 con 0x7f451813dcf0 2024-05-06T06:51:21.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.902+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f4514003da0 con 0x7f451813dcf0 2024-05-06T06:51:21.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.902+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f451408a8c0 con 0x7f451813dcf0 2024-05-06T06:51:21.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.902+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f73c80051a0 con 0x7f73d01543c0 2024-05-06T06:51:21.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.902+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f73c801bf40 con 0x7f73d01543c0 2024-05-06T06:51:21.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.902+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906464226 0 0) 0x7fdda40731c0 con 0x7fdda40ad560 2024-05-06T06:51:21.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.902+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f73c808a9d0 con 0x7f73d01543c0 2024-05-06T06:51:21.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.902+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 --> v1:172.21.15.70:6808/3320203314 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73b407aec0 con 0x7f73b40772f0 2024-05-06T06:51:21.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.902+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f73c808ad80 con 0x7f73d01543c0 2024-05-06T06:51:21.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd90003530 con 0x7fdda40ad560 2024-05-06T06:51:21.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3403116129 0 0) 0x7fdda41e2d50 con 0x7fdda4148300 2024-05-06T06:51:21.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdda40731c0 con 0x7fdda4148300 2024-05-06T06:51:21.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255166053 0 0) 0x7fdda40720b0 con 0x7fdda40aa6c0 2024-05-06T06:51:21.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdda41e2d50 con 0x7fdda40aa6c0 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 418237862 0 0) 0x7fdd90003530 con 0x7fdda40ad560 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdda40720b0 con 0x7fdda40ad560 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdd94001aa0 con 0x7fdda40ad560 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 804307231 0 0) 0x7fdda40731c0 con 0x7fdda4148300 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd90003530 con 0x7fdda4148300 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdd98001840 con 0x7fdda4148300 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3343695330 0 0) 0x7fdda40720b0 con 0x7fdda40ad560 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 >> v1:172.21.15.70:6790/0 conn(0x7fdda40aa6c0 legacy=0x7fdda4073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 >> v1:172.21.15.184:6789/0 conn(0x7fdda4148300 legacy=0x7fdda41e2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda4071620 con 0x7fdda40ad560 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdda8c99640 1 -- 172.21.15.70:0/1765174093 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdda4071910 con 0x7fdda40ad560 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7fdda8c99640 1 -- 172.21.15.70:0/1765174093 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdda4070d10 con 0x7fdda40ad560 2024-05-06T06:51:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 <== mon.1 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f3a4c01b9e0 con 0x7f3a500c11b0 2024-05-06T06:51:21.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 <== mon.1 v1:172.21.15.184:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f3a4c08a300 con 0x7f3a500c11b0 2024-05-06T06:51:21.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 --> v1:172.21.15.70:6804/3977328488 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a3c07adc0 con 0x7f3a3c077150 2024-05-06T06:51:21.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 <== mon.1 v1:172.21.15.184:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f3a4c08a6e0 con 0x7f3a500c11b0 2024-05-06T06:51:21.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 --> v1:172.21.15.70:6800/1610479439 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44f80053b0 con 0x7f44f8001640 2024-05-06T06:51:21.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.906+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 <== osd.2 v1:172.21.15.70:6800/1610479439 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f44f80053b0 con 0x7f44f8001640 2024-05-06T06:51:21.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.910+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 <== osd.3 v1:172.21.15.70:6808/3320203314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f73b407aec0 con 0x7f73b40772f0 2024-05-06T06:51:21.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.910+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 <== osd.0 v1:172.21.15.70:6804/3977328488 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f3a3c07adc0 con 0x7f3a3c077150 2024-05-06T06:51:21.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.914+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd94001d20 con 0x7fdda40ad560 2024-05-06T06:51:21.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.914+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdd94003a70 con 0x7fdda40ad560 2024-05-06T06:51:21.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.914+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fdd94003cd0 con 0x7fdda40ad560 2024-05-06T06:51:21.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.914+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7fdd9408a810 con 0x7fdda40ad560 2024-05-06T06:51:21.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.914+0000 7fdda8c99640 1 -- 172.21.15.70:0/1765174093 --> v1:172.21.15.184:6808/1828934695 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd840053b0 con 0x7fdd84001640 2024-05-06T06:51:21.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.918+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== osd.4 v1:172.21.15.184:6808/1828934695 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fdd840053b0 con 0x7fdd84001640 2024-05-06T06:51:21.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.922+0000 7f73d6b18640 1 -- 172.21.15.70:0/3271511804 --> v1:172.21.15.70:6808/3320203314 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f73d00640c0 con 0x7f73b40772f0 2024-05-06T06:51:21.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.922+0000 7f73c67fc640 1 -- 172.21.15.70:0/3271511804 <== osd.3 v1:172.21.15.70:6808/3320203314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3423592458) 0x7f73d00640c0 con 0x7f73b40772f0 2024-05-06T06:51:21.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.922+0000 7f73d6b18640 1 -- 172.21.15.70:0/3271511804 >> v1:172.21.15.70:6808/3320203314 conn(0x7f73b40772f0 legacy=0x7f73b4079710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.922+0000 7f73d6b18640 1 -- 172.21.15.70:0/3271511804 >> v1:172.21.15.70:6816/2757942729 conn(0x7f73b40701d0 legacy=0x7f73b4072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.922+0000 7f73d6b18640 1 -- 172.21.15.70:0/3271511804 >> v1:172.21.15.70:6790/0 conn(0x7f73d01543c0 legacy=0x7f73d01f65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.922+0000 7f73d6317640 1 -- 172.21.15.70:0/3271511804 reap_dead start 2024-05-06T06:51:21.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.922+0000 7f73d6b18640 1 -- 172.21.15.70:0/3271511804 shutdown_connections 2024-05-06T06:51:21.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.922+0000 7f73d6b18640 1 -- 172.21.15.70:0/3271511804 >> 172.21.15.70:0/3271511804 conn(0x7f73d00b11d0 msgr2=0x7f73d0153cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.922+0000 7f73d6b18640 1 -- 172.21.15.70:0/3271511804 shutdown_connections 2024-05-06T06:51:21.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.922+0000 7f73d6b18640 1 -- 172.21.15.70:0/3271511804 wait complete. 2024-05-06T06:51:21.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe59e3b640 1 Processor -- start 2024-05-06T06:51:21.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe59e3b640 1 -- start start 2024-05-06T06:51:21.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7f05128a4640 1 -- 172.21.15.70:0/2221015125 --> v1:172.21.15.184:6800/1533654869 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f04f4002c80 con 0x7f04f0077060 2024-05-06T06:51:21.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fd363fff640 1 -- 172.21.15.70:0/3777199217 --> v1:172.21.15.70:6812/1567593695 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd36406b800 con 0x7fd350076f30 2024-05-06T06:51:21.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe59e3b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe54072d20 con 0x7fbe54144110 2024-05-06T06:51:21.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe59e3b640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe54073000 con 0x7fbe54070d30 2024-05-06T06:51:21.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe59e3b640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe540732e0 con 0x7fbe54071fa0 2024-05-06T06:51:21.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe53fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fbe54144110 0x7fbe5414b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60464/0 (socket says 172.21.15.70:60464) 2024-05-06T06:51:21.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe53fff640 1 -- 172.21.15.70:0/4246312955 learned_addr learned my addr 172.21.15.70:0/4246312955 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7f05027fc640 1 -- 172.21.15.70:0/2221015125 <== osd.5 v1:172.21.15.184:6800/1533654869 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3423592458) 0x7f04f4002c80 con 0x7f04f0077060 2024-05-06T06:51:21.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fd34bfff640 1 -- 172.21.15.70:0/3777199217 <== osd.1 v1:172.21.15.70:6812/1567593695 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1046766345) 0x7fd36406b800 con 0x7fd350076f30 2024-05-06T06:51:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe527fc640 1 -- 172.21.15.70:0/4246312955 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997846784 0 0) 0x7fbe54072d20 con 0x7fbe54144110 2024-05-06T06:51:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe527fc640 1 -- 172.21.15.70:0/4246312955 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe3c003530 con 0x7fbe54144110 2024-05-06T06:51:21.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe527fc640 1 -- 172.21.15.70:0/4246312955 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1293231313 0 0) 0x7fbe3c003530 con 0x7fbe54144110 2024-05-06T06:51:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe527fc640 1 -- 172.21.15.70:0/4246312955 >> v1:172.21.15.70:6790/0 conn(0x7fbe54071fa0 legacy=0x7fbe54073ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe527fc640 1 -- 172.21.15.70:0/4246312955 >> v1:172.21.15.184:6789/0 conn(0x7fbe54070d30 legacy=0x7fbe54143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-06T06:51:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe527fc640 1 -- 172.21.15.70:0/4246312955 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe54143480 con 0x7fbe54144110 2024-05-06T06:51:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.926+0000 7fbe527fc640 1 -- 172.21.15.70:0/4246312955 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbe4c001a20 con 0x7fbe54144110 2024-05-06T06:51:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fbe527fc640 1 -- 172.21.15.70:0/4246312955 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe4c001bc0 con 0x7fbe54144110 2024-05-06T06:51:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fbe527fc640 1 -- 172.21.15.70:0/4246312955 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbe4c002050 con 0x7fbe54144110 2024-05-06T06:51:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fbe59e3b640 1 -- 172.21.15.70:0/4246312955 >> v1:172.21.15.70:6789/0 conn(0x7fbe54144110 legacy=0x7fbe5414b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fbe59e3b640 1 -- 172.21.15.70:0/4246312955 shutdown_connections 2024-05-06T06:51:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fbe59e3b640 1 -- 172.21.15.70:0/4246312955 >> 172.21.15.70:0/4246312955 conn(0x7fbe540b5a70 msgr2=0x7fbe540b5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f8ea12ff640 1 -- 172.21.15.70:0/3940290507 --> v1:172.21.15.184:6804/3136453628 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8e7c007040 con 0x7f8e7c001640 2024-05-06T06:51:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fbe59e3b640 1 -- 172.21.15.70:0/4246312955 shutdown_connections 2024-05-06T06:51:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fd349ffb640 1 -- 172.21.15.70:0/3777199217 >> v1:172.21.15.70:6812/1567593695 conn(0x7fd350076f30 legacy=0x7fd350079350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fbe59e3b640 1 -- 172.21.15.70:0/4246312955 wait complete. 2024-05-06T06:51:21.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fd349ffb640 1 -- 172.21.15.70:0/3777199217 >> v1:172.21.15.70:6816/2757942729 conn(0x7fd35006fea0 legacy=0x7fd350072360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fd349ffb640 1 -- 172.21.15.70:0/3777199217 >> v1:172.21.15.70:6789/0 conn(0x7fd3640ab170 legacy=0x7fd364141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fd3637fe640 1 -- 172.21.15.70:0/3777199217 reap_dead start 2024-05-06T06:51:21.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fd349ffb640 1 -- 172.21.15.70:0/3777199217 shutdown_connections 2024-05-06T06:51:21.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fd349ffb640 1 -- 172.21.15.70:0/3777199217 >> 172.21.15.70:0/3777199217 conn(0x7fd3640b46d0 msgr2=0x7fd3640ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fd349ffb640 1 -- 172.21.15.70:0/3777199217 shutdown_connections 2024-05-06T06:51:21.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f8e837fe640 1 -- 172.21.15.70:0/3940290507 <== osd.6 v1:172.21.15.184:6804/3136453628 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1046766345) 0x7f8e7c007040 con 0x7f8e7c001640 2024-05-06T06:51:21.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fd349ffb640 1 -- 172.21.15.70:0/3777199217 wait complete. 2024-05-06T06:51:21.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f8ea12ff640 1 -- 172.21.15.70:0/3940290507 >> v1:172.21.15.184:6804/3136453628 conn(0x7f8e7c001640 legacy=0x7f8e7c003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fbe59e3b640 1 Processor -- start 2024-05-06T06:51:21.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f05128a4640 1 -- 172.21.15.70:0/2221015125 >> v1:172.21.15.184:6800/1533654869 conn(0x7f04f0077060 legacy=0x7f04f0079480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f8ea12ff640 1 -- 172.21.15.70:0/3940290507 >> v1:172.21.15.70:6816/2757942729 conn(0x7f8e88070080 legacy=0x7f8e88072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f8ea12ff640 1 -- 172.21.15.70:0/3940290507 >> v1:172.21.15.70:6789/0 conn(0x7f8e9c0aae80 legacy=0x7f8e9c1cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f8e9b7fe640 1 -- 172.21.15.70:0/3940290507 reap_dead start 2024-05-06T06:51:21.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f8ea12ff640 1 -- 172.21.15.70:0/3940290507 shutdown_connections 2024-05-06T06:51:21.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f8ea12ff640 1 -- 172.21.15.70:0/3940290507 >> 172.21.15.70:0/3940290507 conn(0x7f8e9c0b4ad0 msgr2=0x7f8e9c0b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fbe59e3b640 1 -- start start 2024-05-06T06:51:21.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f8ea12ff640 1 -- 172.21.15.70:0/3940290507 shutdown_connections 2024-05-06T06:51:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f05128a4640 1 -- 172.21.15.70:0/2221015125 >> v1:172.21.15.70:6816/2757942729 conn(0x7f04f006ffd0 legacy=0x7f04f0072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f05128a4640 1 -- 172.21.15.70:0/2221015125 >> v1:172.21.15.70:6790/0 conn(0x7f05040371b0 legacy=0x7f050402d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f05120a3640 1 -- 172.21.15.70:0/2221015125 reap_dead start 2024-05-06T06:51:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f8ea12ff640 1 -- 172.21.15.70:0/3940290507 wait complete. 2024-05-06T06:51:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f05128a4640 1 -- 172.21.15.70:0/2221015125 shutdown_connections 2024-05-06T06:51:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f05128a4640 1 -- 172.21.15.70:0/2221015125 >> 172.21.15.70:0/2221015125 conn(0x7f050403a530 msgr2=0x7f05040d8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f05128a4640 1 -- 172.21.15.70:0/2221015125 shutdown_connections 2024-05-06T06:51:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fbe537fe640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fbe54070d30 0x7fbe540ad820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46014/0 (socket says 172.21.15.70:46014) 2024-05-06T06:51:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7fbe537fe640 1 -- 172.21.15.70:0/3715232835 learned_addr learned my addr 172.21.15.70:0/3715232835 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.930+0000 7f05128a4640 1 -- 172.21.15.70:0/2221015125 wait complete. 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe540ad120 con 0x7fbe54139290 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe540ad400 con 0x7fbe54144110 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe54139800 con 0x7fbe54070d30 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2640345066 0 0) 0x7fbe540ad120 con 0x7fbe54139290 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe40003530 con 0x7fbe54139290 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280755698 0 0) 0x7fbe54139800 con 0x7fbe54070d30 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe540ad120 con 0x7fbe54070d30 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1140649987 0 0) 0x7fbe540ad400 con 0x7fbe54144110 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe54139800 con 0x7fbe54144110 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3585128038 0 0) 0x7fbe540ad120 con 0x7fbe54070d30 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe540ad400 con 0x7fbe54070d30 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbe48004010 con 0x7fbe54070d30 2024-05-06T06:51:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2193065954 0 0) 0x7fbe40003530 con 0x7fbe54139290 2024-05-06T06:51:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe540ad120 con 0x7fbe54139290 2024-05-06T06:51:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbe4c001f10 con 0x7fbe54139290 2024-05-06T06:51:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 290430661 0 0) 0x7fbe540ad400 con 0x7fbe54070d30 2024-05-06T06:51:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 >> v1:172.21.15.184:6789/0 conn(0x7fbe54144110 legacy=0x7fbe540adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 >> v1:172.21.15.70:6789/0 conn(0x7fbe54139290 legacy=0x7fbe541e2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe541401e0 con 0x7fbe54070d30 2024-05-06T06:51:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe48000ee0 con 0x7fbe54070d30 2024-05-06T06:51:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbe480012f0 con 0x7fbe54070d30 2024-05-06T06:51:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbe541404d0 con 0x7fbe54070d30 2024-05-06T06:51:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 --> v1:172.21.15.70:6800/1610479439 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f44f8007040 con 0x7f44f8001640 2024-05-06T06:51:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.934+0000 7f450dffb640 1 -- 172.21.15.70:0/811234955 <== osd.2 v1:172.21.15.70:6800/1610479439 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1046766345) 0x7f44f8007040 con 0x7f44f8001640 2024-05-06T06:51:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbe541e48a0 con 0x7fbe54070d30 2024-05-06T06:51:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fbe48001490 con 0x7fbe54070d30 2024-05-06T06:51:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7f3a5df90640 1 -- 172.21.15.70:0/1292753106 --> v1:172.21.15.70:6804/3977328488 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3a500c5460 con 0x7f3a3c077150 2024-05-06T06:51:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7fbe48089650 con 0x7fbe54070d30 2024-05-06T06:51:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 >> v1:172.21.15.70:6800/1610479439 conn(0x7f44f8001640 legacy=0x7f44f8003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 >> v1:172.21.15.70:6816/2757942729 conn(0x7f44fc070110 legacy=0x7f44fc0725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 >> v1:172.21.15.70:6790/0 conn(0x7f451813dcf0 legacy=0x7f4518071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7f451db2a640 1 -- 172.21.15.70:0/811234955 reap_dead start 2024-05-06T06:51:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 shutdown_connections 2024-05-06T06:51:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 >> 172.21.15.70:0/811234955 conn(0x7f45180b46d0 msgr2=0x7f451813aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 shutdown_connections 2024-05-06T06:51:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7f451e32b640 1 -- 172.21.15.70:0/811234955 wait complete. 2024-05-06T06:51:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7f3a557fa640 1 -- 172.21.15.70:0/1292753106 <== osd.0 v1:172.21.15.70:6804/3977328488 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 982563978) 0x7f3a500c5460 con 0x7f3a3c077150 2024-05-06T06:51:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.938+0000 7f3a5df90640 1 -- 172.21.15.70:0/1292753106 >> v1:172.21.15.70:6804/3977328488 conn(0x7f3a3c077150 legacy=0x7f3a3c079570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.946+0000 7f3a5df90640 1 -- 172.21.15.70:0/1292753106 >> v1:172.21.15.70:6816/2757942729 conn(0x7f3a3c0700c0 legacy=0x7f3a3c072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.946+0000 7f3a5df90640 1 -- 172.21.15.70:0/1292753106 >> v1:172.21.15.184:6789/0 conn(0x7f3a500c11b0 legacy=0x7f3a501745d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.946+0000 7f3a5d78f640 1 -- 172.21.15.70:0/1292753106 reap_dead start 2024-05-06T06:51:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.946+0000 7f3a5df90640 1 -- 172.21.15.70:0/1292753106 shutdown_connections 2024-05-06T06:51:21.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.946+0000 7f3a5df90640 1 -- 172.21.15.70:0/1292753106 >> 172.21.15.70:0/1292753106 conn(0x7f3a50005900 msgr2=0x7f3a500375e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.946+0000 7f3a5df90640 1 -- 172.21.15.70:0/1292753106 shutdown_connections 2024-05-06T06:51:21.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.946+0000 7f3a5df90640 1 -- 172.21.15.70:0/1292753106 wait complete. 2024-05-06T06:51:21.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.946+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.184:6812/1421504082 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe540640c0 con 0x7fbe54071fa0 2024-05-06T06:51:21.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.946+0000 7fdda8c99640 1 -- 172.21.15.70:0/1765174093 --> v1:172.21.15.184:6808/1828934695 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd84007040 con 0x7fdd84001640 2024-05-06T06:51:21.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.946+0000 7fdd8bfff640 1 -- 172.21.15.70:0/1765174093 <== osd.4 v1:172.21.15.184:6808/1828934695 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3464192168) 0x7fdd84007040 con 0x7fdd84001640 2024-05-06T06:51:21.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.950+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== osd.7 v1:172.21.15.184:6812/1421504082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fbe4c007e50 con 0x7fbe54071fa0 2024-05-06T06:51:21.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.950+0000 7fdda8c99640 1 -- 172.21.15.70:0/1765174093 >> v1:172.21.15.184:6808/1828934695 conn(0x7fdd84001640 legacy=0x7fdd84003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.950+0000 7fdda8c99640 1 -- 172.21.15.70:0/1765174093 >> v1:172.21.15.70:6816/2757942729 conn(0x7fdd90070250 legacy=0x7fdd90072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.950+0000 7fdda8c99640 1 -- 172.21.15.70:0/1765174093 >> v1:172.21.15.70:6789/0 conn(0x7fdda40ad560 legacy=0x7fdda41e1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.950+0000 7fdda3fff640 1 -- 172.21.15.70:0/1765174093 reap_dead start 2024-05-06T06:51:21.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.950+0000 7fdda8c99640 1 -- 172.21.15.70:0/1765174093 shutdown_connections 2024-05-06T06:51:21.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.950+0000 7fdda8c99640 1 -- 172.21.15.70:0/1765174093 >> 172.21.15.70:0/1765174093 conn(0x7fdda40b47a0 msgr2=0x7fdda4141890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.950+0000 7fdda8c99640 1 -- 172.21.15.70:0/1765174093 shutdown_connections 2024-05-06T06:51:21.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.950+0000 7fdda8c99640 1 -- 172.21.15.70:0/1765174093 wait complete. 2024-05-06T06:51:21.968 INFO:teuthology.orchestra.run.smithi070.stdout:60129542147 2024-05-06T06:51:21.968 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-06T06:51:21.969 INFO:teuthology.orchestra.run.smithi070.stdout:60129542146 2024-05-06T06:51:21.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-06T06:51:21.970 INFO:teuthology.orchestra.run.smithi070.stdout:60129542146 2024-05-06T06:51:21.970 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-06T06:51:21.971 INFO:teuthology.orchestra.run.smithi070.stdout:60129542146 2024-05-06T06:51:21.971 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-06T06:51:21.974 INFO:teuthology.orchestra.run.smithi070.stdout:60129542147 2024-05-06T06:51:21.975 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-06T06:51:21.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.974+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 --> v1:172.21.15.184:6812/1421504082 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe540b1620 con 0x7fbe54071fa0 2024-05-06T06:51:21.979 INFO:teuthology.orchestra.run.smithi070.stdout:55834574851 2024-05-06T06:51:21.979 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-06T06:51:21.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.978+0000 7fbe3bfff640 1 -- 172.21.15.70:0/3715232835 <== osd.7 v1:172.21.15.184:6812/1421504082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3464192168) 0x7fbe540b1620 con 0x7fbe54071fa0 2024-05-06T06:51:21.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.978+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 >> v1:172.21.15.184:6812/1421504082 conn(0x7fbe54071fa0 legacy=0x7fbe540633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.978+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 >> v1:172.21.15.70:6816/2757942729 conn(0x7fbe400700c0 legacy=0x7fbe40072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.978+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 >> v1:172.21.15.70:6790/0 conn(0x7fbe54070d30 legacy=0x7fbe540ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:21.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.978+0000 7fbe53fff640 1 -- 172.21.15.70:0/3715232835 reap_dead start 2024-05-06T06:51:21.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.978+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 shutdown_connections 2024-05-06T06:51:21.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.978+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 >> 172.21.15.70:0/3715232835 conn(0x7fbe540b5a70 msgr2=0x7fbe5413d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:21.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.978+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 shutdown_connections 2024-05-06T06:51:21.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:21.978+0000 7fbe59e3b640 1 -- 172.21.15.70:0/3715232835 wait complete. 2024-05-06T06:51:21.982 INFO:teuthology.orchestra.run.smithi070.stdout:64424509443 2024-05-06T06:51:21.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-06T06:51:22.000 INFO:teuthology.orchestra.run.smithi070.stdout:64424509443 2024-05-06T06:51:22.001 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-06T06:51:22.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.110+0000 7f15d107c640 1 Processor -- start 2024-05-06T06:51:22.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.110+0000 7f15d107c640 1 -- start start 2024-05-06T06:51:22.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.110+0000 7f15d107c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15cc1438f0 con 0x7f15cc140130 2024-05-06T06:51:22.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.110+0000 7f15d107c640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15cc071960 con 0x7f15cc070890 2024-05-06T06:51:22.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.110+0000 7f15d107c640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15cc071c40 con 0x7f15cc142cc0 2024-05-06T06:51:22.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.110+0000 7f15cad9d640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f15cc142cc0 0x7f15cc13fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46016/0 (socket says 172.21.15.70:46016) 2024-05-06T06:51:22.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.110+0000 7f15cad9d640 1 -- 172.21.15.70:0/3662255099 learned_addr learned my addr 172.21.15.70:0/3662255099 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15c9d9b640 1 -- 172.21.15.70:0/3662255099 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761805334 0 0) 0x7f15cc071c40 con 0x7f15cc142cc0 2024-05-06T06:51:22.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15c9d9b640 1 -- 172.21.15.70:0/3662255099 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15b4004640 con 0x7f15cc142cc0 2024-05-06T06:51:22.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15c9d9b640 1 -- 172.21.15.70:0/3662255099 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 540626316 0 0) 0x7f15cc1438f0 con 0x7f15cc140130 2024-05-06T06:51:22.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15c9d9b640 1 -- 172.21.15.70:0/3662255099 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15cc071c40 con 0x7f15cc140130 2024-05-06T06:51:22.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15c9d9b640 1 -- 172.21.15.70:0/3662255099 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487944254 0 0) 0x7f15cc071960 con 0x7f15cc070890 2024-05-06T06:51:22.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15c9d9b640 1 -- 172.21.15.70:0/3662255099 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15cc1438f0 con 0x7f15cc070890 2024-05-06T06:51:22.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15c9d9b640 1 -- 172.21.15.70:0/3662255099 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2145487654 0 0) 0x7f15b4004640 con 0x7f15cc142cc0 2024-05-06T06:51:22.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15c9d9b640 1 -- 172.21.15.70:0/3662255099 >> v1:172.21.15.184:6789/0 conn(0x7f15cc070890 legacy=0x7f15cc14ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15c9d9b640 1 -- 172.21.15.70:0/3662255099 >> v1:172.21.15.70:6789/0 conn(0x7f15cc140130 legacy=0x7f15cc070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15c9d9b640 1 -- 172.21.15.70:0/3662255099 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc071f20 con 0x7f15cc142cc0 2024-05-06T06:51:22.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15c9d9b640 1 -- 172.21.15.70:0/3662255099 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f15c4004fc0 con 0x7f15cc142cc0 2024-05-06T06:51:22.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15c9d9b640 1 -- 172.21.15.70:0/3662255099 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15c4005220 con 0x7f15cc142cc0 2024-05-06T06:51:22.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15d107c640 1 -- 172.21.15.70:0/3662255099 >> v1:172.21.15.70:6790/0 conn(0x7f15cc142cc0 legacy=0x7f15cc13fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15d107c640 1 -- 172.21.15.70:0/3662255099 shutdown_connections 2024-05-06T06:51:22.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15d107c640 1 -- 172.21.15.70:0/3662255099 >> 172.21.15.70:0/3662255099 conn(0x7f15cc0b4710 msgr2=0x7f15cc0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15d107c640 1 -- 172.21.15.70:0/3662255099 shutdown_connections 2024-05-06T06:51:22.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.114+0000 7f15d107c640 1 -- 172.21.15.70:0/3662255099 wait complete. 2024-05-06T06:51:22.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15d107c640 1 Processor -- start 2024-05-06T06:51:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15d107c640 1 -- start start 2024-05-06T06:51:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15d107c640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15cc0ad590 con 0x7f15cc140130 2024-05-06T06:51:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15d107c640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15cc1e8770 con 0x7f15cc070890 2024-05-06T06:51:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15d107c640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15cc1e93a0 con 0x7f15cc142cc0 2024-05-06T06:51:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15ca59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f15cc140130 0x7f15cc1e8c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60496/0 (socket says 172.21.15.70:60496) 2024-05-06T06:51:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15ca59c640 1 -- 172.21.15.70:0/4229720478 learned_addr learned my addr 172.21.15.70:0/4229720478 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 455958011 0 0) 0x7f15cc0ad590 con 0x7f15cc140130 2024-05-06T06:51:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15b4004c80 con 0x7f15cc140130 2024-05-06T06:51:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3098326105 0 0) 0x7f15cc1e93a0 con 0x7f15cc142cc0 2024-05-06T06:51:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15cc0ad590 con 0x7f15cc142cc0 2024-05-06T06:51:22.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567033797 0 0) 0x7f15cc1e8770 con 0x7f15cc070890 2024-05-06T06:51:22.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15cc1e93a0 con 0x7f15cc070890 2024-05-06T06:51:22.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 864382148 0 0) 0x7f15b4004c80 con 0x7f15cc140130 2024-05-06T06:51:22.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15cc1e8770 con 0x7f15cc140130 2024-05-06T06:51:22.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1959047670 0 0) 0x7f15cc0ad590 con 0x7f15cc142cc0 2024-05-06T06:51:22.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15b4004c80 con 0x7f15cc142cc0 2024-05-06T06:51:22.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f15bc0018d0 con 0x7f15cc140130 2024-05-06T06:51:22.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f15c0001710 con 0x7f15cc142cc0 2024-05-06T06:51:22.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 832604206 0 0) 0x7f15cc1e8770 con 0x7f15cc140130 2024-05-06T06:51:22.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 >> v1:172.21.15.70:6790/0 conn(0x7f15cc142cc0 legacy=0x7f15cc1d8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 >> v1:172.21.15.184:6789/0 conn(0x7f15cc070890 legacy=0x7f15cc0adff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc0ab1a0 con 0x7f15cc140130 2024-05-06T06:51:22.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15d107c640 1 -- 172.21.15.70:0/4229720478 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f15cc13ba20 con 0x7f15cc140130 2024-05-06T06:51:22.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.118+0000 7f15d107c640 1 -- 172.21.15.70:0/4229720478 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f15cc1d9400 con 0x7f15cc140130 2024-05-06T06:51:22.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.122+0000 7f15d107c640 1 -- 172.21.15.70:0/4229720478 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15cc0640c0 con 0x7f15cc140130 2024-05-06T06:51:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.122+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15bc003620 con 0x7f15cc140130 2024-05-06T06:51:22.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.122+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f15bc003a30 con 0x7f15cc140130 2024-05-06T06:51:22.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.122+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f15bc003c90 con 0x7f15cc140130 2024-05-06T06:51:22.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.126+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f15bc053a40 con 0x7f15cc140130 2024-05-06T06:51:22.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.130+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f15bc057be0 con 0x7f15cc140130 2024-05-06T06:51:22.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.142+0000 7eff03fd8640 1 Processor -- start 2024-05-06T06:51:22.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.142+0000 7eff03fd8640 1 -- start start 2024-05-06T06:51:22.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fef66e640 1 Processor -- start 2024-05-06T06:51:22.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fef66e640 1 -- start start 2024-05-06T06:51:22.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff03fd8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc143110 con 0x7efefc0b5200 2024-05-06T06:51:22.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff03fd8640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc1438f0 con 0x7efefc070890 2024-05-06T06:51:22.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff03fd8640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc071960 con 0x7efefc142cc0 2024-05-06T06:51:22.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff01d74640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7efefc0b5200 0x7efefc070180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60512/0 (socket says 172.21.15.70:60512) 2024-05-06T06:51:22.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff01d74640 1 -- 172.21.15.70:0/2917329299 learned_addr learned my addr 172.21.15.70:0/2917329299 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2900464626 0 0) 0x7efefc071960 con 0x7efefc142cc0 2024-05-06T06:51:22.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee8003530 con 0x7efefc142cc0 2024-05-06T06:51:22.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3335978386 0 0) 0x7efefc143110 con 0x7efefc0b5200 2024-05-06T06:51:22.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efefc071960 con 0x7efefc0b5200 2024-05-06T06:51:22.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fef66e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe80ac590 con 0x7f5fe80ab170 2024-05-06T06:51:22.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fef66e640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe80ac870 con 0x7f5fe80ae880 2024-05-06T06:51:22.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fef66e640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe80acb50 con 0x7f5fe80ad680 2024-05-06T06:51:22.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fed40a640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5fe80ab170 0x7f5fe80b25f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60526/0 (socket says 172.21.15.70:60526) 2024-05-06T06:51:22.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fed40a640 1 -- 172.21.15.70:0/1876403759 learned_addr learned my addr 172.21.15.70:0/1876403759 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766402789 0 0) 0x7efefc1438f0 con 0x7efefc070890 2024-05-06T06:51:22.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efefc143110 con 0x7efefc070890 2024-05-06T06:51:22.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4076386960 0 0) 0x7efee8003530 con 0x7efefc142cc0 2024-05-06T06:51:22.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 >> v1:172.21.15.184:6789/0 conn(0x7efefc070890 legacy=0x7efefc147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 >> v1:172.21.15.70:6789/0 conn(0x7efefc0b5200 legacy=0x7efefc070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc071c40 con 0x7efefc142cc0 2024-05-06T06:51:22.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7efeec0015d0 con 0x7efefc142cc0 2024-05-06T06:51:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1169017406 0 0) 0x7f5fe80acb50 con 0x7f5fe80ad680 2024-05-06T06:51:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd4003530 con 0x7f5fe80ad680 2024-05-06T06:51:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 892873417 0 0) 0x7f5fe80ac590 con 0x7f5fe80ab170 2024-05-06T06:51:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fe80acb50 con 0x7f5fe80ab170 2024-05-06T06:51:22.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efeec001770 con 0x7efefc142cc0 2024-05-06T06:51:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff00d72640 1 -- 172.21.15.70:0/2917329299 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7efeec001c00 con 0x7efefc142cc0 2024-05-06T06:51:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153836253 0 0) 0x7f5fe80ac870 con 0x7f5fe80ae880 2024-05-06T06:51:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fe80ac590 con 0x7f5fe80ae880 2024-05-06T06:51:22.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 891720634 0 0) 0x7f5fd4003530 con 0x7f5fe80ad680 2024-05-06T06:51:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 >> v1:172.21.15.184:6789/0 conn(0x7f5fe80ae880 legacy=0x7f5fe80acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 >> v1:172.21.15.70:6789/0 conn(0x7f5fe80ab170 legacy=0x7f5fe80b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe80ae360 con 0x7f5fe80ad680 2024-05-06T06:51:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5fe0001a20 con 0x7f5fe80ad680 2024-05-06T06:51:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5fe0001c40 con 0x7f5fe80ad680 2024-05-06T06:51:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fdffff640 1 -- 172.21.15.70:0/1876403759 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5fe0002010 con 0x7f5fe80ad680 2024-05-06T06:51:22.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff03fd8640 1 -- 172.21.15.70:0/2917329299 >> v1:172.21.15.70:6790/0 conn(0x7efefc142cc0 legacy=0x7efefc14b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff03fd8640 1 -- 172.21.15.70:0/2917329299 shutdown_connections 2024-05-06T06:51:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff03fd8640 1 -- 172.21.15.70:0/2917329299 >> 172.21.15.70:0/2917329299 conn(0x7efefc0b4710 msgr2=0x7efefc0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff03fd8640 1 -- 172.21.15.70:0/2917329299 shutdown_connections 2024-05-06T06:51:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fef66e640 1 -- 172.21.15.70:0/1876403759 >> v1:172.21.15.70:6790/0 conn(0x7f5fe80ad680 legacy=0x7f5fe80adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fef66e640 1 -- 172.21.15.70:0/1876403759 shutdown_connections 2024-05-06T06:51:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fef66e640 1 -- 172.21.15.70:0/1876403759 >> 172.21.15.70:0/1876403759 conn(0x7f5fe80b11d0 msgr2=0x7f5fe80b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fef66e640 1 -- 172.21.15.70:0/1876403759 shutdown_connections 2024-05-06T06:51:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7eff03fd8640 1 -- 172.21.15.70:0/2917329299 wait complete. 2024-05-06T06:51:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f990716d640 1 Processor -- start 2024-05-06T06:51:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.146+0000 7f5fef66e640 1 -- 172.21.15.70:0/1876403759 wait complete. 2024-05-06T06:51:22.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fef66e640 1 Processor -- start 2024-05-06T06:51:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7eff03fd8640 1 Processor -- start 2024-05-06T06:51:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7eff03fd8640 1 -- start start 2024-05-06T06:51:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f1af0b22640 1 Processor -- start 2024-05-06T06:51:22.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f1af0b22640 1 -- start start 2024-05-06T06:51:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f990716d640 1 -- start start 2024-05-06T06:51:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fef66e640 1 -- start start 2024-05-06T06:51:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fef66e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe814fbd0 con 0x7f5fe80ab170 2024-05-06T06:51:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fef66e640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe8150120 con 0x7f5fe814eaa0 2024-05-06T06:51:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fef66e640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe814fe40 con 0x7f5fe80ad680 2024-05-06T06:51:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fecc09640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f5fe80ad680 0x7f5fe8071440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46058/0 (socket says 172.21.15.70:46058) 2024-05-06T06:51:22.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fecc09640 1 -- 172.21.15.70:0/1341248250 learned_addr learned my addr 172.21.15.70:0/1341248250 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f990716d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99000adab0 con 0x7f99000aae80 2024-05-06T06:51:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f990716d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99000ad0d0 con 0x7f99000aba80 2024-05-06T06:51:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f990716d640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99000ad3b0 con 0x7f99000abe60 2024-05-06T06:51:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98fffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f99000aae80 0x7f99000adf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60540/0 (socket says 172.21.15.70:60540) 2024-05-06T06:51:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98fffff640 1 -- 172.21.15.70:0/1810739581 learned_addr learned my addr 172.21.15.70:0/1810739581 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1634854711 0 0) 0x7f5fe814fe40 con 0x7f5fe80ad680 2024-05-06T06:51:22.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd4003530 con 0x7f5fe80ad680 2024-05-06T06:51:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7eff03fd8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc0ad8b0 con 0x7efefc142cc0 2024-05-06T06:51:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7eff03fd8640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc0adb20 con 0x7efefc070890 2024-05-06T06:51:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7eff03fd8640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efefc0ade00 con 0x7efefc0b5200 2024-05-06T06:51:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7eff01d74640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7efefc070890 0x7efefc0ac8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.70:37666/0 (socket says 172.21.15.70:37666) 2024-05-06T06:51:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7eff01d74640 1 -- 172.21.15.70:0/1402498948 learned_addr learned my addr 172.21.15.70:0/1402498948 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98ff7fe640 1 -- 172.21.15.70:0/1810739581 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604669538 0 0) 0x7f99000ad0d0 con 0x7f99000aba80 2024-05-06T06:51:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98ff7fe640 1 -- 172.21.15.70:0/1810739581 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98e8003530 con 0x7f99000aba80 2024-05-06T06:51:22.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98ff7fe640 1 -- 172.21.15.70:0/1810739581 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498142303 0 0) 0x7f99000adab0 con 0x7f99000aae80 2024-05-06T06:51:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439502545 0 0) 0x7f5fe80ae360 con 0x7f5fe814eaa0 2024-05-06T06:51:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fe814fe40 con 0x7f5fe814eaa0 2024-05-06T06:51:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98ff7fe640 1 -- 172.21.15.70:0/1810739581 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99000ad0d0 con 0x7f99000aae80 2024-05-06T06:51:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2186561150 0 0) 0x7f5fd4003530 con 0x7f5fe80ad680 2024-05-06T06:51:22.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5fe80ae360 con 0x7f5fe80ad680 2024-05-06T06:51:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5fd8001920 con 0x7f5fe80ad680 2024-05-06T06:51:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3148463777 0 0) 0x7f5fe814fbd0 con 0x7f5fe80ab170 2024-05-06T06:51:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd4003530 con 0x7f5fe80ab170 2024-05-06T06:51:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f1af0b22640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aec1478f0 con 0x7f1aec147480 2024-05-06T06:51:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f1af0b22640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aec0b0de0 con 0x7f1aec0b0340 2024-05-06T06:51:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f1af0b22640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aec0712e0 con 0x7f1aec147000 2024-05-06T06:51:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f1ae3fff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f1aec147000 0x7f1aec14bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46092/0 (socket says 172.21.15.70:46092) 2024-05-06T06:51:22.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f1ae3fff640 1 -- 172.21.15.70:0/1868133043 learned_addr learned my addr 172.21.15.70:0/1868133043 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98ff7fe640 1 -- 172.21.15.70:0/1810739581 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1241140766 0 0) 0x7f99000ad0d0 con 0x7f99000aae80 2024-05-06T06:51:22.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98ff7fe640 1 -- 172.21.15.70:0/1810739581 >> v1:172.21.15.70:6790/0 conn(0x7f99000abe60 legacy=0x7f990014ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1739282752 0 0) 0x7efefc0adb20 con 0x7efefc070890 2024-05-06T06:51:22.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee0003530 con 0x7efefc070890 2024-05-06T06:51:22.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98ff7fe640 1 -- 172.21.15.70:0/1810739581 >> v1:172.21.15.184:6789/0 conn(0x7f99000aba80 legacy=0x7f990013c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98ff7fe640 1 -- 172.21.15.70:0/1810739581 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990013cfc0 con 0x7f99000aae80 2024-05-06T06:51:22.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98ff7fe640 1 -- 172.21.15.70:0/1810739581 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f98f8001a00 con 0x7f99000aae80 2024-05-06T06:51:22.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98ff7fe640 1 -- 172.21.15.70:0/1810739581 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98f8001c20 con 0x7f99000aae80 2024-05-06T06:51:22.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f98ff7fe640 1 -- 172.21.15.70:0/1810739581 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f98f8002070 con 0x7f99000aae80 2024-05-06T06:51:22.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3551159018 0 0) 0x7efee0003530 con 0x7efefc070890 2024-05-06T06:51:22.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efefc0adb20 con 0x7efefc070890 2024-05-06T06:51:22.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 590560257 0 0) 0x7efefc0ade00 con 0x7efefc0b5200 2024-05-06T06:51:22.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efee0003530 con 0x7efefc0b5200 2024-05-06T06:51:22.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7efef80013c0 con 0x7efefc070890 2024-05-06T06:51:22.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2023253069 0 0) 0x7efefc0ad8b0 con 0x7efefc142cc0 2024-05-06T06:51:22.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efefc0ade00 con 0x7efefc142cc0 2024-05-06T06:51:22.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4065342818 0 0) 0x7efee0003530 con 0x7efefc0b5200 2024-05-06T06:51:22.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efefc0ad8b0 con 0x7efefc0b5200 2024-05-06T06:51:22.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7efef4001c80 con 0x7efefc0b5200 2024-05-06T06:51:22.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f990716d640 1 -- 172.21.15.70:0/1810739581 >> v1:172.21.15.70:6789/0 conn(0x7f99000aae80 legacy=0x7f99000adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.1 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2841217648 0 0) 0x7efefc0adb20 con 0x7efefc070890 2024-05-06T06:51:22.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 >> v1:172.21.15.70:6790/0 conn(0x7efefc0b5200 legacy=0x7efefc131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 >> v1:172.21.15.70:6789/0 conn(0x7efefc142cc0 legacy=0x7efefc1e1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc0ae0e0 con 0x7efefc070890 2024-05-06T06:51:22.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7eff03fd8640 1 -- 172.21.15.70:0/1402498948 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efefc0aba10 con 0x7efefc070890 2024-05-06T06:51:22.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3346944167 0 0) 0x7f5fd4003530 con 0x7f5fe80ab170 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5fe814fbd0 con 0x7f5fe80ab170 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5fe40017a0 con 0x7f5fe80ab170 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1436932353 0 0) 0x7f5fe814fe40 con 0x7f5fe814eaa0 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5fd4003530 con 0x7f5fe814eaa0 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.150+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5fe0001f90 con 0x7f5fe814eaa0 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3676714615 0 0) 0x7f5fe80ae360 con 0x7f5fe80ad680 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 >> v1:172.21.15.184:6789/0 conn(0x7f5fe814eaa0 legacy=0x7f5fe81efd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 >> v1:172.21.15.70:6789/0 conn(0x7f5fe80ab170 legacy=0x7f5fe8070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe8153f00 con 0x7f5fe80ad680 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f5fef66e640 1 -- 172.21.15.70:0/1341248250 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe814df30 con 0x7f5fe80ad680 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f5fef66e640 1 -- 172.21.15.70:0/1341248250 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5fe81f1670 con 0x7f5fe80ad680 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5fd8003600 con 0x7f5fe80ad680 2024-05-06T06:51:22.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5fd8003990 con 0x7f5fe80ad680 2024-05-06T06:51:22.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7eff03fd8640 1 -- 172.21.15.70:0/1402498948 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efefc0acfe0 con 0x7efefc070890 2024-05-06T06:51:22.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.1 v1:172.21.15.184:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efef8001640 con 0x7efefc070890 2024-05-06T06:51:22.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.1 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7efef8004c40 con 0x7efefc070890 2024-05-06T06:51:22.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f990716d640 1 -- 172.21.15.70:0/1810739581 shutdown_connections 2024-05-06T06:51:22.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f990716d640 1 -- 172.21.15.70:0/1810739581 >> 172.21.15.70:0/1810739581 conn(0x7f99000b4ad0 msgr2=0x7f99000b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f5fef66e640 1 -- 172.21.15.70:0/1341248250 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fcc005090 con 0x7f5fe80ad680 2024-05-06T06:51:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f990716d640 1 -- 172.21.15.70:0/1810739581 shutdown_connections 2024-05-06T06:51:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7eff03fd8640 1 -- 172.21.15.70:0/1402498948 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee4005090 con 0x7efefc070890 2024-05-06T06:51:22.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f990716d640 1 -- 172.21.15.70:0/1810739581 wait complete. 2024-05-06T06:51:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f990716d640 1 Processor -- start 2024-05-06T06:51:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f5fd8003990 con 0x7f5fe80ad680 2024-05-06T06:51:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f990716d640 1 -- start start 2024-05-06T06:51:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f990716d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9900138fa0 con 0x7f99000abe60 2024-05-06T06:51:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f990716d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f990013f1c0 con 0x7f99000aba80 2024-05-06T06:51:22.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f990716d640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f990013eaf0 con 0x7f99000aae80 2024-05-06T06:51:22.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.1 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7efef801b9e0 con 0x7efefc070890 2024-05-06T06:51:22.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.1 v1:172.21.15.184:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7efef808a6c0 con 0x7efefc070890 2024-05-06T06:51:22.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f5fd808a420 con 0x7f5fe80ad680 2024-05-06T06:51:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.154+0000 7f990570a640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f99000abe60 0x7f99001e5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60562/0 (socket says 172.21.15.70:60562) 2024-05-06T06:51:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f98fffff640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f99000aba80 0x7f99001e5330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.70:37690/0 (socket says 172.21.15.70:37690) 2024-05-06T06:51:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f990570a640 1 -- 172.21.15.70:0/2531291877 learned_addr learned my addr 172.21.15.70:0/2531291877 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157703200 0 0) 0x7f98f4001140 con 0x7f99000abe60 2024-05-06T06:51:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98ec003530 con 0x7f99000abe60 2024-05-06T06:51:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1156415164 0 0) 0x7f98ec003530 con 0x7f99000abe60 2024-05-06T06:51:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98f4001140 con 0x7f99000abe60 2024-05-06T06:51:22.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f98f40019d0 con 0x7f99000abe60 2024-05-06T06:51:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 611677084 0 0) 0x7f98f4001140 con 0x7f99000abe60 2024-05-06T06:51:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 >> v1:172.21.15.70:6790/0 conn(0x7f99000aae80 legacy=0x7f990013e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 >> v1:172.21.15.184:6789/0 conn(0x7f99000aba80 legacy=0x7f99001e5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990013ecc0 con 0x7f99000abe60 2024-05-06T06:51:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f990716d640 1 -- 172.21.15.70:0/2531291877 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f99001f0d80 con 0x7f99000abe60 2024-05-06T06:51:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f990716d640 1 -- 172.21.15.70:0/2531291877 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f99001f1120 con 0x7f99000abe60 2024-05-06T06:51:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98f40038b0 con 0x7f99000abe60 2024-05-06T06:51:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f98f4003d00 con 0x7f99000abe60 2024-05-06T06:51:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.158+0000 7f990716d640 1 -- 172.21.15.70:0/2531291877 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e0005090 con 0x7f99000abe60 2024-05-06T06:51:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f98f4003ea0 con 0x7f99000abe60 2024-05-06T06:51:22.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f98f408a870 con 0x7f99000abe60 2024-05-06T06:51:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f1aeaffd640 1 -- 172.21.15.70:0/1868133043 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2369378274 0 0) 0x7f1ae40013d0 con 0x7f1aec147480 2024-05-06T06:51:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f1aeaffd640 1 -- 172.21.15.70:0/1868133043 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ad8003530 con 0x7f1aec147480 2024-05-06T06:51:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f1aeaffd640 1 -- 172.21.15.70:0/1868133043 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211704078 0 0) 0x7f1aec0b0de0 con 0x7f1aec0b0340 2024-05-06T06:51:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f1aeaffd640 1 -- 172.21.15.70:0/1868133043 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ae40013d0 con 0x7f1aec0b0340 2024-05-06T06:51:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f1aeaffd640 1 -- 172.21.15.70:0/1868133043 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2402036332 0 0) 0x7f1aec0712e0 con 0x7f1aec147000 2024-05-06T06:51:22.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f1aeaffd640 1 -- 172.21.15.70:0/1868133043 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1aec0b0de0 con 0x7f1aec147000 2024-05-06T06:51:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f6ee72c5640 1 Processor -- start 2024-05-06T06:51:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f6ee72c5640 1 -- start start 2024-05-06T06:51:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f6ee72c5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee00b1720 con 0x7f6ee006b810 2024-05-06T06:51:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f6ee72c5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee00b11d0 con 0x7f6ee0140ad0 2024-05-06T06:51:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f6ee72c5640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee0070490 con 0x7f6ee0070040 2024-05-06T06:51:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f1ae3fff640 1 -- 172.21.15.70:0/1868133043 >> v1:172.21.15.70:6790/0 conn(0x7f1aec147000 legacy=0x7f1aec14bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-05-06T06:51:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f1ae3fff640 1 -- 172.21.15.70:0/1868133043 >> v1:172.21.15.70:6790/0 conn(0x7f1aec147000 legacy=0x7f1aec14bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T06:51:22.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f1ae3fff640 1 --1- 172.21.15.70:0/1868133043 >> v1:172.21.15.70:6790/0 conn(0x7f1aec147000 0x7f1aec14bd50 :-1 s=OPENED pgs=107 cs=1 l=1).handle_message read tag failed 2024-05-06T06:51:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f1ae3fff640 1 --1- 172.21.15.70:0/1868133043 >> v1:172.21.15.70:6790/0 conn(0x7f1aec147000 0x7f1aec14bd50 :-1 s=OPENED pgs=107 cs=1 l=1).fault on lossy channel, failing 2024-05-06T06:51:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f6ee62c3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6ee006b810 0x7f6ee01403c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60568/0 (socket says 172.21.15.70:60568) 2024-05-06T06:51:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.162+0000 7f6ee62c3640 1 -- 172.21.15.70:0/75475208 learned_addr learned my addr 172.21.15.70:0/75475208 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f5fd8057880 con 0x7f5fe80ad680 2024-05-06T06:51:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f6ee52c1640 1 -- 172.21.15.70:0/75475208 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668671974 0 0) 0x7f6ee0070490 con 0x7f6ee0070040 2024-05-06T06:51:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f6ee52c1640 1 -- 172.21.15.70:0/75475208 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ecc003530 con 0x7f6ee0070040 2024-05-06T06:51:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1aeaffd640 1 -- 172.21.15.70:0/1868133043 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3881587811 0 0) 0x7f1ad8003530 con 0x7f1aec147480 2024-05-06T06:51:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1aeaffd640 1 -- 172.21.15.70:0/1868133043 >> v1:172.21.15.70:6790/0 conn(0x7f1aec147000 legacy=0x7f1aec14bd50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-06T06:51:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1aeaffd640 1 -- 172.21.15.70:0/1868133043 >> v1:172.21.15.184:6789/0 conn(0x7f1aec0b0340 legacy=0x7f1aec140840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1aeaffd640 1 -- 172.21.15.70:0/1868133043 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aec0715c0 con 0x7f1aec147480 2024-05-06T06:51:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1aeaffd640 1 -- 172.21.15.70:0/1868133043 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f1ae4001b20 con 0x7f1aec147480 2024-05-06T06:51:22.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f9900138fa0 con 0x7f99000abe60 2024-05-06T06:51:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1aeaffd640 1 -- 172.21.15.70:0/1868133043 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ae4001cc0 con 0x7f1aec147480 2024-05-06T06:51:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1af0b22640 1 -- 172.21.15.70:0/1868133043 >> v1:172.21.15.70:6789/0 conn(0x7f1aec147480 legacy=0x7f1aec14f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1af0b22640 1 -- 172.21.15.70:0/1868133043 shutdown_connections 2024-05-06T06:51:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1af0b22640 1 -- 172.21.15.70:0/1868133043 >> 172.21.15.70:0/1868133043 conn(0x7f1aec0b11d0 msgr2=0x7f1aec0b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1af0b22640 1 -- 172.21.15.70:0/1868133043 shutdown_connections 2024-05-06T06:51:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1af0b22640 1 -- 172.21.15.70:0/1868133043 wait complete. 2024-05-06T06:51:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1af0b22640 1 Processor -- start 2024-05-06T06:51:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f6ee52c1640 1 -- 172.21.15.70:0/75475208 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1663529814 0 0) 0x7f6ecc003530 con 0x7f6ee0070040 2024-05-06T06:51:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f6ee52c1640 1 -- 172.21.15.70:0/75475208 >> v1:172.21.15.184:6789/0 conn(0x7f6ee0140ad0 legacy=0x7f6ee01469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f6ee52c1640 1 -- 172.21.15.70:0/75475208 >> v1:172.21.15.70:6789/0 conn(0x7f6ee006b810 legacy=0x7f6ee01403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f6ee52c1640 1 -- 172.21.15.70:0/75475208 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee01470e0 con 0x7f6ee0070040 2024-05-06T06:51:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f6ee52c1640 1 -- 172.21.15.70:0/75475208 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6ed8001a20 con 0x7f6ee0070040 2024-05-06T06:51:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f6ee52c1640 1 -- 172.21.15.70:0/75475208 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ed8001c40 con 0x7f6ee0070040 2024-05-06T06:51:22.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f6ee52c1640 1 -- 172.21.15.70:0/75475208 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6ed80020d0 con 0x7f6ee0070040 2024-05-06T06:51:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.166+0000 7f1af0b22640 1 -- start start 2024-05-06T06:51:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1af0b22640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aec13f620 con 0x7f1aec147000 2024-05-06T06:51:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1af0b22640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aec0abe20 con 0x7f1aec0b0340 2024-05-06T06:51:22.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1af0b22640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aec0ac100 con 0x7f1aec147480 2024-05-06T06:51:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1aebfff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f1aec147480 0x7f1aec13ef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46128/0 (socket says 172.21.15.70:46128) 2024-05-06T06:51:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1aebfff640 1 -- 172.21.15.70:0/651008904 learned_addr learned my addr 172.21.15.70:0/651008904 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749134170 0 0) 0x7f1aec13f620 con 0x7f1aec147000 2024-05-06T06:51:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1acc003530 con 0x7f1aec147000 2024-05-06T06:51:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054879874 0 0) 0x7f1aec0ac100 con 0x7f1aec147480 2024-05-06T06:51:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1aec13f620 con 0x7f1aec147480 2024-05-06T06:51:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2669801781 0 0) 0x7f1aec0abe20 con 0x7f1aec0b0340 2024-05-06T06:51:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1aec0ac100 con 0x7f1aec0b0340 2024-05-06T06:51:22.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.1 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7efef8057b80 con 0x7efefc070890 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 716879938 0 0) 0x7f1aec0ac100 con 0x7f1aec0b0340 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1aec0abe20 con 0x7f1aec0b0340 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f1ad4001870 con 0x7f1aec0b0340 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4250944198 0 0) 0x7f1aec13f620 con 0x7f1aec147480 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1aec0ac100 con 0x7f1aec147480 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2019883257 0 0) 0x7f1acc003530 con 0x7f1aec147000 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1aec13f620 con 0x7f1aec147000 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f1adc0018f0 con 0x7f1aec147000 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f1ae4003980 con 0x7f1aec147480 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.1 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1161057288 0 0) 0x7f1aec0abe20 con 0x7f1aec0b0340 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 >> v1:172.21.15.70:6790/0 conn(0x7f1aec147480 legacy=0x7f1aec13ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 >> v1:172.21.15.70:6789/0 conn(0x7f1aec147000 legacy=0x7f1aec13e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aec0ac3e0 con 0x7f1aec0b0340 2024-05-06T06:51:22.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1af0b22640 1 -- 172.21.15.70:0/651008904 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1aec0aaff0 con 0x7f1aec0b0340 2024-05-06T06:51:22.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1af0b22640 1 -- 172.21.15.70:0/651008904 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1aec141f20 con 0x7f1aec0b0340 2024-05-06T06:51:22.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.1 v1:172.21.15.184:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ad4001d00 con 0x7f1aec0b0340 2024-05-06T06:51:22.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.1 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f1ad40037a0 con 0x7f1aec0b0340 2024-05-06T06:51:22.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.170+0000 7f1af0b22640 1 -- 172.21.15.70:0/651008904 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aec0640c0 con 0x7f1aec0b0340 2024-05-06T06:51:22.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.174+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.1 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f1ad401a3a0 con 0x7f1aec0b0340 2024-05-06T06:51:22.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.174+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.1 v1:172.21.15.184:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f1ad4089070 con 0x7f1aec0b0340 2024-05-06T06:51:22.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.178+0000 7f6ee72c5640 1 -- 172.21.15.70:0/75475208 >> v1:172.21.15.70:6790/0 conn(0x7f6ee0070040 legacy=0x7f6ee014ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.178+0000 7f6ee72c5640 1 -- 172.21.15.70:0/75475208 shutdown_connections 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.178+0000 7f6ee72c5640 1 -- 172.21.15.70:0/75475208 >> 172.21.15.70:0/75475208 conn(0x7f6ee00b55a0 msgr2=0x7f6ee00b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.178+0000 7f6ee72c5640 1 -- 172.21.15.70:0/75475208 shutdown_connections 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.178+0000 7f6ee72c5640 1 -- 172.21.15.70:0/75475208 wait complete. 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.178+0000 7f6ee72c5640 1 Processor -- start 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.178+0000 7f6ee72c5640 1 -- start start 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.178+0000 7f6ee5ac2640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6ee0070040 0x7f6ee01417c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60588/0 (socket says 172.21.15.70:60588) 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ee5ac2640 1 -- 172.21.15.70:0/649665192 learned_addr learned my addr 172.21.15.70:0/649665192 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ee72c5640 1 -- 172.21.15.70:0/649665192 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee0146410 con 0x7f6ee0070040 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ee72c5640 1 -- 172.21.15.70:0/649665192 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee0140ee0 con 0x7f6ee0140ad0 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ee72c5640 1 -- 172.21.15.70:0/649665192 --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee0142c80 con 0x7f6ee006b810 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961238237 0 0) 0x7f6ee0146410 con 0x7f6ee0070040 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ec4003530 con 0x7f6ee0070040 2024-05-06T06:51:22.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915982388 0 0) 0x7f6ee0142c80 con 0x7f6ee006b810 2024-05-06T06:51:22.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ee0146410 con 0x7f6ee006b810 2024-05-06T06:51:22.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 61282670 0 0) 0x7f6ec4003530 con 0x7f6ee0070040 2024-05-06T06:51:22.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ee0142c80 con 0x7f6ee0070040 2024-05-06T06:51:22.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6edc0018e0 con 0x7f6ee0070040 2024-05-06T06:51:22.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2059385553 0 0) 0x7f6ee0146410 con 0x7f6ee006b810 2024-05-06T06:51:22.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ec4003530 con 0x7f6ee006b810 2024-05-06T06:51:22.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6ed00018b0 con 0x7f6ee006b810 2024-05-06T06:51:22.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 956056817 0 0) 0x7f6ee0142c80 con 0x7f6ee0070040 2024-05-06T06:51:22.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 >> v1:172.21.15.70:6790/0 conn(0x7f6ee006b810 legacy=0x7f6ee0071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 >> v1:172.21.15.184:6789/0 conn(0x7f6ee0140ad0 legacy=0x7f6ee01332f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee0142e50 con 0x7f6ee0070040 2024-05-06T06:51:22.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6edc003620 con 0x7f6ee0070040 2024-05-06T06:51:22.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6edc003a30 con 0x7f6ee0070040 2024-05-06T06:51:22.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ee72c5640 1 -- 172.21.15.70:0/649665192 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee01359e0 con 0x7f6ee0070040 2024-05-06T06:51:22.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.182+0000 7f6ee72c5640 1 -- 172.21.15.70:0/649665192 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6ee0133a00 con 0x7f6ee0070040 2024-05-06T06:51:22.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.186+0000 7f6ed4ff9640 1 -- 172.21.15.70:0/649665192 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee00640c0 con 0x7f6ee0070040 2024-05-06T06:51:22.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.190+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f6edc003bd0 con 0x7f6ee0070040 2024-05-06T06:51:22.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.190+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f6edc08a530 con 0x7f6ee0070040 2024-05-06T06:51:22.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.186+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.1 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f1ad40564d0 con 0x7f1aec0b0340 2024-05-06T06:51:22.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.198+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f6edc057990 con 0x7f6ee0070040 2024-05-06T06:51:22.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.230+0000 7f06d9279640 1 Processor -- start 2024-05-06T06:51:22.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.230+0000 7f06d9279640 1 -- start start 2024-05-06T06:51:22.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d9279640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06cc02c430 con 0x7f06cc029c20 2024-05-06T06:51:22.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d9279640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06cc02a0b0 con 0x7f06cc02b0f0 2024-05-06T06:51:22.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d9279640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06cc0e9000 con 0x7f06cc0e2d80 2024-05-06T06:51:22.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d2ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f06cc029c20 0x7f06cc006820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60600/0 (socket says 172.21.15.70:60600) 2024-05-06T06:51:22.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d2ffd640 1 -- 172.21.15.70:0/2345358219 learned_addr learned my addr 172.21.15.70:0/2345358219 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2245523834 0 0) 0x7f06cc02c430 con 0x7f06cc029c20 2024-05-06T06:51:22.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06bc003530 con 0x7f06cc029c20 2024-05-06T06:51:22.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1363744982 0 0) 0x7f06cc0e9000 con 0x7f06cc0e2d80 2024-05-06T06:51:22.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06cc02c430 con 0x7f06cc0e2d80 2024-05-06T06:51:22.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970189549 0 0) 0x7f06cc02a0b0 con 0x7f06cc02b0f0 2024-05-06T06:51:22.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06cc0e9000 con 0x7f06cc02b0f0 2024-05-06T06:51:22.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1637616629 0 0) 0x7f06bc003530 con 0x7f06cc029c20 2024-05-06T06:51:22.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 >> v1:172.21.15.70:6790/0 conn(0x7f06cc0e2d80 legacy=0x7f06cc0e88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 >> v1:172.21.15.184:6789/0 conn(0x7f06cc02b0f0 legacy=0x7f06cc0e2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc0e91d0 con 0x7f06cc029c20 2024-05-06T06:51:22.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f06c40016a0 con 0x7f06cc029c20 2024-05-06T06:51:22.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f06c4001840 con 0x7f06cc029c20 2024-05-06T06:51:22.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d1ffb640 1 -- 172.21.15.70:0/2345358219 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f06c4001c90 con 0x7f06cc029c20 2024-05-06T06:51:22.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d9279640 1 -- 172.21.15.70:0/2345358219 >> v1:172.21.15.70:6789/0 conn(0x7f06cc029c20 legacy=0x7f06cc006820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d9279640 1 -- 172.21.15.70:0/2345358219 shutdown_connections 2024-05-06T06:51:22.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d9279640 1 -- 172.21.15.70:0/2345358219 >> 172.21.15.70:0/2345358219 conn(0x7f06cc005900 msgr2=0x7f06cc005d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d9279640 1 -- 172.21.15.70:0/2345358219 shutdown_connections 2024-05-06T06:51:22.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f06d9279640 1 -- 172.21.15.70:0/2345358219 wait complete. 2024-05-06T06:51:22.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f659ed2a640 1 Processor -- start 2024-05-06T06:51:22.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.234+0000 7f659ed2a640 1 -- start start 2024-05-06T06:51:22.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.238+0000 7f06d9279640 1 Processor -- start 2024-05-06T06:51:22.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.238+0000 7f659ed2a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6598146e80 con 0x7f659814cdb0 2024-05-06T06:51:22.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.238+0000 7f659ed2a640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6598071330 con 0x7f6598146a20 2024-05-06T06:51:22.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.238+0000 7f659ed2a640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6598071610 con 0x7f65980b3860 2024-05-06T06:51:22.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.238+0000 7f659cac6640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f65980b3860 0x7f6598070a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46146/0 (socket says 172.21.15.70:46146) 2024-05-06T06:51:22.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.238+0000 7f659cac6640 1 -- 172.21.15.70:0/143883930 learned_addr learned my addr 172.21.15.70:0/143883930 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.238+0000 7f06d9279640 1 -- start start 2024-05-06T06:51:22.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.238+0000 7f06d9279640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06cc0e55b0 con 0x7f06cc0e2d80 2024-05-06T06:51:22.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.238+0000 7f06d9279640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06cc0e5ad0 con 0x7f06cc0dacd0 2024-05-06T06:51:22.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.238+0000 7f06d9279640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06cc0e60b0 con 0x7f06cc02b0f0 2024-05-06T06:51:22.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.238+0000 7f06d2ffd640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f06cc02b0f0 0x7f06cc0da5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46152/0 (socket says 172.21.15.70:46152) 2024-05-06T06:51:22.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.238+0000 7f06d2ffd640 1 -- 172.21.15.70:0/470414145 learned_addr learned my addr 172.21.15.70:0/470414145 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f65977fe640 1 -- 172.21.15.70:0/143883930 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409911179 0 0) 0x7f6598146e80 con 0x7f659814cdb0 2024-05-06T06:51:22.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f65977fe640 1 -- 172.21.15.70:0/143883930 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6580003530 con 0x7f659814cdb0 2024-05-06T06:51:22.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f65977fe640 1 -- 172.21.15.70:0/143883930 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3000207124 0 0) 0x7f6598071610 con 0x7f65980b3860 2024-05-06T06:51:22.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f65977fe640 1 -- 172.21.15.70:0/143883930 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6598146e80 con 0x7f65980b3860 2024-05-06T06:51:22.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f65977fe640 1 -- 172.21.15.70:0/143883930 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102016355 0 0) 0x7f6598071330 con 0x7f6598146a20 2024-05-06T06:51:22.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f65977fe640 1 -- 172.21.15.70:0/143883930 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6598071610 con 0x7f6598146a20 2024-05-06T06:51:22.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f65977fe640 1 -- 172.21.15.70:0/143883930 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 386537585 0 0) 0x7f6580003530 con 0x7f659814cdb0 2024-05-06T06:51:22.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f65977fe640 1 -- 172.21.15.70:0/143883930 >> v1:172.21.15.70:6790/0 conn(0x7f65980b3860 legacy=0x7f6598070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f65977fe640 1 -- 172.21.15.70:0/143883930 >> v1:172.21.15.184:6789/0 conn(0x7f6598146a20 legacy=0x7f65981408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f65977fe640 1 -- 172.21.15.70:0/143883930 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659806d7f0 con 0x7f659814cdb0 2024-05-06T06:51:22.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f65977fe640 1 -- 172.21.15.70:0/143883930 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f65880016a0 con 0x7f659814cdb0 2024-05-06T06:51:22.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f65977fe640 1 -- 172.21.15.70:0/143883930 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6588001900 con 0x7f659814cdb0 2024-05-06T06:51:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f659ed2a640 1 -- 172.21.15.70:0/143883930 >> v1:172.21.15.70:6789/0 conn(0x7f659814cdb0 legacy=0x7f659814f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f659ed2a640 1 -- 172.21.15.70:0/143883930 shutdown_connections 2024-05-06T06:51:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f659ed2a640 1 -- 172.21.15.70:0/143883930 >> 172.21.15.70:0/143883930 conn(0x7f65980b4710 msgr2=0x7f65980b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f659ed2a640 1 -- 172.21.15.70:0/143883930 shutdown_connections 2024-05-06T06:51:22.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f659ed2a640 1 -- 172.21.15.70:0/143883930 wait complete. 2024-05-06T06:51:22.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f659ed2a640 1 Processor -- start 2024-05-06T06:51:22.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.242+0000 7f659ed2a640 1 -- start start 2024-05-06T06:51:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f659ed2a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f659811ea70 con 0x7f65980b3860 2024-05-06T06:51:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f659ed2a640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f659813c2b0 con 0x7f6598146a20 2024-05-06T06:51:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f659ed2a640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f659811d360 con 0x7f659811c810 2024-05-06T06:51:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f659cac6640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f65980b3860 0x7f65981dbc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60630/0 (socket says 172.21.15.70:60630) 2024-05-06T06:51:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f659cac6640 1 -- 172.21.15.70:0/3667608086 learned_addr learned my addr 172.21.15.70:0/3667608086 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:22.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 250699752 0 0) 0x7f659811ea70 con 0x7f65980b3860 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6584003530 con 0x7f65980b3860 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228578388 0 0) 0x7f659811d360 con 0x7f659811c810 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f659811ea70 con 0x7f659811c810 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352756565 0 0) 0x7f659813c2b0 con 0x7f6598146a20 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f659811d360 con 0x7f6598146a20 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2061648024 0 0) 0x7f6584003530 con 0x7f65980b3860 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f659813c2b0 con 0x7f65980b3860 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6590001c70 con 0x7f65980b3860 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4157763819 0 0) 0x7f659811d360 con 0x7f6598146a20 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6584003530 con 0x7f6598146a20 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3027849100 0 0) 0x7f659813c2b0 con 0x7f65980b3860 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 >> v1:172.21.15.70:6790/0 conn(0x7f659811c810 legacy=0x7f65981e2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 >> v1:172.21.15.184:6789/0 conn(0x7f6598146a20 legacy=0x7f65981dc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659811d530 con 0x7f65980b3860 2024-05-06T06:51:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f659ed2a640 1 -- 172.21.15.70:0/3667608086 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f65981e4690 con 0x7f65980b3860 2024-05-06T06:51:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6590004b70 con 0x7f65980b3860 2024-05-06T06:51:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6590004f00 con 0x7f65980b3860 2024-05-06T06:51:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f659ed2a640 1 -- 172.21.15.70:0/3667608086 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f65981e4a30 con 0x7f65980b3860 2024-05-06T06:51:22.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.250+0000 7f659ed2a640 1 -- 172.21.15.70:0/3667608086 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f659811ce70 con 0x7f65980b3860 2024-05-06T06:51:22.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.246+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615228324 0 0) 0x7f06cc0e55b0 con 0x7f06cc0e2d80 2024-05-06T06:51:22.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.250+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f6590004f00 con 0x7f65980b3860 2024-05-06T06:51:22.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.250+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f659008a7e0 con 0x7f65980b3860 2024-05-06T06:51:22.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.250+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06c0003530 con 0x7f06cc0e2d80 2024-05-06T06:51:22.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.250+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3343472483 0 0) 0x7f06cc0e5ad0 con 0x7f06cc0dacd0 2024-05-06T06:51:22.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.250+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06cc0e55b0 con 0x7f06cc0dacd0 2024-05-06T06:51:22.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.250+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883326163 0 0) 0x7f06cc0e60b0 con 0x7f06cc02b0f0 2024-05-06T06:51:22.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.250+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06cc0e5ad0 con 0x7f06cc02b0f0 2024-05-06T06:51:22.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1621436889 0 0) 0x7f06cc0e55b0 con 0x7f06cc0dacd0 2024-05-06T06:51:22.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06cc0e60b0 con 0x7f06cc0dacd0 2024-05-06T06:51:22.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1098005769 0 0) 0x7f06cc0e5ad0 con 0x7f06cc02b0f0 2024-05-06T06:51:22.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06cc0e55b0 con 0x7f06cc02b0f0 2024-05-06T06:51:22.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f06d4076df0 con 0x7f06cc0dacd0 2024-05-06T06:51:22.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f06c4001b90 con 0x7f06cc02b0f0 2024-05-06T06:51:22.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2197896545 0 0) 0x7f06cc0e55b0 con 0x7f06cc02b0f0 2024-05-06T06:51:22.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 >> v1:172.21.15.184:6789/0 conn(0x7f06cc0dacd0 legacy=0x7f06cc0d40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 >> v1:172.21.15.70:6789/0 conn(0x7f06cc0e2d80 legacy=0x7f06cc0d39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc0e4b30 con 0x7f06cc02b0f0 2024-05-06T06:51:22.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06d9279640 1 -- 172.21.15.70:0/470414145 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f06cc0d47e0 con 0x7f06cc02b0f0 2024-05-06T06:51:22.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06d9279640 1 -- 172.21.15.70:0/470414145 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f06cc0eb3e0 con 0x7f06cc02b0f0 2024-05-06T06:51:22.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f06c4001180 con 0x7f06cc02b0f0 2024-05-06T06:51:22.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f06c4004aa0 con 0x7f06cc02b0f0 2024-05-06T06:51:22.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f6590057c40 con 0x7f65980b3860 2024-05-06T06:51:22.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f06c4004c40 con 0x7f06cc02b0f0 2024-05-06T06:51:22.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.258+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f06c408a490 con 0x7f06cc02b0f0 2024-05-06T06:51:22.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.266+0000 7f06d9279640 1 -- 172.21.15.70:0/470414145 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b4005090 con 0x7f06cc02b0f0 2024-05-06T06:51:22.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.274+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f06c4057950 con 0x7f06cc02b0f0 2024-05-06T06:51:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.434+0000 7f15d107c640 1 -- 172.21.15.70:0/4229720478 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f15cc13ee40 con 0x7f15cc140130 2024-05-06T06:51:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.434+0000 7f15bb7fe640 1 -- 172.21.15.70:0/4229720478 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 326014871) 0x7f15bc0574e0 con 0x7f15cc140130 2024-05-06T06:51:22.437 INFO:teuthology.orchestra.run.smithi070.stdout:60129542146 2024-05-06T06:51:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.438+0000 7f15b97fa640 1 -- 172.21.15.70:0/4229720478 >> v1:172.21.15.70:6816/2757942729 conn(0x7f15b4070420 legacy=0x7f15b40728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.438+0000 7f15b97fa640 1 -- 172.21.15.70:0/4229720478 >> v1:172.21.15.70:6789/0 conn(0x7f15cc140130 legacy=0x7f15cc1e8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.438+0000 7f15b97fa640 1 -- 172.21.15.70:0/4229720478 shutdown_connections 2024-05-06T06:51:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.438+0000 7f15b97fa640 1 -- 172.21.15.70:0/4229720478 >> 172.21.15.70:0/4229720478 conn(0x7f15cc0b4710 msgr2=0x7f15cc073400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.438+0000 7f15b97fa640 1 -- 172.21.15.70:0/4229720478 shutdown_connections 2024-05-06T06:51:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.438+0000 7f15b97fa640 1 -- 172.21.15.70:0/4229720478 wait complete. 2024-05-06T06:51:22.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.3 2024-05-06T06:51:22.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.478+0000 7f5fef66e640 1 -- 172.21.15.70:0/1341248250 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5fcc005380 con 0x7f5fe80ad680 2024-05-06T06:51:22.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.478+0000 7f5fddffb640 1 -- 172.21.15.70:0/1341248250 <== mon.2 v1:172.21.15.70:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 663305998) 0x7f5fd8057180 con 0x7f5fe80ad680 2024-05-06T06:51:22.478 INFO:teuthology.orchestra.run.smithi070.stdout:60129542145 2024-05-06T06:51:22.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f5fef66e640 1 -- 172.21.15.70:0/1341248250 >> v1:172.21.15.70:6816/2757942729 conn(0x7f5fd4070360 legacy=0x7f5fd4072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f5fef66e640 1 -- 172.21.15.70:0/1341248250 >> v1:172.21.15.70:6790/0 conn(0x7f5fe80ad680 legacy=0x7f5fe8071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f5fef66e640 1 -- 172.21.15.70:0/1341248250 shutdown_connections 2024-05-06T06:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f5fef66e640 1 -- 172.21.15.70:0/1341248250 >> 172.21.15.70:0/1341248250 conn(0x7f5fe80b11d0 msgr2=0x7f5fe80b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f990716d640 1 -- 172.21.15.70:0/2531291877 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f98e0005380 con 0x7f99000abe60 2024-05-06T06:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f5fef66e640 1 -- 172.21.15.70:0/1341248250 shutdown_connections 2024-05-06T06:51:22.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f5fef66e640 1 -- 172.21.15.70:0/1341248250 wait complete. 2024-05-06T06:51:22.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f98fd7fa640 1 -- 172.21.15.70:0/2531291877 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 2439918515) 0x7f98f4057cd0 con 0x7f99000abe60 2024-05-06T06:51:22.483 INFO:teuthology.orchestra.run.smithi070.stdout:55834574850 2024-05-06T06:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f990716d640 1 -- 172.21.15.70:0/2531291877 >> v1:172.21.15.70:6816/2757942729 conn(0x7f98ec070010 legacy=0x7f98ec0724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f990716d640 1 -- 172.21.15.70:0/2531291877 >> v1:172.21.15.70:6789/0 conn(0x7f99000abe60 legacy=0x7f99001e5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f990716d640 1 -- 172.21.15.70:0/2531291877 shutdown_connections 2024-05-06T06:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f990716d640 1 -- 172.21.15.70:0/2531291877 >> 172.21.15.70:0/2531291877 conn(0x7f99000b4ad0 msgr2=0x7f99000b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f990716d640 1 -- 172.21.15.70:0/2531291877 shutdown_connections 2024-05-06T06:51:22.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.482+0000 7f990716d640 1 -- 172.21.15.70:0/2531291877 wait complete. 2024-05-06T06:51:22.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.494+0000 7eff03fd8640 1 -- 172.21.15.70:0/1402498948 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efee4005380 con 0x7efefc070890 2024-05-06T06:51:22.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.494+0000 7efef27fc640 1 -- 172.21.15.70:0/1402498948 <== mon.1 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 663305998) 0x7efef8057480 con 0x7efefc070890 2024-05-06T06:51:22.496 INFO:teuthology.orchestra.run.smithi070.stdout:60129542145 2024-05-06T06:51:22.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.498+0000 7eff03fd8640 1 -- 172.21.15.70:0/1402498948 >> v1:172.21.15.70:6816/2757942729 conn(0x7efee00701a0 legacy=0x7efee0072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.498+0000 7eff03fd8640 1 -- 172.21.15.70:0/1402498948 >> v1:172.21.15.184:6789/0 conn(0x7efefc070890 legacy=0x7efefc0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.498+0000 7eff03fd8640 1 -- 172.21.15.70:0/1402498948 shutdown_connections 2024-05-06T06:51:22.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.498+0000 7eff03fd8640 1 -- 172.21.15.70:0/1402498948 >> 172.21.15.70:0/1402498948 conn(0x7efefc0b4710 msgr2=0x7efefc073400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.498+0000 7eff03fd8640 1 -- 172.21.15.70:0/1402498948 shutdown_connections 2024-05-06T06:51:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.498+0000 7eff03fd8640 1 -- 172.21.15.70:0/1402498948 wait complete. 2024-05-06T06:51:22.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.0 2024-05-06T06:51:22.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542145 for osd.6 2024-05-06T06:51:22.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.514+0000 7f1af0b22640 1 -- 172.21.15.70:0/651008904 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1aec0008e0 con 0x7f1aec0b0340 2024-05-06T06:51:22.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.514+0000 7f1ae8ff9640 1 -- 172.21.15.70:0/651008904 <== mon.1 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 326014871) 0x7f1ad4055dd0 con 0x7f1aec0b0340 2024-05-06T06:51:22.516 INFO:teuthology.orchestra.run.smithi070.stdout:60129542146 2024-05-06T06:51:22.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.518+0000 7f1af0b22640 1 -- 172.21.15.70:0/651008904 >> v1:172.21.15.70:6816/2757942729 conn(0x7f1acc0701a0 legacy=0x7f1acc072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.518+0000 7f1af0b22640 1 -- 172.21.15.70:0/651008904 >> v1:172.21.15.184:6789/0 conn(0x7f1aec0b0340 legacy=0x7f1aec141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.518+0000 7f1af0b22640 1 -- 172.21.15.70:0/651008904 shutdown_connections 2024-05-06T06:51:22.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.518+0000 7f1af0b22640 1 -- 172.21.15.70:0/651008904 >> 172.21.15.70:0/651008904 conn(0x7f1aec0b11d0 msgr2=0x7f1aec140ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.518+0000 7f1af0b22640 1 -- 172.21.15.70:0/651008904 shutdown_connections 2024-05-06T06:51:22.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.518+0000 7f1af0b22640 1 -- 172.21.15.70:0/651008904 wait complete. 2024-05-06T06:51:22.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542145 for osd.2 2024-05-06T06:51:22.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.526+0000 7f6ed4ff9640 1 -- 172.21.15.70:0/649665192 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6ee0146ec0 con 0x7f6ee0070040 2024-05-06T06:51:22.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.526+0000 7f6ed6ffd640 1 -- 172.21.15.70:0/649665192 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 663305998) 0x7f6edc057290 con 0x7f6ee0070040 2024-05-06T06:51:22.525 INFO:teuthology.orchestra.run.smithi070.stdout:60129542145 2024-05-06T06:51:22.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.526+0000 7f6ed4ff9640 1 -- 172.21.15.70:0/649665192 >> v1:172.21.15.70:6816/2757942729 conn(0x7f6ec4070060 legacy=0x7f6ec4072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.526+0000 7f6ed4ff9640 1 -- 172.21.15.70:0/649665192 >> v1:172.21.15.70:6789/0 conn(0x7f6ee0070040 legacy=0x7f6ee01417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.526+0000 7f6ed4ff9640 1 -- 172.21.15.70:0/649665192 shutdown_connections 2024-05-06T06:51:22.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.526+0000 7f6ed4ff9640 1 -- 172.21.15.70:0/649665192 >> 172.21.15.70:0/649665192 conn(0x7f6ee00b55a0 msgr2=0x7f6ee00b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.526+0000 7f6ed4ff9640 1 -- 172.21.15.70:0/649665192 shutdown_connections 2024-05-06T06:51:22.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.526+0000 7f6ed4ff9640 1 -- 172.21.15.70:0/649665192 wait complete. 2024-05-06T06:51:22.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.5 2024-05-06T06:51:22.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542145 for osd.1 2024-05-06T06:51:22.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.554+0000 7f659ed2a640 1 -- 172.21.15.70:0/3667608086 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f65980640c0 con 0x7f65980b3860 2024-05-06T06:51:22.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.554+0000 7f65957fa640 1 -- 172.21.15.70:0/3667608086 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 1344022086) 0x7f6590057540 con 0x7f65980b3860 2024-05-06T06:51:22.554 INFO:teuthology.orchestra.run.smithi070.stdout:64424509442 2024-05-06T06:51:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.554+0000 7f659ed2a640 1 -- 172.21.15.70:0/3667608086 >> v1:172.21.15.70:6816/2757942729 conn(0x7f658406ff10 legacy=0x7f65840723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.554+0000 7f659ed2a640 1 -- 172.21.15.70:0/3667608086 >> v1:172.21.15.70:6789/0 conn(0x7f65980b3860 legacy=0x7f65981dbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.554+0000 7f659ed2a640 1 -- 172.21.15.70:0/3667608086 shutdown_connections 2024-05-06T06:51:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.554+0000 7f659ed2a640 1 -- 172.21.15.70:0/3667608086 >> 172.21.15.70:0/3667608086 conn(0x7f65980b4710 msgr2=0x7f65980b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.554+0000 7f659ed2a640 1 -- 172.21.15.70:0/3667608086 shutdown_connections 2024-05-06T06:51:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.554+0000 7f659ed2a640 1 -- 172.21.15.70:0/3667608086 wait complete. 2024-05-06T06:51:22.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509442 for osd.4 2024-05-06T06:51:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.570+0000 7f06d9279640 1 -- 172.21.15.70:0/470414145 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f06b4005380 con 0x7f06cc02b0f0 2024-05-06T06:51:22.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.570+0000 7f06bb7fe640 1 -- 172.21.15.70:0/470414145 <== mon.2 v1:172.21.15.70:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+2 (unknown 1482059429 0 732707515) 0x7f06c4057250 con 0x7f06cc02b0f0 2024-05-06T06:51:22.572 INFO:teuthology.orchestra.run.smithi070.stdout:0 2024-05-06T06:51:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.574+0000 7f06d9279640 1 -- 172.21.15.70:0/470414145 >> v1:172.21.15.70:6816/2757942729 conn(0x7f06c0070130 legacy=0x7f06c00725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.574+0000 7f06d9279640 1 -- 172.21.15.70:0/470414145 >> v1:172.21.15.70:6790/0 conn(0x7f06cc02b0f0 legacy=0x7f06cc0da5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.574+0000 7f06d9279640 1 -- 172.21.15.70:0/470414145 shutdown_connections 2024-05-06T06:51:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.574+0000 7f06d9279640 1 -- 172.21.15.70:0/470414145 >> 172.21.15.70:0/470414145 conn(0x7f06cc005900 msgr2=0x7f06cc0043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.574+0000 7f06d9279640 1 -- 172.21.15.70:0/470414145 shutdown_connections 2024-05-06T06:51:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:22.574+0000 7f06d9279640 1 -- 172.21.15.70:0/470414145 wait complete. 2024-05-06T06:51:22.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 0 for osd.7 2024-05-06T06:51:23.463 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-06T06:51:23.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-06T06:51:23.508 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-06T06:51:23.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-06T06:51:23.543 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-06T06:51:23.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-06T06:51:23.571 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-06T06:51:23.589 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-06T06:51:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13e667d640 1 Processor -- start 2024-05-06T06:51:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13e667d640 1 -- start start 2024-05-06T06:51:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13e667d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e00b0690 con 0x7f13e0070f40 2024-05-06T06:51:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13e667d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e0140390 con 0x7f13e0070080 2024-05-06T06:51:23.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13e667d640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e0071940 con 0x7f13e00b02b0 2024-05-06T06:51:23.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13e5e7c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f13e0070f40 0x7f13e014ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60646/0 (socket says 172.21.15.70:60646) 2024-05-06T06:51:23.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13e5e7c640 1 -- 172.21.15.70:0/3400071797 learned_addr learned my addr 172.21.15.70:0/3400071797 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13d7fff640 1 -- 172.21.15.70:0/3400071797 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 912742063 0 0) 0x7f13e00b0690 con 0x7f13e0070f40 2024-05-06T06:51:23.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13d7fff640 1 -- 172.21.15.70:0/3400071797 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13cc003530 con 0x7f13e0070f40 2024-05-06T06:51:23.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13d7fff640 1 -- 172.21.15.70:0/3400071797 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 747347581 0 0) 0x7f13e0140390 con 0x7f13e0070080 2024-05-06T06:51:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13d7fff640 1 -- 172.21.15.70:0/3400071797 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e00b0690 con 0x7f13e0070080 2024-05-06T06:51:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13d7fff640 1 -- 172.21.15.70:0/3400071797 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 96288793 0 0) 0x7f13cc003530 con 0x7f13e0070f40 2024-05-06T06:51:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13d7fff640 1 -- 172.21.15.70:0/3400071797 >> v1:172.21.15.70:6790/0 conn(0x7f13e00b02b0 legacy=0x7f13e013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-06T06:51:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13d7fff640 1 -- 172.21.15.70:0/3400071797 >> v1:172.21.15.184:6789/0 conn(0x7f13e0070080 legacy=0x7f13e0070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13d7fff640 1 -- 172.21.15.70:0/3400071797 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e0071c20 con 0x7f13e0070f40 2024-05-06T06:51:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13d7fff640 1 -- 172.21.15.70:0/3400071797 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f13d80019a0 con 0x7f13e0070f40 2024-05-06T06:51:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13d7fff640 1 -- 172.21.15.70:0/3400071797 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13d8001c00 con 0x7f13e0070f40 2024-05-06T06:51:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.630+0000 7f13d7fff640 1 -- 172.21.15.70:0/3400071797 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f13d8002010 con 0x7f13e0070f40 2024-05-06T06:51:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.634+0000 7f13e667d640 1 -- 172.21.15.70:0/3400071797 >> v1:172.21.15.70:6789/0 conn(0x7f13e0070f40 legacy=0x7f13e014ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.634+0000 7f13e667d640 1 -- 172.21.15.70:0/3400071797 shutdown_connections 2024-05-06T06:51:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.634+0000 7f13e667d640 1 -- 172.21.15.70:0/3400071797 >> 172.21.15.70:0/3400071797 conn(0x7f13e00b11d0 msgr2=0x7f13e00b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:23.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.634+0000 7f13e667d640 1 -- 172.21.15.70:0/3400071797 shutdown_connections 2024-05-06T06:51:23.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.634+0000 7f13e667d640 1 -- 172.21.15.70:0/3400071797 wait complete. 2024-05-06T06:51:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.634+0000 7f13e667d640 1 Processor -- start 2024-05-06T06:51:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.634+0000 7f13e667d640 1 -- start start 2024-05-06T06:51:23.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13e667d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e01c6150 con 0x7f13e00b02b0 2024-05-06T06:51:23.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13e667d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e01c6430 con 0x7f13e0070f40 2024-05-06T06:51:23.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13e667d640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e01e0120 con 0x7f13e0070080 2024-05-06T06:51:23.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13e5e7c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f13e00b02b0 0x7f13e01371d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60652/0 (socket says 172.21.15.70:60652) 2024-05-06T06:51:23.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13e5e7c640 1 -- 172.21.15.70:0/2940320351 learned_addr learned my addr 172.21.15.70:0/2940320351 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3432507287 0 0) 0x7f13e01e0120 con 0x7f13e0070080 2024-05-06T06:51:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13cc003530 con 0x7f13e0070080 2024-05-06T06:51:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 847317052 0 0) 0x7f13e01c6430 con 0x7f13e0070f40 2024-05-06T06:51:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e01e0120 con 0x7f13e0070f40 2024-05-06T06:51:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399225556 0 0) 0x7f13e01c6150 con 0x7f13e00b02b0 2024-05-06T06:51:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e01c6430 con 0x7f13e00b02b0 2024-05-06T06:51:23.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2073550935 0 0) 0x7f13cc003530 con 0x7f13e0070080 2024-05-06T06:51:23.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13e01c6150 con 0x7f13e0070080 2024-05-06T06:51:23.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f13dc0017e0 con 0x7f13e0070080 2024-05-06T06:51:23.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3477346054 0 0) 0x7f13e01e0120 con 0x7f13e0070f40 2024-05-06T06:51:23.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13cc003530 con 0x7f13e0070f40 2024-05-06T06:51:23.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f13d0001830 con 0x7f13e0070f40 2024-05-06T06:51:23.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13e4e7a640 1 -- 172.21.15.70:0/2940320351 >> v1:172.21.15.184:6789/0 conn(0x7f13e0070f40 legacy=0x7f13e00ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-06T06:51:23.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13e4e7a640 1 -- 172.21.15.70:0/2940320351 >> v1:172.21.15.184:6789/0 conn(0x7f13e0070f40 legacy=0x7f13e00ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T06:51:23.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13e4e7a640 1 --1- 172.21.15.70:0/2940320351 >> v1:172.21.15.184:6789/0 conn(0x7f13e0070f40 0x7f13e00ad0f0 :-1 s=OPENED pgs=118 cs=1 l=1).handle_message read tag failed 2024-05-06T06:51:23.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13e4e7a640 1 --1- 172.21.15.70:0/2940320351 >> v1:172.21.15.184:6789/0 conn(0x7f13e0070f40 0x7f13e00ad0f0 :-1 s=OPENED pgs=118 cs=1 l=1).fault on lossy channel, failing 2024-05-06T06:51:23.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1707079869 0 0) 0x7f13e01c6150 con 0x7f13e0070080 2024-05-06T06:51:23.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 >> v1:172.21.15.184:6789/0 conn(0x7f13e0070f40 legacy=0x7f13e00ad0f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-06T06:51:23.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 >> v1:172.21.15.70:6789/0 conn(0x7f13e00b02b0 legacy=0x7f13e01371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e00ae470 con 0x7f13e0070080 2024-05-06T06:51:23.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13e667d640 1 -- 172.21.15.70:0/2940320351 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13e01dfcd0 con 0x7f13e0070080 2024-05-06T06:51:23.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.638+0000 7f13e667d640 1 -- 172.21.15.70:0/2940320351 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f13e013e590 con 0x7f13e0070080 2024-05-06T06:51:23.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.642+0000 7f13e667d640 1 -- 172.21.15.70:0/2940320351 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e00640c0 con 0x7f13e0070080 2024-05-06T06:51:23.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.642+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13dc001d30 con 0x7f13e0070080 2024-05-06T06:51:23.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.642+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f13dc0037a0 con 0x7f13e0070080 2024-05-06T06:51:23.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.642+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f13dc01a580 con 0x7f13e0070080 2024-05-06T06:51:23.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.642+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f13dc0892a0 con 0x7f13e0070080 2024-05-06T06:51:23.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.642+0000 7f2c2886a640 1 Processor -- start 2024-05-06T06:51:23.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.642+0000 7f2c2886a640 1 -- start start 2024-05-06T06:51:23.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c2886a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c240ad5f0 con 0x7f2c240abe00 2024-05-06T06:51:23.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c2886a640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c240ad7c0 con 0x7f2c240aa460 2024-05-06T06:51:23.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c2886a640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c24145160 con 0x7f2c240aac90 2024-05-06T06:51:23.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c22d9d640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2c240aa460 0x7f2c241530c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.70:37772/0 (socket says 172.21.15.70:37772) 2024-05-06T06:51:23.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c22d9d640 1 -- 172.21.15.70:0/4292016779 learned_addr learned my addr 172.21.15.70:0/4292016779 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c2159a640 1 -- 172.21.15.70:0/4292016779 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886887325 0 0) 0x7f2c240ad7c0 con 0x7f2c240aa460 2024-05-06T06:51:23.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c2159a640 1 -- 172.21.15.70:0/4292016779 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c0c003530 con 0x7f2c240aa460 2024-05-06T06:51:23.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c2159a640 1 -- 172.21.15.70:0/4292016779 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1476262345 0 0) 0x7f2c240ad5f0 con 0x7f2c240abe00 2024-05-06T06:51:23.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c2159a640 1 -- 172.21.15.70:0/4292016779 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c240ad7c0 con 0x7f2c240abe00 2024-05-06T06:51:23.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c2159a640 1 -- 172.21.15.70:0/4292016779 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4234556511 0 0) 0x7f2c0c003530 con 0x7f2c240aa460 2024-05-06T06:51:23.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c2159a640 1 -- 172.21.15.70:0/4292016779 >> v1:172.21.15.70:6790/0 conn(0x7f2c240aac90 legacy=0x7f2c24144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c2159a640 1 -- 172.21.15.70:0/4292016779 >> v1:172.21.15.70:6789/0 conn(0x7f2c240abe00 legacy=0x7f2c2414b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c2159a640 1 -- 172.21.15.70:0/4292016779 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c24145330 con 0x7f2c240aa460 2024-05-06T06:51:23.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.646+0000 7f2c2159a640 1 -- 172.21.15.70:0/4292016779 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2c1c001950 con 0x7f2c240aa460 2024-05-06T06:51:23.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.650+0000 7f2c2159a640 1 -- 172.21.15.70:0/4292016779 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c1c001bb0 con 0x7f2c240aa460 2024-05-06T06:51:23.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.650+0000 7f2c2886a640 1 -- 172.21.15.70:0/4292016779 >> v1:172.21.15.184:6789/0 conn(0x7f2c240aa460 legacy=0x7f2c241530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.650+0000 7f2c2886a640 1 -- 172.21.15.70:0/4292016779 shutdown_connections 2024-05-06T06:51:23.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.650+0000 7f2c2886a640 1 -- 172.21.15.70:0/4292016779 >> 172.21.15.70:0/4292016779 conn(0x7f2c240b4ad0 msgr2=0x7f2c240b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:23.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.650+0000 7f2c2886a640 1 -- 172.21.15.70:0/4292016779 shutdown_connections 2024-05-06T06:51:23.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.650+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f13dc056700 con 0x7f13e0070080 2024-05-06T06:51:23.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.650+0000 7f2c2886a640 1 -- 172.21.15.70:0/4292016779 wait complete. 2024-05-06T06:51:23.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.650+0000 7f2c2886a640 1 Processor -- start 2024-05-06T06:51:23.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.650+0000 7f914ce86640 1 Processor -- start 2024-05-06T06:51:23.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.650+0000 7f2c2886a640 1 -- start start 2024-05-06T06:51:23.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.650+0000 7f914ce86640 1 -- start start 2024-05-06T06:51:23.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f914ce86640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91480ad070 con 0x7f91480aadf0 2024-05-06T06:51:23.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f914ce86640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91480ad2e0 con 0x7f91480ae0f0 2024-05-06T06:51:23.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f914ce86640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91480ad5c0 con 0x7f91480abf00 2024-05-06T06:51:23.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c2886a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c2413e180 con 0x7f2c240aa460 2024-05-06T06:51:23.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c2886a640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c2413f000 con 0x7f2c240b4520 2024-05-06T06:51:23.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c2886a640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c241e5ed0 con 0x7f2c240aac90 2024-05-06T06:51:23.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91477fe640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f91480abf00 0x7f914813c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46204/0 (socket says 172.21.15.70:46204) 2024-05-06T06:51:23.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f9147fff640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f91480ae0f0 0x7f914814abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.70:37786/0 (socket says 172.21.15.70:37786) 2024-05-06T06:51:23.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91477fe640 1 -- 172.21.15.70:0/3207449854 learned_addr learned my addr 172.21.15.70:0/3207449854 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c22d9d640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2c240b4520 0x7f2c241e57c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.70:37794/0 (socket says 172.21.15.70:37794) 2024-05-06T06:51:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c22d9d640 1 -- 172.21.15.70:0/2400760327 learned_addr learned my addr 172.21.15.70:0/2400760327 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096026595 0 0) 0x7f91480ad2e0 con 0x7f91480ae0f0 2024-05-06T06:51:23.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9130003530 con 0x7f91480ae0f0 2024-05-06T06:51:23.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 310062382 0 0) 0x7f2c2413f000 con 0x7f2c240b4520 2024-05-06T06:51:23.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c04003530 con 0x7f2c240b4520 2024-05-06T06:51:23.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379531873 0 0) 0x7f2c2413e180 con 0x7f2c240aa460 2024-05-06T06:51:23.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c2413f000 con 0x7f2c240aa460 2024-05-06T06:51:23.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392702967 0 0) 0x7f2c241e5ed0 con 0x7f2c240aac90 2024-05-06T06:51:23.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c2413e180 con 0x7f2c240aac90 2024-05-06T06:51:23.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232770984 0 0) 0x7f91480ad070 con 0x7f91480aadf0 2024-05-06T06:51:23.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91480ad2e0 con 0x7f91480aadf0 2024-05-06T06:51:23.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2423409870 0 0) 0x7f91480ad5c0 con 0x7f91480abf00 2024-05-06T06:51:23.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91480ad070 con 0x7f91480abf00 2024-05-06T06:51:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1641077029 0 0) 0x7f2c04003530 con 0x7f2c240b4520 2024-05-06T06:51:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c241e5ed0 con 0x7f2c240b4520 2024-05-06T06:51:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2c1c004d10 con 0x7f2c240b4520 2024-05-06T06:51:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1092532027 0 0) 0x7f2c2413e180 con 0x7f2c240aac90 2024-05-06T06:51:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c04003530 con 0x7f2c240aac90 2024-05-06T06:51:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2c140017b0 con 0x7f2c240aac90 2024-05-06T06:51:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3696226693 0 0) 0x7f2c2413f000 con 0x7f2c240aa460 2024-05-06T06:51:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c2413e180 con 0x7f2c240aa460 2024-05-06T06:51:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2c18001840 con 0x7f2c240aa460 2024-05-06T06:51:23.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1723514423 0 0) 0x7f9130003530 con 0x7f91480ae0f0 2024-05-06T06:51:23.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 >> v1:172.21.15.70:6790/0 conn(0x7f91480abf00 legacy=0x7f914813c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 >> v1:172.21.15.70:6789/0 conn(0x7f91480aadf0 legacy=0x7f91480ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91480b0ab0 con 0x7f91480ae0f0 2024-05-06T06:51:23.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f9140001260 con 0x7f91480ae0f0 2024-05-06T06:51:23.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3835528413 0 0) 0x7f2c04003530 con 0x7f2c240aac90 2024-05-06T06:51:23.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 >> v1:172.21.15.184:6789/0 conn(0x7f2c240b4520 legacy=0x7f2c241e57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 >> v1:172.21.15.70:6789/0 conn(0x7f2c240aa460 legacy=0x7f2c2413d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2413fec0 con 0x7f2c240aac90 2024-05-06T06:51:23.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.658+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c14001c00 con 0x7f2c240aac90 2024-05-06T06:51:23.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.658+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2c140037a0 con 0x7f2c240aac90 2024-05-06T06:51:23.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 <== mon.1 v1:172.21.15.184:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9140001400 con 0x7f91480ae0f0 2024-05-06T06:51:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.654+0000 7f91467fc640 1 -- 172.21.15.70:0/3207449854 <== mon.1 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f9140001810 con 0x7f91480ae0f0 2024-05-06T06:51:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.658+0000 7f914ce86640 1 -- 172.21.15.70:0/3207449854 >> v1:172.21.15.184:6789/0 conn(0x7f91480ae0f0 legacy=0x7f914814abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.658+0000 7f2c2886a640 1 -- 172.21.15.70:0/2400760327 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2c2413d850 con 0x7f2c240aac90 2024-05-06T06:51:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.658+0000 7f2c2886a640 1 -- 172.21.15.70:0/2400760327 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2c2414a740 con 0x7f2c240aac90 2024-05-06T06:51:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.658+0000 7f914ce86640 1 -- 172.21.15.70:0/3207449854 shutdown_connections 2024-05-06T06:51:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.658+0000 7f914ce86640 1 -- 172.21.15.70:0/3207449854 >> 172.21.15.70:0/3207449854 conn(0x7f91480b47a0 msgr2=0x7f91480b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.658+0000 7f914ce86640 1 -- 172.21.15.70:0/3207449854 shutdown_connections 2024-05-06T06:51:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.658+0000 7f914ce86640 1 -- 172.21.15.70:0/3207449854 wait complete. 2024-05-06T06:51:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.658+0000 7f914ce86640 1 Processor -- start 2024-05-06T06:51:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.658+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f2c1401a3a0 con 0x7f2c240aac90 2024-05-06T06:51:23.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.658+0000 7f914ce86640 1 -- start start 2024-05-06T06:51:23.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f914ce86640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9148142b70 con 0x7f91480aadf0 2024-05-06T06:51:23.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f914ce86640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9148142e50 con 0x7f91480abf00 2024-05-06T06:51:23.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f914ce86640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9148143130 con 0x7f91480ae0f0 2024-05-06T06:51:23.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f9147fff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f91480ae0f0 0x7f91481dce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46234/0 (socket says 172.21.15.70:46234) 2024-05-06T06:51:23.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f9147fff640 1 -- 172.21.15.70:0/3817383636 learned_addr learned my addr 172.21.15.70:0/3817383636 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f9147fff640 1 -- 172.21.15.70:0/3817383636 >> v1:172.21.15.70:6790/0 conn(0x7f91480ae0f0 legacy=0x7f91481dce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-06T06:51:23.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f9147fff640 1 -- 172.21.15.70:0/3817383636 >> v1:172.21.15.70:6790/0 conn(0x7f91480ae0f0 legacy=0x7f91481dce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T06:51:23.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f9147fff640 1 --1- 172.21.15.70:0/3817383636 >> v1:172.21.15.70:6790/0 conn(0x7f91480ae0f0 0x7f91481dce80 :-1 s=OPENED pgs=120 cs=1 l=1).handle_message read tag failed 2024-05-06T06:51:23.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f9147fff640 1 --1- 172.21.15.70:0/3817383636 >> v1:172.21.15.70:6790/0 conn(0x7f91480ae0f0 0x7f91481dce80 :-1 s=OPENED pgs=120 cs=1 l=1).fault on lossy channel, failing 2024-05-06T06:51:23.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f2c14088ff0 con 0x7f2c240aac90 2024-05-06T06:51:23.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194193301 0 0) 0x7f9138001080 con 0x7f91480aadf0 2024-05-06T06:51:23.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9134003530 con 0x7f91480aadf0 2024-05-06T06:51:23.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417008652 0 0) 0x7f9148142e50 con 0x7f91480abf00 2024-05-06T06:51:23.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9138001080 con 0x7f91480abf00 2024-05-06T06:51:23.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2906616525 0 0) 0x7f9134003530 con 0x7f91480aadf0 2024-05-06T06:51:23.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9148142e50 con 0x7f91480aadf0 2024-05-06T06:51:23.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f2c2886a640 1 -- 172.21.15.70:0/2400760327 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c240640c0 con 0x7f2c240aac90 2024-05-06T06:51:23.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1504193398 0 0) 0x7f9138001080 con 0x7f91480abf00 2024-05-06T06:51:23.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9134003530 con 0x7f91480abf00 2024-05-06T06:51:23.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f9138001a60 con 0x7f91480aadf0 2024-05-06T06:51:23.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f913c001220 con 0x7f91480abf00 2024-05-06T06:51:23.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1914360386 0 0) 0x7f9148142e50 con 0x7f91480aadf0 2024-05-06T06:51:23.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 >> v1:172.21.15.70:6790/0 conn(0x7f91480ae0f0 legacy=0x7f91481dce80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-06T06:51:23.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 >> v1:172.21.15.184:6789/0 conn(0x7f91480abf00 legacy=0x7f91480b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9148141710 con 0x7f91480aadf0 2024-05-06T06:51:23.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f914ce86640 1 -- 172.21.15.70:0/3817383636 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f91481e0930 con 0x7f91480aadf0 2024-05-06T06:51:23.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.662+0000 7f914ce86640 1 -- 172.21.15.70:0/3817383636 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9148141f70 con 0x7f91480aadf0 2024-05-06T06:51:23.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.666+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9138004aa0 con 0x7f91480aadf0 2024-05-06T06:51:23.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.666+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f9138004df0 con 0x7f91480aadf0 2024-05-06T06:51:23.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.666+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f913801bb90 con 0x7f91480aadf0 2024-05-06T06:51:23.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.670+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f913808a860 con 0x7f91480aadf0 2024-05-06T06:51:23.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.674+0000 7f914ce86640 1 -- 172.21.15.70:0/3817383636 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9128005090 con 0x7f91480aadf0 2024-05-06T06:51:23.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.674+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f2c14056450 con 0x7f2c240aac90 2024-05-06T06:51:23.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.682+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f9148142b70 con 0x7f91480aadf0 2024-05-06T06:51:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7effe4bac640 1 Processor -- start 2024-05-06T06:51:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7f8717fff640 1 Processor -- start 2024-05-06T06:51:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7f8717fff640 1 -- start start 2024-05-06T06:51:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7f8717fff640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87180ad070 con 0x7f87180aadf0 2024-05-06T06:51:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7f8717fff640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87180ad2e0 con 0x7f87180abf00 2024-05-06T06:51:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7f8717fff640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87180ad5c0 con 0x7f87180ae0f0 2024-05-06T06:51:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7effe4bac640 1 -- start start 2024-05-06T06:51:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7effe4bac640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd802b320 con 0x7effd8006a80 2024-05-06T06:51:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7effe4bac640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd802a310 con 0x7effd80cf8e0 2024-05-06T06:51:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7effe4bac640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd802c190 con 0x7effd8033090 2024-05-06T06:51:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7effdeffd640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7effd8033090 0x7effd80cf1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46240/0 (socket says 172.21.15.70:46240) 2024-05-06T06:51:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7effdeffd640 1 -- 172.21.15.70:0/3312951885 learned_addr learned my addr 172.21.15.70:0/3312951885 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7f87167fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f87180aadf0 0x7f87180ad9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60694/0 (socket says 172.21.15.70:60694) 2024-05-06T06:51:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.726+0000 7f87167fc640 1 -- 172.21.15.70:0/315714896 learned_addr learned my addr 172.21.15.70:0/315714896 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8715ffb640 1 -- 172.21.15.70:0/315714896 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239623471 0 0) 0x7f87180ad5c0 con 0x7f87180ae0f0 2024-05-06T06:51:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8715ffb640 1 -- 172.21.15.70:0/315714896 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8700003530 con 0x7f87180ae0f0 2024-05-06T06:51:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8715ffb640 1 -- 172.21.15.70:0/315714896 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766092736 0 0) 0x7f87180ad070 con 0x7f87180aadf0 2024-05-06T06:51:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8715ffb640 1 -- 172.21.15.70:0/315714896 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87180ad5c0 con 0x7f87180aadf0 2024-05-06T06:51:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8715ffb640 1 -- 172.21.15.70:0/315714896 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1166238802 0 0) 0x7f8700003530 con 0x7f87180ae0f0 2024-05-06T06:51:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8715ffb640 1 -- 172.21.15.70:0/315714896 >> v1:172.21.15.184:6789/0 conn(0x7f87180abf00 legacy=0x7f871813c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8715ffb640 1 -- 172.21.15.70:0/315714896 >> v1:172.21.15.70:6789/0 conn(0x7f87180aadf0 legacy=0x7f87180ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8715ffb640 1 -- 172.21.15.70:0/315714896 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87180b0ab0 con 0x7f87180ae0f0 2024-05-06T06:51:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8715ffb640 1 -- 172.21.15.70:0/315714896 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f87100019a0 con 0x7f87180ae0f0 2024-05-06T06:51:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8715ffb640 1 -- 172.21.15.70:0/315714896 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8710001c00 con 0x7f87180ae0f0 2024-05-06T06:51:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8715ffb640 1 -- 172.21.15.70:0/315714896 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f8710002010 con 0x7f87180ae0f0 2024-05-06T06:51:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8717fff640 1 -- 172.21.15.70:0/315714896 >> v1:172.21.15.70:6790/0 conn(0x7f87180ae0f0 legacy=0x7f871814abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8717fff640 1 -- 172.21.15.70:0/315714896 shutdown_connections 2024-05-06T06:51:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8717fff640 1 -- 172.21.15.70:0/315714896 >> 172.21.15.70:0/315714896 conn(0x7f87180b47a0 msgr2=0x7f87180b4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8717fff640 1 -- 172.21.15.70:0/315714896 shutdown_connections 2024-05-06T06:51:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8717fff640 1 -- 172.21.15.70:0/315714896 wait complete. 2024-05-06T06:51:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8717fff640 1 Processor -- start 2024-05-06T06:51:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.730+0000 7f8717fff640 1 -- start start 2024-05-06T06:51:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f8717fff640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87181c9bf0 con 0x7f87180ae0f0 2024-05-06T06:51:23.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f8717fff640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87181427c0 con 0x7f87180aadf0 2024-05-06T06:51:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f8717fff640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8718142990 con 0x7f87180abf00 2024-05-06T06:51:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f87177fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f87180ae0f0 0x7f87181e2510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60708/0 (socket says 172.21.15.70:60708) 2024-05-06T06:51:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f87177fe640 1 -- 172.21.15.70:0/3206298303 learned_addr learned my addr 172.21.15.70:0/3206298303 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193268540 0 0) 0x7f87181c9bf0 con 0x7f87180ae0f0 2024-05-06T06:51:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8704003530 con 0x7f87180ae0f0 2024-05-06T06:51:23.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910350529 0 0) 0x7f87181427c0 con 0x7f87180aadf0 2024-05-06T06:51:23.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87181c9bf0 con 0x7f87180aadf0 2024-05-06T06:51:23.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1383574251 0 0) 0x7effd802c190 con 0x7effd8033090 2024-05-06T06:51:23.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effd0003530 con 0x7effd8033090 2024-05-06T06:51:23.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 62481747 0 0) 0x7effd802a310 con 0x7effd80cf8e0 2024-05-06T06:51:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effd802c190 con 0x7effd80cf8e0 2024-05-06T06:51:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175884042 0 0) 0x7effd802b320 con 0x7effd8006a80 2024-05-06T06:51:23.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effd802a310 con 0x7effd8006a80 2024-05-06T06:51:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2049131240 0 0) 0x7f8704003530 con 0x7f87180ae0f0 2024-05-06T06:51:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87181427c0 con 0x7f87180ae0f0 2024-05-06T06:51:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f8710001f90 con 0x7f87180ae0f0 2024-05-06T06:51:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2037790494 0 0) 0x7f87181c9bf0 con 0x7f87180aadf0 2024-05-06T06:51:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8704003530 con 0x7f87180aadf0 2024-05-06T06:51:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f8708001940 con 0x7f87180aadf0 2024-05-06T06:51:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518687717 0 0) 0x7f8718142990 con 0x7f87180abf00 2024-05-06T06:51:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87181c9bf0 con 0x7f87180abf00 2024-05-06T06:51:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 675657521 0 0) 0x7f87181427c0 con 0x7f87180ae0f0 2024-05-06T06:51:23.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 >> v1:172.21.15.70:6790/0 conn(0x7f87180abf00 legacy=0x7f87181e5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 >> v1:172.21.15.184:6789/0 conn(0x7f87180aadf0 legacy=0x7f87181430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87181e6030 con 0x7f87180ae0f0 2024-05-06T06:51:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f8717fff640 1 -- 172.21.15.70:0/3206298303 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f87181ca280 con 0x7f87180ae0f0 2024-05-06T06:51:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.734+0000 7f8717fff640 1 -- 172.21.15.70:0/3206298303 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f87181e2df0 con 0x7f87180ae0f0 2024-05-06T06:51:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3460551044 0 0) 0x7effd0003530 con 0x7effd8033090 2024-05-06T06:51:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 >> v1:172.21.15.184:6789/0 conn(0x7effd80cf8e0 legacy=0x7effd80d7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 >> v1:172.21.15.70:6789/0 conn(0x7effd8006a80 legacy=0x7effd80c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd802c470 con 0x7effd8033090 2024-05-06T06:51:23.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7f8717fff640 1 -- 172.21.15.70:0/3206298303 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87180640c0 con 0x7f87180ae0f0 2024-05-06T06:51:23.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7effe006a600 con 0x7effd8033090 2024-05-06T06:51:23.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effe00516e0 con 0x7effd8033090 2024-05-06T06:51:23.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effde7fc640 1 -- 172.21.15.70:0/3312951885 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7effe0050fa0 con 0x7effd8033090 2024-05-06T06:51:23.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effe4bac640 1 -- 172.21.15.70:0/3312951885 >> v1:172.21.15.70:6790/0 conn(0x7effd8033090 legacy=0x7effd80cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effe4bac640 1 -- 172.21.15.70:0/3312951885 shutdown_connections 2024-05-06T06:51:23.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effe4bac640 1 -- 172.21.15.70:0/3312951885 >> 172.21.15.70:0/3312951885 conn(0x7effd8005900 msgr2=0x7effd8005d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:23.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effe4bac640 1 -- 172.21.15.70:0/3312951885 shutdown_connections 2024-05-06T06:51:23.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8710001be0 con 0x7f87180ae0f0 2024-05-06T06:51:23.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f8710003dd0 con 0x7f87180ae0f0 2024-05-06T06:51:23.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f8710004030 con 0x7f87180ae0f0 2024-05-06T06:51:23.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f871008a9c0 con 0x7f87180ae0f0 2024-05-06T06:51:23.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effe4bac640 1 -- 172.21.15.70:0/3312951885 wait complete. 2024-05-06T06:51:23.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effe4bac640 1 Processor -- start 2024-05-06T06:51:23.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.738+0000 7effe4bac640 1 -- start start 2024-05-06T06:51:23.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effe4bac640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd80cec60 con 0x7effd80cf8e0 2024-05-06T06:51:23.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effe4bac640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd80ca560 con 0x7effd8006a80 2024-05-06T06:51:23.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effe4bac640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd80ca730 con 0x7effd8033090 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effdeffd640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7effd8033090 0x7effd80cc4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46264/0 (socket says 172.21.15.70:46264) 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effdeffd640 1 -- 172.21.15.70:0/938933745 learned_addr learned my addr 172.21.15.70:0/938933745 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3569817508 0 0) 0x7effd80ca560 con 0x7effd8006a80 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effc4003530 con 0x7effd8006a80 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 418446052 0 0) 0x7effd80ca730 con 0x7effd8033090 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effd80ca560 con 0x7effd8033090 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 614284279 0 0) 0x7effc4003530 con 0x7effd8006a80 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effd80ca730 con 0x7effd8006a80 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7effd4001080 con 0x7effd8006a80 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 577871272 0 0) 0x7effd80ca560 con 0x7effd8033090 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effc4003530 con 0x7effd8033090 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7effe0050fa0 con 0x7effd8033090 2024-05-06T06:51:23.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.1 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3950033755 0 0) 0x7effd80ca730 con 0x7effd8006a80 2024-05-06T06:51:23.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 >> v1:172.21.15.70:6790/0 conn(0x7effd8033090 legacy=0x7effd80cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 >> v1:172.21.15.70:6789/0 conn(0x7effd80cf8e0 legacy=0x7effd816bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd80349e0 con 0x7effd8006a80 2024-05-06T06:51:23.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.1 v1:172.21.15.184:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effd4003600 con 0x7effd8006a80 2024-05-06T06:51:23.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.1 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7effd4003950 con 0x7effd8006a80 2024-05-06T06:51:23.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effe4bac640 1 -- 172.21.15.70:0/938933745 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7effd8034cd0 con 0x7effd8006a80 2024-05-06T06:51:23.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.742+0000 7effe4bac640 1 -- 172.21.15.70:0/938933745 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7effd80c9c40 con 0x7effd8006a80 2024-05-06T06:51:23.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.746+0000 7effe4bac640 1 -- 172.21.15.70:0/938933745 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd80cea50 con 0x7effd8006a80 2024-05-06T06:51:23.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.746+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.1 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7effd401a6f0 con 0x7effd8006a80 2024-05-06T06:51:23.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.746+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.1 v1:172.21.15.184:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7effd4089480 con 0x7effd8006a80 2024-05-06T06:51:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f8710057ea0 con 0x7f87180ae0f0 2024-05-06T06:51:23.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb68c32d640 1 Processor -- start 2024-05-06T06:51:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb68c32d640 1 -- start start 2024-05-06T06:51:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb68c32d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67c02c1a0 con 0x7fb67c0c8e80 2024-05-06T06:51:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb68c32d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67c02ac80 con 0x7fb67c006a80 2024-05-06T06:51:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb68c32d640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67c032a50 con 0x7fb67c02b0d0 2024-05-06T06:51:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb68b0cb640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb67c0c8e80 0x7fb67c0d7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60720/0 (socket says 172.21.15.70:60720) 2024-05-06T06:51:23.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb68b0cb640 1 -- 172.21.15.70:0/3971237391 learned_addr learned my addr 172.21.15.70:0/3971237391 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb6890c7640 1 -- 172.21.15.70:0/3971237391 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811399915 0 0) 0x7fb67c02c1a0 con 0x7fb67c0c8e80 2024-05-06T06:51:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb6890c7640 1 -- 172.21.15.70:0/3971237391 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb670003530 con 0x7fb67c0c8e80 2024-05-06T06:51:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb6890c7640 1 -- 172.21.15.70:0/3971237391 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3044464241 0 0) 0x7fb670003530 con 0x7fb67c0c8e80 2024-05-06T06:51:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb6890c7640 1 -- 172.21.15.70:0/3971237391 >> v1:172.21.15.70:6790/0 conn(0x7fb67c02b0d0 legacy=0x7fb67c02a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-06T06:51:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb6890c7640 1 -- 172.21.15.70:0/3971237391 >> v1:172.21.15.184:6789/0 conn(0x7fb67c006a80 legacy=0x7fb67c0cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb6890c7640 1 -- 172.21.15.70:0/3971237391 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c0c9310 con 0x7fb67c0c8e80 2024-05-06T06:51:23.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb6890c7640 1 -- 172.21.15.70:0/3971237391 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb6800015d0 con 0x7fb67c0c8e80 2024-05-06T06:51:23.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb6890c7640 1 -- 172.21.15.70:0/3971237391 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb680001920 con 0x7fb67c0c8e80 2024-05-06T06:51:23.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.750+0000 7fb6890c7640 1 -- 172.21.15.70:0/3971237391 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb680001d30 con 0x7fb67c0c8e80 2024-05-06T06:51:23.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.754+0000 7fb68c32d640 1 -- 172.21.15.70:0/3971237391 >> v1:172.21.15.70:6789/0 conn(0x7fb67c0c8e80 legacy=0x7fb67c0d7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.754+0000 7fb68c32d640 1 -- 172.21.15.70:0/3971237391 shutdown_connections 2024-05-06T06:51:23.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.754+0000 7fb68c32d640 1 -- 172.21.15.70:0/3971237391 >> 172.21.15.70:0/3971237391 conn(0x7fb67c005ad0 msgr2=0x7fb67c005ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:23.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.754+0000 7fb68c32d640 1 -- 172.21.15.70:0/3971237391 shutdown_connections 2024-05-06T06:51:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.754+0000 7fb68c32d640 1 -- 172.21.15.70:0/3971237391 wait complete. 2024-05-06T06:51:23.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.754+0000 7fb68c32d640 1 Processor -- start 2024-05-06T06:51:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.754+0000 7fb68c32d640 1 -- start start 2024-05-06T06:51:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb68a0c9640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fb67c006a80 0x7fb67c1698e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46280/0 (socket says 172.21.15.70:46280) 2024-05-06T06:51:23.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb6898c8640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb67c169ff0 0x7fb67c0c9a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60724/0 (socket says 172.21.15.70:60724) 2024-05-06T06:51:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb68a0c9640 1 -- 172.21.15.70:0/680960327 learned_addr learned my addr 172.21.15.70:0/680960327 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67c0cdfc0 con 0x7fb67c169ff0 2024-05-06T06:51:23.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2230589965 0 0) 0x7fb67c0cdfc0 con 0x7fb67c169ff0 2024-05-06T06:51:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67c0ce2a0 con 0x7fb67c0ccef0 2024-05-06T06:51:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb67c0351c0 con 0x7fb67c006a80 2024-05-06T06:51:23.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.1 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7effd40568e0 con 0x7effd8006a80 2024-05-06T06:51:23.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb668003530 con 0x7fb67c169ff0 2024-05-06T06:51:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314494155 0 0) 0x7fb67c0351c0 con 0x7fb67c006a80 2024-05-06T06:51:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb67c0cdfc0 con 0x7fb67c006a80 2024-05-06T06:51:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1845221694 0 0) 0x7fb67c0cdfc0 con 0x7fb67c006a80 2024-05-06T06:51:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb67c0351c0 con 0x7fb67c006a80 2024-05-06T06:51:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb68406a600 con 0x7fb67c006a80 2024-05-06T06:51:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3713709163 0 0) 0x7fb67c0351c0 con 0x7fb67c006a80 2024-05-06T06:51:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 >> v1:172.21.15.184:6789/0 conn(0x7fb67c0ccef0 legacy=0x7fb67c0ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 >> v1:172.21.15.70:6789/0 conn(0x7fb67c169ff0 legacy=0x7fb67c0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67c035390 con 0x7fb67c006a80 2024-05-06T06:51:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb684050cc0 con 0x7fb67c006a80 2024-05-06T06:51:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb684050fa0 con 0x7fb67c006a80 2024-05-06T06:51:23.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.758+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb67c175bb0 con 0x7fb67c006a80 2024-05-06T06:51:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.762+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fb684069720 con 0x7fb67c006a80 2024-05-06T06:51:23.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.762+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb67c175f50 con 0x7fb67c006a80 2024-05-06T06:51:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.762+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7fb6840cf6e0 con 0x7fb67c006a80 2024-05-06T06:51:23.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.766+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb67c035560 con 0x7fb67c006a80 2024-05-06T06:51:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.774+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fb6840d3880 con 0x7fb67c006a80 2024-05-06T06:51:23.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.778+0000 7fd9d9b79640 1 Processor -- start 2024-05-06T06:51:23.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.778+0000 7fd9d9b79640 1 -- start start 2024-05-06T06:51:23.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.778+0000 7fd9d9b79640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9d4071db0 con 0x7fd9d40b37d0 2024-05-06T06:51:23.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.778+0000 7fd9d9b79640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9d406f5e0 con 0x7fd9d40b53b0 2024-05-06T06:51:23.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.778+0000 7fd9d9b79640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9d4153d80 con 0x7fd9d4070890 2024-05-06T06:51:23.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.778+0000 7fd9d37fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd9d40b37d0 0x7fd9d4153670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60740/0 (socket says 172.21.15.70:60740) 2024-05-06T06:51:23.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.778+0000 7fd9d37fe640 1 -- 172.21.15.70:0/1435832973 learned_addr learned my addr 172.21.15.70:0/1435832973 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d27fc640 1 -- 172.21.15.70:0/1435832973 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699455709 0 0) 0x7fd9d4071db0 con 0x7fd9d40b37d0 2024-05-06T06:51:23.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d27fc640 1 -- 172.21.15.70:0/1435832973 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9bc003530 con 0x7fd9d40b37d0 2024-05-06T06:51:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d27fc640 1 -- 172.21.15.70:0/1435832973 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216362422 0 0) 0x7fd9d406f5e0 con 0x7fd9d40b53b0 2024-05-06T06:51:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d27fc640 1 -- 172.21.15.70:0/1435832973 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9d4071db0 con 0x7fd9d40b53b0 2024-05-06T06:51:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d27fc640 1 -- 172.21.15.70:0/1435832973 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2888129870 0 0) 0x7fd9bc003530 con 0x7fd9d40b37d0 2024-05-06T06:51:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d27fc640 1 -- 172.21.15.70:0/1435832973 >> v1:172.21.15.70:6790/0 conn(0x7fd9d4070890 legacy=0x7fd9d415bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d27fc640 1 -- 172.21.15.70:0/1435832973 >> v1:172.21.15.184:6789/0 conn(0x7fd9d40b53b0 legacy=0x7fd9d4070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d27fc640 1 -- 172.21.15.70:0/1435832973 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d40b3bb0 con 0x7fd9d40b37d0 2024-05-06T06:51:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d27fc640 1 -- 172.21.15.70:0/1435832973 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd9c40016a0 con 0x7fd9d40b37d0 2024-05-06T06:51:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d27fc640 1 -- 172.21.15.70:0/1435832973 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9c4001840 con 0x7fd9d40b37d0 2024-05-06T06:51:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d27fc640 1 -- 172.21.15.70:0/1435832973 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd9c4001c90 con 0x7fd9d40b37d0 2024-05-06T06:51:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d9b79640 1 -- 172.21.15.70:0/1435832973 >> v1:172.21.15.70:6789/0 conn(0x7fd9d40b37d0 legacy=0x7fd9d4153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d9b79640 1 -- 172.21.15.70:0/1435832973 shutdown_connections 2024-05-06T06:51:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d9b79640 1 -- 172.21.15.70:0/1435832973 >> 172.21.15.70:0/1435832973 conn(0x7fd9d40b4710 msgr2=0x7fd9d40b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d9b79640 1 -- 172.21.15.70:0/1435832973 shutdown_connections 2024-05-06T06:51:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d9b79640 1 -- 172.21.15.70:0/1435832973 wait complete. 2024-05-06T06:51:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fbb75f02640 1 Processor -- start 2024-05-06T06:51:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d9b79640 1 Processor -- start 2024-05-06T06:51:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fd9d9b79640 1 -- start start 2024-05-06T06:51:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9d9b79640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9d41427f0 con 0x7fd9d40b53b0 2024-05-06T06:51:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9d9b79640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9d4142ad0 con 0x7fd9d4070890 2024-05-06T06:51:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9d9b79640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9d4140940 con 0x7fd9d40b37d0 2024-05-06T06:51:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9d2ffd640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fd9d40b37d0 0x7fd9d413ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46308/0 (socket says 172.21.15.70:46308) 2024-05-06T06:51:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9d2ffd640 1 -- 172.21.15.70:0/3968201069 learned_addr learned my addr 172.21.15.70:0/3968201069 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.782+0000 7fbb75f02640 1 -- start start 2024-05-06T06:51:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fbb75f02640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb700b0690 con 0x7fbb70070080 2024-05-06T06:51:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fbb75f02640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb70140390 con 0x7fbb70070f40 2024-05-06T06:51:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fbb75f02640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb70071940 con 0x7fbb700b02b0 2024-05-06T06:51:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fbb6ffff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fbb70070080 0x7fbb70070830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60756/0 (socket says 172.21.15.70:60756) 2024-05-06T06:51:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fbb6ffff640 1 -- 172.21.15.70:0/980861066 learned_addr learned my addr 172.21.15.70:0/980861066 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479191408 0 0) 0x7fd9d4140940 con 0x7fd9d40b37d0 2024-05-06T06:51:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9c0003530 con 0x7fd9d40b37d0 2024-05-06T06:51:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4091387246 0 0) 0x7fd9d41427f0 con 0x7fd9d40b53b0 2024-05-06T06:51:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9d4140940 con 0x7fd9d40b53b0 2024-05-06T06:51:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 486691973 0 0) 0x7fd9d4142ad0 con 0x7fd9d4070890 2024-05-06T06:51:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9d41427f0 con 0x7fd9d4070890 2024-05-06T06:51:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2556377549 0 0) 0x7fd9c0003530 con 0x7fd9d40b37d0 2024-05-06T06:51:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9d4142ad0 con 0x7fd9d40b37d0 2024-05-06T06:51:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2754455760 0 0) 0x7fd9d4140940 con 0x7fd9d40b53b0 2024-05-06T06:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9c0003530 con 0x7fd9d40b53b0 2024-05-06T06:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd9cc001c40 con 0x7fd9d40b37d0 2024-05-06T06:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd9c8001770 con 0x7fd9d40b53b0 2024-05-06T06:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2412930037 0 0) 0x7fd9d41427f0 con 0x7fd9d4070890 2024-05-06T06:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9d4140940 con 0x7fd9d4070890 2024-05-06T06:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2153695322 0 0) 0x7fd9d4142ad0 con 0x7fd9d40b37d0 2024-05-06T06:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 >> v1:172.21.15.184:6789/0 conn(0x7fd9d4070890 legacy=0x7fd9d413e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 >> v1:172.21.15.70:6789/0 conn(0x7fd9d40b53b0 legacy=0x7fd9d41f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d4140b10 con 0x7fd9d40b37d0 2024-05-06T06:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9d9b79640 1 -- 172.21.15.70:0/3968201069 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d4141390 con 0x7fd9d40b37d0 2024-05-06T06:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.786+0000 7fd9d9b79640 1 -- 172.21.15.70:0/3968201069 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd9d41f3770 con 0x7fd9d40b37d0 2024-05-06T06:51:23.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.790+0000 7fd9d9b79640 1 -- 172.21.15.70:0/3968201069 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d40640c0 con 0x7fd9d40b37d0 2024-05-06T06:51:23.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/980861066 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766307619 0 0) 0x7fbb700b0690 con 0x7fbb70070080 2024-05-06T06:51:23.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9cc0039a0 con 0x7fd9d40b37d0 2024-05-06T06:51:23.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/980861066 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb58003530 con 0x7fbb70070080 2024-05-06T06:51:23.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/980861066 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419376224 0 0) 0x7fbb70140390 con 0x7fbb70070f40 2024-05-06T06:51:23.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd9cc003d30 con 0x7fd9d40b37d0 2024-05-06T06:51:23.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fd9cc003f90 con 0x7fd9d40b37d0 2024-05-06T06:51:23.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/980861066 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb700b0690 con 0x7fbb70070f40 2024-05-06T06:51:23.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/980861066 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3633338264 0 0) 0x7fbb58003530 con 0x7fbb70070080 2024-05-06T06:51:23.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/980861066 >> v1:172.21.15.70:6790/0 conn(0x7fbb700b02b0 legacy=0x7fbb7013fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-06T06:51:23.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/980861066 >> v1:172.21.15.184:6789/0 conn(0x7fbb70070f40 legacy=0x7fbb7014ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/980861066 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb70071c20 con 0x7fbb70070080 2024-05-06T06:51:23.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/980861066 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbb600016a0 con 0x7fbb70070080 2024-05-06T06:51:23.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/980861066 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb60001840 con 0x7fbb70070080 2024-05-06T06:51:23.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb75f02640 1 -- 172.21.15.70:0/980861066 >> v1:172.21.15.70:6789/0 conn(0x7fbb70070080 legacy=0x7fbb70070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb75f02640 1 -- 172.21.15.70:0/980861066 shutdown_connections 2024-05-06T06:51:23.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.798+0000 7fbb75f02640 1 -- 172.21.15.70:0/980861066 >> 172.21.15.70:0/980861066 conn(0x7fbb700b11d0 msgr2=0x7fbb700b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:23.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.802+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7fd9cc08a970 con 0x7fd9d40b37d0 2024-05-06T06:51:23.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.802+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fd9cc08aca0 con 0x7fd9d40b37d0 2024-05-06T06:51:23.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.802+0000 7fbb75f02640 1 -- 172.21.15.70:0/980861066 shutdown_connections 2024-05-06T06:51:23.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.802+0000 7fbb75f02640 1 -- 172.21.15.70:0/980861066 wait complete. 2024-05-06T06:51:23.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb75f02640 1 Processor -- start 2024-05-06T06:51:23.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb75f02640 1 -- start start 2024-05-06T06:51:23.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb75f02640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb7013a1f0 con 0x7fbb70070f40 2024-05-06T06:51:23.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb75f02640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb700ab3e0 con 0x7fbb701c8f90 2024-05-06T06:51:23.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb75f02640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb700ab6c0 con 0x7fbb700aa460 2024-05-06T06:51:23.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb74f00640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fbb70070f40 0x7fbb701c58b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60768/0 (socket says 172.21.15.70:60768) 2024-05-06T06:51:23.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6ffff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fbb700aa460 0x7fbb701393d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46320/0 (socket says 172.21.15.70:46320) 2024-05-06T06:51:23.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb74f00640 1 -- 172.21.15.70:0/3251841069 learned_addr learned my addr 172.21.15.70:0/3251841069 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:23.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215201233 0 0) 0x7fbb7013a1f0 con 0x7fbb70070f40 2024-05-06T06:51:23.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb5c003530 con 0x7fbb70070f40 2024-05-06T06:51:23.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204454465 0 0) 0x7fbb700ab3e0 con 0x7fbb701c8f90 2024-05-06T06:51:23.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb7013a1f0 con 0x7fbb701c8f90 2024-05-06T06:51:23.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3646092081 0 0) 0x7fbb5c003530 con 0x7fbb70070f40 2024-05-06T06:51:23.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb700ab3e0 con 0x7fbb70070f40 2024-05-06T06:51:23.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060454594 0 0) 0x7fbb700ab6c0 con 0x7fbb700aa460 2024-05-06T06:51:23.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb5c003530 con 0x7fbb700aa460 2024-05-06T06:51:23.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbb64003eb0 con 0x7fbb70070f40 2024-05-06T06:51:23.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3469987330 0 0) 0x7fbb7013a1f0 con 0x7fbb701c8f90 2024-05-06T06:51:23.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb700ab6c0 con 0x7fbb701c8f90 2024-05-06T06:51:23.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 858612489 0 0) 0x7fbb700ab3e0 con 0x7fbb70070f40 2024-05-06T06:51:23.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.806+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 >> v1:172.21.15.70:6790/0 conn(0x7fbb700aa460 legacy=0x7fbb701393d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.810+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 >> v1:172.21.15.184:6789/0 conn(0x7fbb701c8f90 legacy=0x7fbb70139ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.810+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7013a520 con 0x7fbb70070f40 2024-05-06T06:51:23.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.810+0000 7fbb75f02640 1 -- 172.21.15.70:0/3251841069 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb701c8720 con 0x7fbb70070f40 2024-05-06T06:51:23.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.810+0000 7fbb75f02640 1 -- 172.21.15.70:0/3251841069 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb700b3390 con 0x7fbb70070f40 2024-05-06T06:51:23.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.814+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb64000ee0 con 0x7fbb70070f40 2024-05-06T06:51:23.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.814+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbb64001110 con 0x7fbb70070f40 2024-05-06T06:51:23.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.814+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fbb64001370 con 0x7fbb70070f40 2024-05-06T06:51:23.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.814+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7fbb6408a530 con 0x7fbb70070f40 2024-05-06T06:51:23.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.814+0000 7fbb75f02640 1 -- 172.21.15.70:0/3251841069 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb50005090 con 0x7fbb70070f40 2024-05-06T06:51:23.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.822+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fbb64057a10 con 0x7fbb70070f40 2024-05-06T06:51:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.934+0000 7f13e667d640 1 -- 172.21.15.70:0/2940320351 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f13e00008e0 con 0x7f13e0070080 2024-05-06T06:51:23.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.934+0000 7f13d5ffb640 1 -- 172.21.15.70:0/2940320351 <== mon.2 v1:172.21.15.70:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 13373408) 0x7f13dc056000 con 0x7f13e0070080 2024-05-06T06:51:23.937 INFO:teuthology.orchestra.run.smithi070.stdout:60129542147 2024-05-06T06:51:23.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.938+0000 7f13cb7fe640 1 -- 172.21.15.70:0/2940320351 >> v1:172.21.15.70:6816/2757942729 conn(0x7f13cc070450 legacy=0x7f13cc072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.938+0000 7f13cb7fe640 1 -- 172.21.15.70:0/2940320351 >> v1:172.21.15.70:6790/0 conn(0x7f13e0070080 legacy=0x7f13e01e0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.938+0000 7f13cb7fe640 1 -- 172.21.15.70:0/2940320351 shutdown_connections 2024-05-06T06:51:23.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.938+0000 7f13cb7fe640 1 -- 172.21.15.70:0/2940320351 >> 172.21.15.70:0/2940320351 conn(0x7f13e00b11d0 msgr2=0x7f13e00b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.938+0000 7f13cb7fe640 1 -- 172.21.15.70:0/2940320351 shutdown_connections 2024-05-06T06:51:23.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.938+0000 7f13cb7fe640 1 -- 172.21.15.70:0/2940320351 wait complete. 2024-05-06T06:51:23.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.3 2024-05-06T06:51:23.961 DEBUG:teuthology.parallel:result is None 2024-05-06T06:51:23.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.990+0000 7f2c2886a640 1 -- 172.21.15.70:0/2400760327 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2c240699d0 con 0x7f2c240aac90 2024-05-06T06:51:23.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.990+0000 7f2c12ffd640 1 -- 172.21.15.70:0/2400760327 <== mon.2 v1:172.21.15.70:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 2194451396) 0x7f2c14055d50 con 0x7f2c240aac90 2024-05-06T06:51:23.991 INFO:teuthology.orchestra.run.smithi070.stdout:55834574851 2024-05-06T06:51:23.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.994+0000 7f2c2886a640 1 -- 172.21.15.70:0/2400760327 >> v1:172.21.15.70:6816/2757942729 conn(0x7f2c040703a0 legacy=0x7f2c04072860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.994+0000 7f2c2886a640 1 -- 172.21.15.70:0/2400760327 >> v1:172.21.15.70:6790/0 conn(0x7f2c240aac90 legacy=0x7f2c241e50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:23.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.994+0000 7f2c2886a640 1 -- 172.21.15.70:0/2400760327 shutdown_connections 2024-05-06T06:51:23.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.994+0000 7f2c2886a640 1 -- 172.21.15.70:0/2400760327 >> 172.21.15.70:0/2400760327 conn(0x7f2c240b4ad0 msgr2=0x7f2c240af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:23.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.994+0000 7f2c2886a640 1 -- 172.21.15.70:0/2400760327 shutdown_connections 2024-05-06T06:51:23.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:23.994+0000 7f2c2886a640 1 -- 172.21.15.70:0/2400760327 wait complete. 2024-05-06T06:51:24.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.014+0000 7f914ce86640 1 -- 172.21.15.70:0/3817383636 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9128005380 con 0x7f91480aadf0 2024-05-06T06:51:24.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.014+0000 7f912ffff640 1 -- 172.21.15.70:0/3817383636 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 326014871) 0x7f9138057d40 con 0x7f91480aadf0 2024-05-06T06:51:24.014 INFO:teuthology.orchestra.run.smithi070.stdout:60129542146 2024-05-06T06:51:24.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.0 2024-05-06T06:51:24.016 DEBUG:teuthology.parallel:result is None 2024-05-06T06:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.018+0000 7f914ce86640 1 -- 172.21.15.70:0/3817383636 >> v1:172.21.15.70:6816/2757942729 conn(0x7f9134070250 legacy=0x7f9134072710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.018+0000 7f914ce86640 1 -- 172.21.15.70:0/3817383636 >> v1:172.21.15.70:6789/0 conn(0x7f91480aadf0 legacy=0x7f91481e0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.018+0000 7f914ce86640 1 -- 172.21.15.70:0/3817383636 shutdown_connections 2024-05-06T06:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.018+0000 7f914ce86640 1 -- 172.21.15.70:0/3817383636 >> 172.21.15.70:0/3817383636 conn(0x7f91480b47a0 msgr2=0x7f91481360d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.018+0000 7f914ce86640 1 -- 172.21.15.70:0/3817383636 shutdown_connections 2024-05-06T06:51:24.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.018+0000 7f914ce86640 1 -- 172.21.15.70:0/3817383636 wait complete. 2024-05-06T06:51:24.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.022+0000 7f8717fff640 1 -- 172.21.15.70:0/3206298303 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f87180aee80 con 0x7f87180ae0f0 2024-05-06T06:51:24.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.022+0000 7f86ff7fe640 1 -- 172.21.15.70:0/3206298303 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 326014871) 0x7f87100577a0 con 0x7f87180ae0f0 2024-05-06T06:51:24.022 INFO:teuthology.orchestra.run.smithi070.stdout:60129542146 2024-05-06T06:51:24.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.022+0000 7f8717fff640 1 -- 172.21.15.70:0/3206298303 >> v1:172.21.15.70:6816/2757942729 conn(0x7f87040701f0 legacy=0x7f87040726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.022+0000 7f8717fff640 1 -- 172.21.15.70:0/3206298303 >> v1:172.21.15.70:6789/0 conn(0x7f87180ae0f0 legacy=0x7f87181e2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.022+0000 7f8717fff640 1 -- 172.21.15.70:0/3206298303 shutdown_connections 2024-05-06T06:51:24.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.022+0000 7f8717fff640 1 -- 172.21.15.70:0/3206298303 >> 172.21.15.70:0/3206298303 conn(0x7f87180b47a0 msgr2=0x7f87181cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:24.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.022+0000 7f8717fff640 1 -- 172.21.15.70:0/3206298303 shutdown_connections 2024-05-06T06:51:24.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.022+0000 7f8717fff640 1 -- 172.21.15.70:0/3206298303 wait complete. 2024-05-06T06:51:24.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542146 for osd.1 2024-05-06T06:51:24.041 DEBUG:teuthology.parallel:result is None 2024-05-06T06:51:24.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542146 for osd.6 2024-05-06T06:51:24.043 DEBUG:teuthology.parallel:result is None 2024-05-06T06:51:24.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.058+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb67c004eb0 con 0x7fb67c006a80 2024-05-06T06:51:24.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.058+0000 7fb67affd640 1 -- 172.21.15.70:0/680960327 <== mon.2 v1:172.21.15.70:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 326014871) 0x7fb6840d3180 con 0x7fb67c006a80 2024-05-06T06:51:24.058 INFO:teuthology.orchestra.run.smithi070.stdout:60129542146 2024-05-06T06:51:24.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.058+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 >> v1:172.21.15.70:6816/2757942729 conn(0x7fb668070030 legacy=0x7fb6680724f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.058+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 >> v1:172.21.15.70:6790/0 conn(0x7fb67c006a80 legacy=0x7fb67c1698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.058+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 shutdown_connections 2024-05-06T06:51:24.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.058+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 >> 172.21.15.70:0/680960327 conn(0x7fb67c005ad0 msgr2=0x7fb67c0c82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:24.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.058+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 shutdown_connections 2024-05-06T06:51:24.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.058+0000 7fb68c32d640 1 -- 172.21.15.70:0/680960327 wait complete. 2024-05-06T06:51:24.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542146 for osd.2 2024-05-06T06:51:24.075 DEBUG:teuthology.parallel:result is None 2024-05-06T06:51:24.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.086+0000 7effe4bac640 1 -- 172.21.15.70:0/938933745 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7effd8004ce0 con 0x7effd8006a80 2024-05-06T06:51:24.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.086+0000 7effcbfff640 1 -- 172.21.15.70:0/938933745 <== mon.1 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 13373408) 0x7effd40561e0 con 0x7effd8006a80 2024-05-06T06:51:24.088 INFO:teuthology.orchestra.run.smithi070.stdout:60129542147 2024-05-06T06:51:24.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.090+0000 7effe4bac640 1 -- 172.21.15.70:0/938933745 >> v1:172.21.15.70:6816/2757942729 conn(0x7effc4070140 legacy=0x7effc4072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.090+0000 7effe4bac640 1 -- 172.21.15.70:0/938933745 >> v1:172.21.15.184:6789/0 conn(0x7effd8006a80 legacy=0x7effd80cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.090+0000 7effe4bac640 1 -- 172.21.15.70:0/938933745 shutdown_connections 2024-05-06T06:51:24.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.090+0000 7effe4bac640 1 -- 172.21.15.70:0/938933745 >> 172.21.15.70:0/938933745 conn(0x7effd8005900 msgr2=0x7effd80c8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:24.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.090+0000 7effe4bac640 1 -- 172.21.15.70:0/938933745 shutdown_connections 2024-05-06T06:51:24.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.090+0000 7effe4bac640 1 -- 172.21.15.70:0/938933745 wait complete. 2024-05-06T06:51:24.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.090+0000 7fbb75f02640 1 -- 172.21.15.70:0/3251841069 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbb50005380 con 0x7fbb70070f40 2024-05-06T06:51:24.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.090+0000 7fbb6d7fa640 1 -- 172.21.15.70:0/3251841069 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 1136574001) 0x7fbb64057310 con 0x7fbb70070f40 2024-05-06T06:51:24.093 INFO:teuthology.orchestra.run.smithi070.stdout:64424509443 2024-05-06T06:51:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.094+0000 7fbb75f02640 1 -- 172.21.15.70:0/3251841069 >> v1:172.21.15.70:6816/2757942729 conn(0x7fbb5c0703d0 legacy=0x7fbb5c072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.094+0000 7fbb75f02640 1 -- 172.21.15.70:0/3251841069 >> v1:172.21.15.70:6789/0 conn(0x7fbb70070f40 legacy=0x7fbb701c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.094+0000 7fbb75f02640 1 -- 172.21.15.70:0/3251841069 shutdown_connections 2024-05-06T06:51:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.094+0000 7fbb75f02640 1 -- 172.21.15.70:0/3251841069 >> 172.21.15.70:0/3251841069 conn(0x7fbb700b11d0 msgr2=0x7fbb7013fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:24.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.094+0000 7fbb75f02640 1 -- 172.21.15.70:0/3251841069 shutdown_connections 2024-05-06T06:51:24.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.094+0000 7fbb75f02640 1 -- 172.21.15.70:0/3251841069 wait complete. 2024-05-06T06:51:24.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.106+0000 7fd9d9b79640 1 -- 172.21.15.70:0/3968201069 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd9d41418f0 con 0x7fd9d40b37d0 2024-05-06T06:51:24.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.106+0000 7fd9bbfff640 1 -- 172.21.15.70:0/3968201069 <== mon.2 v1:172.21.15.70:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 1136574001) 0x7fd9cc057e50 con 0x7fd9d40b37d0 2024-05-06T06:51:24.106 INFO:teuthology.orchestra.run.smithi070.stdout:64424509443 2024-05-06T06:51:24.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.5 2024-05-06T06:51:24.108 DEBUG:teuthology.parallel:result is None 2024-05-06T06:51:24.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.106+0000 7fd9d9b79640 1 -- 172.21.15.70:0/3968201069 >> v1:172.21.15.70:6816/2757942729 conn(0x7fd9c00706a0 legacy=0x7fd9c0072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.106+0000 7fd9d9b79640 1 -- 172.21.15.70:0/3968201069 >> v1:172.21.15.70:6790/0 conn(0x7fd9d40b37d0 legacy=0x7fd9d413ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.106+0000 7fd9d9b79640 1 -- 172.21.15.70:0/3968201069 shutdown_connections 2024-05-06T06:51:24.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.106+0000 7fd9d9b79640 1 -- 172.21.15.70:0/3968201069 >> 172.21.15.70:0/3968201069 conn(0x7fd9d40b4710 msgr2=0x7fd9d40b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:24.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.106+0000 7fd9d9b79640 1 -- 172.21.15.70:0/3968201069 shutdown_connections 2024-05-06T06:51:24.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.106+0000 7fd9d9b79640 1 -- 172.21.15.70:0/3968201069 wait complete. 2024-05-06T06:51:24.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.4 2024-05-06T06:51:24.111 DEBUG:teuthology.parallel:result is None 2024-05-06T06:51:24.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509443 got 64424509443 for osd.7 2024-05-06T06:51:24.123 DEBUG:teuthology.parallel:result is None 2024-05-06T06:51:24.123 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-06T06:51:24.123 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-06T06:51:24.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.262+0000 7f9a2f9b4640 1 Processor -- start 2024-05-06T06:51:24.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.262+0000 7f9a2f9b4640 1 -- start start 2024-05-06T06:51:24.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a28073240 con 0x7f9a28144920 2024-05-06T06:51:24.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a280afe80 con 0x7f9a28145270 2024-05-06T06:51:24.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a28073fc0 con 0x7f9a280af0c0 2024-05-06T06:51:24.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2d750640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f9a28144920 0x7f9a280af770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60782/0 (socket says 172.21.15.70:60782) 2024-05-06T06:51:24.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2df51640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f9a280af0c0 0x7f9a2814ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46326/0 (socket says 172.21.15.70:46326) 2024-05-06T06:51:24.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2d750640 1 -- 172.21.15.70:0/437612571 learned_addr learned my addr 172.21.15.70:0/437612571 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:24.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1ffff640 1 -- 172.21.15.70:0/437612571 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 915577389 0 0) 0x7f9a28073fc0 con 0x7f9a280af0c0 2024-05-06T06:51:24.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1ffff640 1 -- 172.21.15.70:0/437612571 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a14003530 con 0x7f9a280af0c0 2024-05-06T06:51:24.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1ffff640 1 -- 172.21.15.70:0/437612571 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4225613305 0 0) 0x7f9a28073240 con 0x7f9a28144920 2024-05-06T06:51:24.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1ffff640 1 -- 172.21.15.70:0/437612571 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a28073fc0 con 0x7f9a28144920 2024-05-06T06:51:24.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2cf4f640 1 -- 172.21.15.70:0/437612571 >> v1:172.21.15.184:6789/0 conn(0x7f9a28145270 legacy=0x7f9a280ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-06T06:51:24.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2cf4f640 1 -- 172.21.15.70:0/437612571 >> v1:172.21.15.184:6789/0 conn(0x7f9a28145270 legacy=0x7f9a280ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-06T06:51:24.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2cf4f640 1 --1- 172.21.15.70:0/437612571 >> v1:172.21.15.184:6789/0 conn(0x7f9a28145270 0x7f9a280ae9b0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2024-05-06T06:51:24.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1ffff640 1 -- 172.21.15.70:0/437612571 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3457505463 0 0) 0x7f9a14003530 con 0x7f9a280af0c0 2024-05-06T06:51:24.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1ffff640 1 -- 172.21.15.70:0/437612571 >> v1:172.21.15.184:6789/0 conn(0x7f9a28145270 legacy=0x7f9a280ae9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-06T06:51:24.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1ffff640 1 -- 172.21.15.70:0/437612571 >> v1:172.21.15.70:6789/0 conn(0x7f9a28144920 legacy=0x7f9a280af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1ffff640 1 -- 172.21.15.70:0/437612571 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a280742a0 con 0x7f9a280af0c0 2024-05-06T06:51:24.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1ffff640 1 -- 172.21.15.70:0/437612571 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f9a20001a20 con 0x7f9a280af0c0 2024-05-06T06:51:24.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1ffff640 1 -- 172.21.15.70:0/437612571 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a20001c40 con 0x7f9a280af0c0 2024-05-06T06:51:24.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1ffff640 1 -- 172.21.15.70:0/437612571 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f9a20002010 con 0x7f9a280af0c0 2024-05-06T06:51:24.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/437612571 >> v1:172.21.15.70:6790/0 conn(0x7f9a280af0c0 legacy=0x7f9a2814ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/437612571 shutdown_connections 2024-05-06T06:51:24.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/437612571 >> 172.21.15.70:0/437612571 conn(0x7f9a280b4d70 msgr2=0x7f9a280b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:24.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/437612571 shutdown_connections 2024-05-06T06:51:24.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/437612571 wait complete. 2024-05-06T06:51:24.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 Processor -- start 2024-05-06T06:51:24.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- start start 2024-05-06T06:51:24.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a28139dc0 con 0x7f9a28144920 2024-05-06T06:51:24.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a281d6f90 con 0x7f9a28145270 2024-05-06T06:51:24.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a281d7160 con 0x7f9a280af0c0 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2d750640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f9a280af0c0 0x7f9a2813e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46342/0 (socket says 172.21.15.70:46342) 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2d750640 1 -- 172.21.15.70:0/3098759395 learned_addr learned my addr 172.21.15.70:0/3098759395 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3966642956 0 0) 0x7f9a281d7160 con 0x7f9a280af0c0 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a0c003530 con 0x7f9a280af0c0 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473136607 0 0) 0x7f9a28139dc0 con 0x7f9a28144920 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a281d7160 con 0x7f9a28144920 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3162920988 0 0) 0x7f9a0c003530 con 0x7f9a280af0c0 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a28139dc0 con 0x7f9a280af0c0 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f9a24001980 con 0x7f9a280af0c0 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1722557249 0 0) 0x7f9a281d7160 con 0x7f9a28144920 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a0c003530 con 0x7f9a28144920 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f9a18003f60 con 0x7f9a28144920 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 407721889 0 0) 0x7f9a28139dc0 con 0x7f9a280af0c0 2024-05-06T06:51:24.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 >> v1:172.21.15.184:6789/0 conn(0x7f9a28145270 legacy=0x7f9a28138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 >> v1:172.21.15.70:6789/0 conn(0x7f9a28144920 legacy=0x7f9a281d6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2814d6b0 con 0x7f9a280af0c0 2024-05-06T06:51:24.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/3098759395 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a2814d960 con 0x7f9a280af0c0 2024-05-06T06:51:24.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.266+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/3098759395 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a28139840 con 0x7f9a280af0c0 2024-05-06T06:51:24.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.270+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a240047f0 con 0x7f9a280af0c0 2024-05-06T06:51:24.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.270+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f9a24004b40 con 0x7f9a280af0c0 2024-05-06T06:51:24.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.270+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/3098759395 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a08005090 con 0x7f9a280af0c0 2024-05-06T06:51:24.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.270+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f9a2401b8e0 con 0x7f9a280af0c0 2024-05-06T06:51:24.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.270+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f9a2408a6c0 con 0x7f9a280af0c0 2024-05-06T06:51:24.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.274+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f9a24057b20 con 0x7f9a280af0c0 2024-05-06T06:51:24.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.418+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/3098759395 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a08000ba0 con 0x7f9a0c06ffa0 2024-05-06T06:51:24.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.422+0000 7f9a1dffb640 1 -- 172.21.15.70:0/3098759395 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+35485 (unknown 2965378022 0 4151147711) 0x7f9a08000ba0 con 0x7f9a0c06ffa0 2024-05-06T06:51:24.422 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:51:24.422 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-06T06:51:24.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.422+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/3098759395 >> v1:172.21.15.70:6816/2757942729 conn(0x7f9a0c06ffa0 legacy=0x7f9a0c072460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.422+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/3098759395 >> v1:172.21.15.70:6790/0 conn(0x7f9a280af0c0 legacy=0x7f9a2813e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.422+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/3098759395 shutdown_connections 2024-05-06T06:51:24.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.422+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/3098759395 >> 172.21.15.70:0/3098759395 conn(0x7f9a280b4d70 msgr2=0x7f9a280af670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:24.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.422+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/3098759395 shutdown_connections 2024-05-06T06:51:24.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.422+0000 7f9a2f9b4640 1 -- 172.21.15.70:0/3098759395 wait complete. 2024-05-06T06:51:24.438 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-05-06T06:51:22.590368+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":222784,"kb_used_data":2192,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751936,"statfs":{"total":773094113280,"available":772865982464,"internally_reserved":0,"allocated":2244608,"data_stored":1410664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.915733"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-06T06:51:21.681761+0000","last_change":"2024-05-06T06:51:20.687085+0000","last_active":"2024-05-06T06:51:21.681761+0000","last_peered":"2024-05-06T06:51:21.681761+0000","last_clean":"2024-05-06T06:51:21.681761+0000","last_became_active":"2024-05-06T06:51:20.686210+0000","last_became_peered":"2024-05-06T06:51:20.686210+0000","last_unstale":"2024-05-06T06:51:21.681761+0000","last_undegraded":"2024-05-06T06:51:21.681761+0000","last_fullsized":"2024-05-06T06:51:21.681761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:25:00.217824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-06T06:51:20.690108+0000","last_change":"2024-05-06T06:51:20.689651+0000","last_active":"2024-05-06T06:51:20.690108+0000","last_peered":"2024-05-06T06:51:20.690108+0000","last_clean":"2024-05-06T06:51:20.690108+0000","last_became_active":"2024-05-06T06:51:20.689362+0000","last_became_peered":"2024-05-06T06:51:20.689362+0000","last_unstale":"2024-05-06T06:51:20.690108+0000","last_undegraded":"2024-05-06T06:51:20.690108+0000","last_fullsized":"2024-05-06T06:51:20.690108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:08:53.456015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-06T06:51:20.681448+0000","last_change":"2024-05-06T06:51:20.681448+0000","last_active":"2024-05-06T06:51:20.681448+0000","last_peered":"2024-05-06T06:51:20.681448+0000","last_clean":"2024-05-06T06:51:20.681448+0000","last_became_active":"2024-05-06T06:51:20.680436+0000","last_became_peered":"2024-05-06T06:51:20.680436+0000","last_unstale":"2024-05-06T06:51:20.681448+0000","last_undegraded":"2024-05-06T06:51:20.681448+0000","last_fullsized":"2024-05-06T06:51:20.681448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:05:09.388357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-06T06:51:20.687201+0000","last_change":"2024-05-06T06:51:20.686480+0000","last_active":"2024-05-06T06:51:20.687201+0000","last_peered":"2024-05-06T06:51:20.687201+0000","last_clean":"2024-05-06T06:51:20.687201+0000","last_became_active":"2024-05-06T06:51:20.686231+0000","last_became_peered":"2024-05-06T06:51:20.686231+0000","last_unstale":"2024-05-06T06:51:20.687201+0000","last_undegraded":"2024-05-06T06:51:20.687201+0000","last_fullsized":"2024-05-06T06:51:20.687201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:22:39.169549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-06T06:51:20.693095+0000","last_change":"2024-05-06T06:51:20.689365+0000","last_active":"2024-05-06T06:51:20.693095+0000","last_peered":"2024-05-06T06:51:20.693095+0000","last_clean":"2024-05-06T06:51:20.693095+0000","last_became_active":"2024-05-06T06:51:20.688666+0000","last_became_peered":"2024-05-06T06:51:20.688666+0000","last_unstale":"2024-05-06T06:51:20.693095+0000","last_undegraded":"2024-05-06T06:51:20.693095+0000","last_fullsized":"2024-05-06T06:51:20.693095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:51:47.901467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-06T06:51:20.784971+0000","last_change":"2024-05-06T06:51:20.784004+0000","last_active":"2024-05-06T06:51:20.784971+0000","last_peered":"2024-05-06T06:51:20.784971+0000","last_clean":"2024-05-06T06:51:20.784971+0000","last_became_active":"2024-05-06T06:51:20.783638+0000","last_became_peered":"2024-05-06T06:51:20.783638+0000","last_unstale":"2024-05-06T06:51:20.784971+0000","last_undegraded":"2024-05-06T06:51:20.784971+0000","last_fullsized":"2024-05-06T06:51:20.784971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:42:12.615009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-06T06:51:20.683556+0000","last_change":"2024-05-06T06:51:20.683556+0000","last_active":"2024-05-06T06:51:20.683556+0000","last_peered":"2024-05-06T06:51:20.683556+0000","last_clean":"2024-05-06T06:51:20.683556+0000","last_became_active":"2024-05-06T06:51:20.682896+0000","last_became_peered":"2024-05-06T06:51:20.682896+0000","last_unstale":"2024-05-06T06:51:20.683556+0000","last_undegraded":"2024-05-06T06:51:20.683556+0000","last_fullsized":"2024-05-06T06:51:20.683556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T14:55:23.464116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-06T06:51:20.693581+0000","last_change":"2024-05-06T06:51:20.691287+0000","last_active":"2024-05-06T06:51:20.693581+0000","last_peered":"2024-05-06T06:51:20.693581+0000","last_clean":"2024-05-06T06:51:20.693581+0000","last_became_active":"2024-05-06T06:51:20.690621+0000","last_became_peered":"2024-05-06T06:51:20.690621+0000","last_unstale":"2024-05-06T06:51:20.693581+0000","last_undegraded":"2024-05-06T06:51:20.693581+0000","last_fullsized":"2024-05-06T06:51:20.693581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T14:07:16.464988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":102,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-06T06:51:20.676691+0000","last_change":"2024-05-06T06:51:19.660034+0000","last_active":"2024-05-06T06:51:20.676691+0000","last_peered":"2024-05-06T06:51:20.676691+0000","last_clean":"2024-05-06T06:51:20.676691+0000","last_became_active":"2024-05-06T06:51:19.659348+0000","last_became_peered":"2024-05-06T06:51:19.659348+0000","last_unstale":"2024-05-06T06:51:20.676691+0000","last_undegraded":"2024-05-06T06:51:20.676691+0000","last_fullsized":"2024-05-06T06:51:20.676691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:18.638703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:18.638703+0000","last_clean_scrub_stamp":"2024-05-06T06:51:18.638703+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:35:56.572278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":679936,"data_stored":573029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":44101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":147456,"data_stored":44101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":44101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":44101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542146,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":44101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542146,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":147456,"data_stored":44101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":679936,"data_stored":573029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T06:51:24.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-06T06:51:24.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.550+0000 7f3289b95640 1 Processor -- start 2024-05-06T06:51:24.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3289b95640 1 -- start start 2024-05-06T06:51:24.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3289b95640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f328406f4d0 con 0x7f32840acd50 2024-05-06T06:51:24.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3289b95640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32840740f0 con 0x7f32840adfe0 2024-05-06T06:51:24.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3289b95640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f328413ece0 con 0x7f32840ad130 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3283fff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f32840ad130 0x7f328414ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46352/0 (socket says 172.21.15.70:46352) 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f32837fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f32840acd50 0x7f3284144fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60804/0 (socket says 172.21.15.70:60804) 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3283fff640 1 -- 172.21.15.70:0/2329532045 learned_addr learned my addr 172.21.15.70:0/2329532045 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f32827fc640 1 -- 172.21.15.70:0/2329532045 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440619727 0 0) 0x7f328406f4d0 con 0x7f32840acd50 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f32827fc640 1 -- 172.21.15.70:0/2329532045 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f326c003530 con 0x7f32840acd50 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f32827fc640 1 -- 172.21.15.70:0/2329532045 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493512007 0 0) 0x7f328413ece0 con 0x7f32840ad130 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f32827fc640 1 -- 172.21.15.70:0/2329532045 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f328406f4d0 con 0x7f32840ad130 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f32827fc640 1 -- 172.21.15.70:0/2329532045 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4107673969 0 0) 0x7f328406f4d0 con 0x7f32840ad130 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f32827fc640 1 -- 172.21.15.70:0/2329532045 >> v1:172.21.15.184:6789/0 conn(0x7f32840adfe0 legacy=0x7f328413e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f32827fc640 1 -- 172.21.15.70:0/2329532045 >> v1:172.21.15.70:6789/0 conn(0x7f32840acd50 legacy=0x7f3284144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f32827fc640 1 -- 172.21.15.70:0/2329532045 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32840af3f0 con 0x7f32840ad130 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f32827fc640 1 -- 172.21.15.70:0/2329532045 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f327c001a00 con 0x7f32840ad130 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f32827fc640 1 -- 172.21.15.70:0/2329532045 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f327c001c20 con 0x7f32840ad130 2024-05-06T06:51:24.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f32827fc640 1 -- 172.21.15.70:0/2329532045 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f327c002030 con 0x7f32840ad130 2024-05-06T06:51:24.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3289b95640 1 -- 172.21.15.70:0/2329532045 >> v1:172.21.15.70:6790/0 conn(0x7f32840ad130 legacy=0x7f328414ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3289b95640 1 -- 172.21.15.70:0/2329532045 shutdown_connections 2024-05-06T06:51:24.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3289b95640 1 -- 172.21.15.70:0/2329532045 >> 172.21.15.70:0/2329532045 conn(0x7f32840b49f0 msgr2=0x7f32840b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:24.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3289b95640 1 -- 172.21.15.70:0/2329532045 shutdown_connections 2024-05-06T06:51:24.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3289b95640 1 -- 172.21.15.70:0/2329532045 wait complete. 2024-05-06T06:51:24.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3289b95640 1 Processor -- start 2024-05-06T06:51:24.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.554+0000 7f3289b95640 1 -- start start 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f3289b95640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32840727e0 con 0x7f32840ad130 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f3289b95640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32840738e0 con 0x7f32840acd50 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f3289b95640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3284072a50 con 0x7f32840adfe0 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f3283fff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f32840adfe0 0x7f3284070760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46358/0 (socket says 172.21.15.70:46358) 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f3283fff640 1 -- 172.21.15.70:0/4111720379 learned_addr learned my addr 172.21.15.70:0/4111720379 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045501647 0 0) 0x7f32840727e0 con 0x7f32840ad130 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3270003530 con 0x7f32840ad130 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1300725451 0 0) 0x7f3284072a50 con 0x7f32840adfe0 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32840727e0 con 0x7f32840adfe0 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1641975086 0 0) 0x7f3270003530 con 0x7f32840ad130 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3284072a50 con 0x7f32840ad130 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f32780018a0 con 0x7f32840ad130 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 767082952 0 0) 0x7f32840727e0 con 0x7f32840adfe0 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3270003530 con 0x7f32840adfe0 2024-05-06T06:51:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f327c001f70 con 0x7f32840adfe0 2024-05-06T06:51:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 119328478 0 0) 0x7f32840738e0 con 0x7f32840acd50 2024-05-06T06:51:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32840727e0 con 0x7f32840acd50 2024-05-06T06:51:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 835569239 0 0) 0x7f3284072a50 con 0x7f32840ad130 2024-05-06T06:51:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 >> v1:172.21.15.70:6790/0 conn(0x7f32840adfe0 legacy=0x7f3284070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 >> v1:172.21.15.184:6789/0 conn(0x7f32840acd50 legacy=0x7f32840731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32841381e0 con 0x7f32840ad130 2024-05-06T06:51:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f3289b95640 1 -- 172.21.15.70:0/4111720379 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3284133290 con 0x7f32840ad130 2024-05-06T06:51:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f3289b95640 1 -- 172.21.15.70:0/4111720379 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3284070e70 con 0x7f32840ad130 2024-05-06T06:51:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f3289b95640 1 -- 172.21.15.70:0/4111720379 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32840640c0 con 0x7f32840ad130 2024-05-06T06:51:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3278003600 con 0x7f32840ad130 2024-05-06T06:51:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f3278003950 con 0x7f32840ad130 2024-05-06T06:51:24.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f327801a6f0 con 0x7f32840ad130 2024-05-06T06:51:24.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.558+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f3278089360 con 0x7f32840ad130 2024-05-06T06:51:24.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.562+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f3278056820 con 0x7f32840ad130 2024-05-06T06:51:24.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.710+0000 7f3289b95640 1 -- 172.21.15.70:0/4111720379 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f32840b4080 con 0x7f32700700a0 2024-05-06T06:51:24.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.714+0000 7f326bfff640 1 -- 172.21.15.70:0/4111720379 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+35488 (unknown 2965378022 0 424567897) 0x7f32840b4080 con 0x7f32700700a0 2024-05-06T06:51:24.714 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:51:24.715 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-06T06:51:24.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.714+0000 7f3289b95640 1 -- 172.21.15.70:0/4111720379 >> v1:172.21.15.70:6816/2757942729 conn(0x7f32700700a0 legacy=0x7f3270072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.714+0000 7f3289b95640 1 -- 172.21.15.70:0/4111720379 >> v1:172.21.15.70:6789/0 conn(0x7f32840ad130 legacy=0x7f3284132b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.714+0000 7f3289b95640 1 -- 172.21.15.70:0/4111720379 shutdown_connections 2024-05-06T06:51:24.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.714+0000 7f3289b95640 1 -- 172.21.15.70:0/4111720379 >> 172.21.15.70:0/4111720379 conn(0x7f32840b49f0 msgr2=0x7f32840b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:24.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.714+0000 7f3289b95640 1 -- 172.21.15.70:0/4111720379 shutdown_connections 2024-05-06T06:51:24.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.714+0000 7f3289b95640 1 -- 172.21.15.70:0/4111720379 wait complete. 2024-05-06T06:51:24.730 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-05-06T06:51:24.590680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":222832,"kb_used_data":2240,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751888,"statfs":{"total":773094113280,"available":772865933312,"internally_reserved":0,"allocated":2293760,"data_stored":1438432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.916045"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-06T06:51:21.681761+0000","last_change":"2024-05-06T06:51:20.687085+0000","last_active":"2024-05-06T06:51:21.681761+0000","last_peered":"2024-05-06T06:51:21.681761+0000","last_clean":"2024-05-06T06:51:21.681761+0000","last_became_active":"2024-05-06T06:51:20.686210+0000","last_became_peered":"2024-05-06T06:51:20.686210+0000","last_unstale":"2024-05-06T06:51:21.681761+0000","last_undegraded":"2024-05-06T06:51:21.681761+0000","last_fullsized":"2024-05-06T06:51:21.681761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:25:00.217824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-06T06:51:22.193039+0000","last_change":"2024-05-06T06:51:20.689651+0000","last_active":"2024-05-06T06:51:22.193039+0000","last_peered":"2024-05-06T06:51:22.193039+0000","last_clean":"2024-05-06T06:51:22.193039+0000","last_became_active":"2024-05-06T06:51:20.689362+0000","last_became_peered":"2024-05-06T06:51:20.689362+0000","last_unstale":"2024-05-06T06:51:22.193039+0000","last_undegraded":"2024-05-06T06:51:22.193039+0000","last_fullsized":"2024-05-06T06:51:22.193039+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T16:42:56.711253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-06T06:51:20.681448+0000","last_change":"2024-05-06T06:51:20.681448+0000","last_active":"2024-05-06T06:51:20.681448+0000","last_peered":"2024-05-06T06:51:20.681448+0000","last_clean":"2024-05-06T06:51:20.681448+0000","last_became_active":"2024-05-06T06:51:20.680436+0000","last_became_peered":"2024-05-06T06:51:20.680436+0000","last_unstale":"2024-05-06T06:51:20.681448+0000","last_undegraded":"2024-05-06T06:51:20.681448+0000","last_fullsized":"2024-05-06T06:51:20.681448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:05:09.388357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-06T06:51:22.193196+0000","last_change":"2024-05-06T06:51:20.686480+0000","last_active":"2024-05-06T06:51:22.193196+0000","last_peered":"2024-05-06T06:51:22.193196+0000","last_clean":"2024-05-06T06:51:22.193196+0000","last_became_active":"2024-05-06T06:51:20.686231+0000","last_became_peered":"2024-05-06T06:51:20.686231+0000","last_unstale":"2024-05-06T06:51:22.193196+0000","last_undegraded":"2024-05-06T06:51:22.193196+0000","last_fullsized":"2024-05-06T06:51:22.193196+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:07:14.251359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-06T06:51:22.190382+0000","last_change":"2024-05-06T06:51:20.689365+0000","last_active":"2024-05-06T06:51:22.190382+0000","last_peered":"2024-05-06T06:51:22.190382+0000","last_clean":"2024-05-06T06:51:22.190382+0000","last_became_active":"2024-05-06T06:51:20.688666+0000","last_became_peered":"2024-05-06T06:51:20.688666+0000","last_unstale":"2024-05-06T06:51:22.190382+0000","last_undegraded":"2024-05-06T06:51:22.190382+0000","last_fullsized":"2024-05-06T06:51:22.190382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:39:52.485414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-06T06:51:22.192420+0000","last_change":"2024-05-06T06:51:20.784004+0000","last_active":"2024-05-06T06:51:22.192420+0000","last_peered":"2024-05-06T06:51:22.192420+0000","last_clean":"2024-05-06T06:51:22.192420+0000","last_became_active":"2024-05-06T06:51:20.783638+0000","last_became_peered":"2024-05-06T06:51:20.783638+0000","last_unstale":"2024-05-06T06:51:22.192420+0000","last_undegraded":"2024-05-06T06:51:22.192420+0000","last_fullsized":"2024-05-06T06:51:22.192420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:37:19.323657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-06T06:51:20.683556+0000","last_change":"2024-05-06T06:51:20.683556+0000","last_active":"2024-05-06T06:51:20.683556+0000","last_peered":"2024-05-06T06:51:20.683556+0000","last_clean":"2024-05-06T06:51:20.683556+0000","last_became_active":"2024-05-06T06:51:20.682896+0000","last_became_peered":"2024-05-06T06:51:20.682896+0000","last_unstale":"2024-05-06T06:51:20.683556+0000","last_undegraded":"2024-05-06T06:51:20.683556+0000","last_fullsized":"2024-05-06T06:51:20.683556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T14:55:23.464116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-05-06T06:51:22.190364+0000","last_change":"2024-05-06T06:51:20.691287+0000","last_active":"2024-05-06T06:51:22.190364+0000","last_peered":"2024-05-06T06:51:22.190364+0000","last_clean":"2024-05-06T06:51:22.190364+0000","last_became_active":"2024-05-06T06:51:20.690621+0000","last_became_peered":"2024-05-06T06:51:20.690621+0000","last_unstale":"2024-05-06T06:51:22.190364+0000","last_undegraded":"2024-05-06T06:51:22.190364+0000","last_fullsized":"2024-05-06T06:51:22.190364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:05:07.506405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":102,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-05-06T06:51:20.676691+0000","last_change":"2024-05-06T06:51:19.660034+0000","last_active":"2024-05-06T06:51:20.676691+0000","last_peered":"2024-05-06T06:51:20.676691+0000","last_clean":"2024-05-06T06:51:20.676691+0000","last_became_active":"2024-05-06T06:51:19.659348+0000","last_became_peered":"2024-05-06T06:51:19.659348+0000","last_unstale":"2024-05-06T06:51:20.676691+0000","last_undegraded":"2024-05-06T06:51:20.676691+0000","last_fullsized":"2024-05-06T06:51:20.676691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:18.638703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:18.638703+0000","last_clean_scrub_stamp":"2024-05-06T06:51:18.638703+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:35:56.572278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509443,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":679936,"data_stored":573029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27164,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":147456,"data_stored":44101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":48729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":48729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":48729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":48729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":48729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":688128,"data_stored":577657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T06:51:24.730 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-06T06:51:24.731 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-06T06:51:24.731 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-06T06:51:24.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-06T06:51:24.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f9994640 1 Processor -- start 2024-05-06T06:51:24.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f9994640 1 -- start start 2024-05-06T06:51:24.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f9994640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f4143410 con 0x7f08f4075d80 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f9994640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f40af740 con 0x7f08f4147530 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f9994640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f40aa670 con 0x7f08f40aaf80 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f27fc640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f08f40aaf80 0x7f08f4146e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46360/0 (socket says 172.21.15.70:46360) 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f27fc640 1 -- 172.21.15.70:0/388223298 learned_addr learned my addr 172.21.15.70:0/388223298 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f1ffb640 1 -- 172.21.15.70:0/388223298 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 617559519 0 0) 0x7f08f40aa670 con 0x7f08f40aaf80 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f1ffb640 1 -- 172.21.15.70:0/388223298 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08dc003530 con 0x7f08f40aaf80 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f1ffb640 1 -- 172.21.15.70:0/388223298 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1055580066 0 0) 0x7f08f4143410 con 0x7f08f4075d80 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f1ffb640 1 -- 172.21.15.70:0/388223298 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08f40aa670 con 0x7f08f4075d80 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f1ffb640 1 -- 172.21.15.70:0/388223298 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2203698839 0 0) 0x7f08f40aa670 con 0x7f08f4075d80 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f1ffb640 1 -- 172.21.15.70:0/388223298 >> v1:172.21.15.70:6790/0 conn(0x7f08f40aaf80 legacy=0x7f08f4146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f1ffb640 1 -- 172.21.15.70:0/388223298 >> v1:172.21.15.184:6789/0 conn(0x7f08f4147530 legacy=0x7f08f414ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f1ffb640 1 -- 172.21.15.70:0/388223298 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f40aa840 con 0x7f08f4075d80 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f1ffb640 1 -- 172.21.15.70:0/388223298 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f08e4001680 con 0x7f08f4075d80 2024-05-06T06:51:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f1ffb640 1 -- 172.21.15.70:0/388223298 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f08e40018a0 con 0x7f08f4075d80 2024-05-06T06:51:24.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f1ffb640 1 -- 172.21.15.70:0/388223298 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f08e4001c30 con 0x7f08f4075d80 2024-05-06T06:51:24.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f9994640 1 -- 172.21.15.70:0/388223298 >> v1:172.21.15.70:6789/0 conn(0x7f08f4075d80 legacy=0x7f08f40af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f9994640 1 -- 172.21.15.70:0/388223298 shutdown_connections 2024-05-06T06:51:24.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f9994640 1 -- 172.21.15.70:0/388223298 >> 172.21.15.70:0/388223298 conn(0x7f08f40b5140 msgr2=0x7f08f40b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:24.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f9994640 1 -- 172.21.15.70:0/388223298 shutdown_connections 2024-05-06T06:51:24.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.834+0000 7f08f9994640 1 -- 172.21.15.70:0/388223298 wait complete. 2024-05-06T06:51:24.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08f9994640 1 Processor -- start 2024-05-06T06:51:24.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08f9994640 1 -- start start 2024-05-06T06:51:24.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08f9994640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f4138780 con 0x7f08f40aaf80 2024-05-06T06:51:24.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08f9994640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f4138a60 con 0x7f08f4075d80 2024-05-06T06:51:24.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08f9994640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f4138d40 con 0x7f08f4147530 2024-05-06T06:51:24.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08f27fc640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f08f40aaf80 0x7f08f41412a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60826/0 (socket says 172.21.15.70:60826) 2024-05-06T06:51:24.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08f27fc640 1 -- 172.21.15.70:0/4221615369 learned_addr learned my addr 172.21.15.70:0/4221615369 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:24.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2664842601 0 0) 0x7f08f4138d40 con 0x7f08f4147530 2024-05-06T06:51:24.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08e0003530 con 0x7f08f4147530 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255587105 0 0) 0x7f08f4138780 con 0x7f08f40aaf80 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08f4138d40 con 0x7f08f40aaf80 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1031395152 0 0) 0x7f08e0003530 con 0x7f08f4147530 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08f4138780 con 0x7f08f4147530 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f08ec001ba0 con 0x7f08f4147530 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1506776689 0 0) 0x7f08f4138d40 con 0x7f08f40aaf80 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08e0003530 con 0x7f08f40aaf80 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f08e8001960 con 0x7f08f40aaf80 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2227141637 0 0) 0x7f08f4138a60 con 0x7f08f4075d80 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08f4138d40 con 0x7f08f4075d80 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1158541526 0 0) 0x7f08f4138780 con 0x7f08f4147530 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 >> v1:172.21.15.184:6789/0 conn(0x7f08f4075d80 legacy=0x7f08f41371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 >> v1:172.21.15.70:6789/0 conn(0x7f08f40aaf80 legacy=0x7f08f41412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f41366e0 con 0x7f08f4147530 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08f9994640 1 -- 172.21.15.70:0/4221615369 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f08f41e46d0 con 0x7f08f4147530 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08f9994640 1 -- 172.21.15.70:0/4221615369 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f08f41e4a70 con 0x7f08f4147530 2024-05-06T06:51:24.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f08ec003980 con 0x7f08f4147530 2024-05-06T06:51:24.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f08ec003b30 con 0x7f08f4147530 2024-05-06T06:51:24.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08f9994640 1 -- 172.21.15.70:0/4221615369 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d4005090 con 0x7f08f4147530 2024-05-06T06:51:24.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f08ec01a8d0 con 0x7f08f4147530 2024-05-06T06:51:24.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.838+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7f08ec0896b0 con 0x7f08f4147530 2024-05-06T06:51:24.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:24.842+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f08ec056b10 con 0x7f08f4147530 2024-05-06T06:51:25.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.026+0000 7f08f9994640 1 -- 172.21.15.70:0/4221615369 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f08d4005380 con 0x7f08f4147530 2024-05-06T06:51:25.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.030+0000 7f08dbfff640 1 -- 172.21.15.70:0/4221615369 <== mon.2 v1:172.21.15.70:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f08ec056410 con 0x7f08f4147530 2024-05-06T06:51:25.029 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:51:25.029 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-06T06:51:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.030+0000 7f08f9994640 1 -- 172.21.15.70:0/4221615369 >> v1:172.21.15.70:6816/2757942729 conn(0x7f08e0070020 legacy=0x7f08e00724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.030+0000 7f08f9994640 1 -- 172.21.15.70:0/4221615369 >> v1:172.21.15.70:6790/0 conn(0x7f08f4147530 legacy=0x7f08f41419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.030+0000 7f08f9994640 1 -- 172.21.15.70:0/4221615369 shutdown_connections 2024-05-06T06:51:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.030+0000 7f08f9994640 1 -- 172.21.15.70:0/4221615369 >> 172.21.15.70:0/4221615369 conn(0x7f08f40b5140 msgr2=0x7f08f40aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:25.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.030+0000 7f08f9994640 1 -- 172.21.15.70:0/4221615369 shutdown_connections 2024-05-06T06:51:25.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.030+0000 7f08f9994640 1 -- 172.21.15.70:0/4221615369 wait complete. 2024-05-06T06:51:25.046 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-06T06:51:25.046 INFO:teuthology.run_tasks:Running task exec... 2024-05-06T06:51:25.056 INFO:teuthology.task.exec:Executing custom commands... 2024-05-06T06:51:25.056 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:51:25.056 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd pool create cephsqlite' 2024-05-06T06:51:25.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.162+0000 7fc85cd86640 1 Processor -- start 2024-05-06T06:51:25.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.162+0000 7fc85cd86640 1 -- start start 2024-05-06T06:51:25.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.162+0000 7fc85cd86640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc858072c10 con 0x7fc858141880 2024-05-06T06:51:25.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.162+0000 7fc85cd86640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc85806ff60 con 0x7fc85806f800 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.162+0000 7fc85cd86640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc85806fc60 con 0x7fc85806d1c0 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.162+0000 7fc856d9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fc858141880 0x7fc85814c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60830/0 (socket says 172.21.15.70:60830) 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.162+0000 7fc856d9d640 1 -- 172.21.15.70:0/445085351 learned_addr learned my addr 172.21.15.70:0/445085351 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.162+0000 7fc85659c640 1 --1- 172.21.15.70:0/445085351 >> v1:172.21.15.70:6790/0 conn(0x7fc85806d1c0 0x7fc85813e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46390/0 (socket says 172.21.15.70:46390) 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85559a640 1 -- 172.21.15.70:0/445085351 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2573782824 0 0) 0x7fc85806fc60 con 0x7fc85806d1c0 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85559a640 1 -- 172.21.15.70:0/445085351 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc840003530 con 0x7fc85806d1c0 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85559a640 1 -- 172.21.15.70:0/445085351 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351793042 0 0) 0x7fc858072c10 con 0x7fc858141880 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85559a640 1 -- 172.21.15.70:0/445085351 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc85806fc60 con 0x7fc858141880 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85559a640 1 -- 172.21.15.70:0/445085351 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3704312392 0 0) 0x7fc840003530 con 0x7fc85806d1c0 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85559a640 1 -- 172.21.15.70:0/445085351 >> v1:172.21.15.184:6789/0 conn(0x7fc85806f800 legacy=0x7fc858141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85559a640 1 -- 172.21.15.70:0/445085351 >> v1:172.21.15.70:6789/0 conn(0x7fc858141880 legacy=0x7fc85814c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85559a640 1 -- 172.21.15.70:0/445085351 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc858141d10 con 0x7fc85806d1c0 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85559a640 1 -- 172.21.15.70:0/445085351 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fc8480016a0 con 0x7fc85806d1c0 2024-05-06T06:51:25.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85559a640 1 -- 172.21.15.70:0/445085351 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc848001840 con 0x7fc85806d1c0 2024-05-06T06:51:25.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85559a640 1 -- 172.21.15.70:0/445085351 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fc848001cd0 con 0x7fc85806d1c0 2024-05-06T06:51:25.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85cd86640 1 -- 172.21.15.70:0/445085351 >> v1:172.21.15.70:6790/0 conn(0x7fc85806d1c0 legacy=0x7fc85813e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85cd86640 1 -- 172.21.15.70:0/445085351 shutdown_connections 2024-05-06T06:51:25.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85cd86640 1 -- 172.21.15.70:0/445085351 >> 172.21.15.70:0/445085351 conn(0x7fc85806c440 msgr2=0x7fc85806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:25.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85cd86640 1 -- 172.21.15.70:0/445085351 shutdown_connections 2024-05-06T06:51:25.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85cd86640 1 -- 172.21.15.70:0/445085351 wait complete. 2024-05-06T06:51:25.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85cd86640 1 Processor -- start 2024-05-06T06:51:25.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85cd86640 1 -- start start 2024-05-06T06:51:25.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85cd86640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8580ad3d0 con 0x7fc85806f800 2024-05-06T06:51:25.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85cd86640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8580ad5a0 con 0x7fc85806d1c0 2024-05-06T06:51:25.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc85cd86640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8581d65b0 con 0x7fc858141880 2024-05-06T06:51:25.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc856d9d640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fc858141880 0x7fc85812cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46402/0 (socket says 172.21.15.70:46402) 2024-05-06T06:51:25.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc856d9d640 1 -- 172.21.15.70:0/2016318755 learned_addr learned my addr 172.21.15.70:0/2016318755 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705503741 0 0) 0x7fc8581d65b0 con 0x7fc858141880 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc838003530 con 0x7fc858141880 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603590167 0 0) 0x7fc8580ad3d0 con 0x7fc85806f800 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8581d65b0 con 0x7fc85806f800 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3747663621 0 0) 0x7fc838003530 con 0x7fc858141880 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8580ad3d0 con 0x7fc858141880 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fc850001ba0 con 0x7fc858141880 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4285237728 0 0) 0x7fc8581d65b0 con 0x7fc85806f800 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc838003530 con 0x7fc85806f800 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.166+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fc84c001880 con 0x7fc85806f800 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.170+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1744492798 0 0) 0x7fc8580ad3d0 con 0x7fc858141880 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.170+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 >> v1:172.21.15.184:6789/0 conn(0x7fc85806d1c0 legacy=0x7fc8581d6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.170+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 >> v1:172.21.15.70:6789/0 conn(0x7fc85806f800 legacy=0x7fc8580aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.170+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8581d6780 con 0x7fc858141880 2024-05-06T06:51:25.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.170+0000 7fc85cd86640 1 -- 172.21.15.70:0/2016318755 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc85812db10 con 0x7fc858141880 2024-05-06T06:51:25.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.170+0000 7fc85cd86640 1 -- 172.21.15.70:0/2016318755 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc8580ae2a0 con 0x7fc858141880 2024-05-06T06:51:25.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.170+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc850004b70 con 0x7fc858141880 2024-05-06T06:51:25.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.170+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fc850004ec0 con 0x7fc858141880 2024-05-06T06:51:25.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.170+0000 7fc85cd86640 1 -- 172.21.15.70:0/2016318755 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc83c005090 con 0x7fc858141880 2024-05-06T06:51:25.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.170+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fc85001bc60 con 0x7fc858141880 2024-05-06T06:51:25.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.170+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 4090+0+0 (unknown 3933517806 0 0) 0x7fc85008a970 con 0x7fc858141880 2024-05-06T06:51:25.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.174+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fc850057dd0 con 0x7fc858141880 2024-05-06T06:51:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.322+0000 7fc85cd86640 1 -- 172.21.15.70:0/2016318755 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "cephsqlite"} v 0) -- 0x7fc83c005380 con 0x7fc858141880 2024-05-06T06:51:25.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.718+0000 7fc846ffd640 1 -- 172.21.15.70:0/2016318755 <== mon.2 v1:172.21.15.70:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephsqlite"}]=0 pool 'cephsqlite' created v19) ==== 110+0+0 (unknown 986820178 0 0) 0x7fc8500576d0 con 0x7fc858141880 2024-05-06T06:51:25.721 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephsqlite' created 2024-05-06T06:51:25.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.726+0000 7fc85cd86640 1 -- 172.21.15.70:0/2016318755 >> v1:172.21.15.70:6816/2757942729 conn(0x7fc83806ffc0 legacy=0x7fc838072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.726+0000 7fc85cd86640 1 -- 172.21.15.70:0/2016318755 >> v1:172.21.15.70:6790/0 conn(0x7fc858141880 legacy=0x7fc85812cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.726+0000 7fc85cd86640 1 -- 172.21.15.70:0/2016318755 shutdown_connections 2024-05-06T06:51:25.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.726+0000 7fc85cd86640 1 -- 172.21.15.70:0/2016318755 >> 172.21.15.70:0/2016318755 conn(0x7fc85806c440 msgr2=0x7fc85813a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:25.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.730+0000 7fc85cd86640 1 -- 172.21.15.70:0/2016318755 shutdown_connections 2024-05-06T06:51:25.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.730+0000 7fc85cd86640 1 -- 172.21.15.70:0/2016318755 wait complete. 2024-05-06T06:51:25.747 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph auth get-or-create client.libcephsqlite mon '"'"'profile simple-rados-client-with-blocklist'"'"' osd '"'"'allow rwx pool=cephsqlite'"'"' >> /etc/ceph/ceph.keyring' 2024-05-06T06:51:25.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.862+0000 7fc3c7196640 1 Processor -- start 2024-05-06T06:51:25.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.862+0000 7fc3c7196640 1 -- start start 2024-05-06T06:51:25.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.862+0000 7fc3c7196640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c0070090 con 0x7fc3c0140930 2024-05-06T06:51:25.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.862+0000 7fc3c7196640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c0074240 con 0x7fc3c00b0e30 2024-05-06T06:51:25.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.862+0000 7fc3c7196640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c006f5d0 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c4f32640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fc3c0140930 0x7fc3c0073aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:60858/0 (socket says 172.21.15.70:60858) 2024-05-06T06:51:25.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c5733640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fc3c00ae8b0 0x7fc3c014eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46408/0 (socket says 172.21.15.70:46408) 2024-05-06T06:51:25.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c4f32640 1 -- 172.21.15.70:0/1698713415 learned_addr learned my addr 172.21.15.70:0/1698713415 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:25.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bf7fe640 1 -- 172.21.15.70:0/1698713415 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3318375536 0 0) 0x7fc3c0070090 con 0x7fc3c0140930 2024-05-06T06:51:25.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bf7fe640 1 -- 172.21.15.70:0/1698713415 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ac003530 con 0x7fc3c0140930 2024-05-06T06:51:25.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bf7fe640 1 -- 172.21.15.70:0/1698713415 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045924305 0 0) 0x7fc3c006f5d0 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bf7fe640 1 -- 172.21.15.70:0/1698713415 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c0070090 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bf7fe640 1 -- 172.21.15.70:0/1698713415 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2843101754 0 0) 0x7fc3c0070090 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bf7fe640 1 -- 172.21.15.70:0/1698713415 >> v1:172.21.15.184:6789/0 conn(0x7fc3c00b0e30 legacy=0x7fc3c0146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bf7fe640 1 -- 172.21.15.70:0/1698713415 >> v1:172.21.15.70:6789/0 conn(0x7fc3c0140930 legacy=0x7fc3c0073aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bf7fe640 1 -- 172.21.15.70:0/1698713415 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c00aed40 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bf7fe640 1 -- 172.21.15.70:0/1698713415 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fc3a8001680 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bf7fe640 1 -- 172.21.15.70:0/1698713415 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3a80018a0 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bf7fe640 1 -- 172.21.15.70:0/1698713415 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fc3a8001cb0 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c7196640 1 -- 172.21.15.70:0/1698713415 >> v1:172.21.15.70:6790/0 conn(0x7fc3c00ae8b0 legacy=0x7fc3c014eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c7196640 1 -- 172.21.15.70:0/1698713415 shutdown_connections 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c7196640 1 -- 172.21.15.70:0/1698713415 >> 172.21.15.70:0/1698713415 conn(0x7fc3c006cee0 msgr2=0x7fc3c00b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c7196640 1 -- 172.21.15.70:0/1698713415 shutdown_connections 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c7196640 1 -- 172.21.15.70:0/1698713415 wait complete. 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c7196640 1 Processor -- start 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c7196640 1 -- start start 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c7196640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c0134d30 con 0x7fc3c0140930 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c7196640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c01425f0 con 0x7fc3c00b0e30 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c7196640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3c0142250 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c4f32640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fc3c00ae8b0 0x7fc3c0141500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:46414/0 (socket says 172.21.15.70:46414) 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3c4f32640 1 -- 172.21.15.70:0/3130284466 learned_addr learned my addr 172.21.15.70:0/3130284466 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436103832 0 0) 0x7fc3c0134d30 con 0x7fc3c0140930 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3a0003530 con 0x7fc3c0140930 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080988000 0 0) 0x7fc3c0142250 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c0134d30 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 229296999 0 0) 0x7fc3a0003530 con 0x7fc3c0140930 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3c0142250 con 0x7fc3c0140930 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fc3a8001bf0 con 0x7fc3c0140930 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2572115204 0 0) 0x7fc3c0134d30 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3a0003530 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fc3b8001bc0 con 0x7fc3c00ae8b0 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.866+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3427604353 0 0) 0x7fc3c0142250 con 0x7fc3c0140930 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.870+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 >> v1:172.21.15.70:6790/0 conn(0x7fc3c00ae8b0 legacy=0x7fc3c0141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.870+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 >> v1:172.21.15.184:6789/0 conn(0x7fc3c00b0e30 legacy=0x7fc3c013fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.870+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c0140440 con 0x7fc3c0140930 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.870+0000 7fc3c7196640 1 -- 172.21.15.70:0/3130284466 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c01406d0 con 0x7fc3c0140930 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.870+0000 7fc3c7196640 1 -- 172.21.15.70:0/3130284466 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3c0143f60 con 0x7fc3c0140930 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.870+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3a80011b0 con 0x7fc3c0140930 2024-05-06T06:51:25.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.870+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fc3a8004ce0 con 0x7fc3c0140930 2024-05-06T06:51:25.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.870+0000 7fc3c7196640 1 -- 172.21.15.70:0/3130284466 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a4005090 con 0x7fc3c0140930 2024-05-06T06:51:25.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.870+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fc3a801ba80 con 0x7fc3c0140930 2024-05-06T06:51:25.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.870+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 4439+0+0 (unknown 959849125 0 0) 0x7fc3a808a750 con 0x7fc3c0140930 2024-05-06T06:51:25.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:25.874+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fc3a8057a50 con 0x7fc3c0140930 2024-05-06T06:51:26.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:26.082+0000 7fc3c7196640 1 -- 172.21.15.70:0/3130284466 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.libcephsqlite", "caps": ["mon", "profile simple-rados-client-with-blocklist", "osd", "allow rwx pool=cephsqlite"]} v 0) -- 0x7fc3a4005380 con 0x7fc3c0140930 2024-05-06T06:51:26.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:26.082+0000 7fc3bd7fa640 1 -- 172.21.15.70:0/3130284466 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.libcephsqlite", "caps": ["mon", "profile simple-rados-client-with-blocklist", "osd", "allow rwx pool=cephsqlite"]}]=0 v15) ==== 199+0+71 (unknown 3040008346 0 1288722926) 0x7fc3a8057350 con 0x7fc3c0140930 2024-05-06T06:51:26.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:26.086+0000 7fc3c7196640 1 -- 172.21.15.70:0/3130284466 >> v1:172.21.15.70:6816/2757942729 conn(0x7fc3a006ffc0 legacy=0x7fc3a0072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:26.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:26.086+0000 7fc3c7196640 1 -- 172.21.15.70:0/3130284466 >> v1:172.21.15.70:6789/0 conn(0x7fc3c0140930 legacy=0x7fc3c01d85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:51:26.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:26.086+0000 7fc3c7196640 1 -- 172.21.15.70:0/3130284466 shutdown_connections 2024-05-06T06:51:26.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:26.086+0000 7fc3c7196640 1 -- 172.21.15.70:0/3130284466 >> 172.21.15.70:0/3130284466 conn(0x7fc3c006cee0 msgr2=0x7fc3c00737f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:51:26.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:26.086+0000 7fc3c7196640 1 -- 172.21.15.70:0/3130284466 shutdown_connections 2024-05-06T06:51:26.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:51:26.086+0000 7fc3c7196640 1 -- 172.21.15.70:0/3130284466 wait complete. 2024-05-06T06:51:26.102 INFO:teuthology.run_tasks:Running task exec... 2024-05-06T06:51:26.110 INFO:teuthology.task.exec:Executing custom commands... 2024-05-06T06:51:26.110 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:51:26.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_libcephsqlite --id libcephsqlite --no-log-to-stderr' 2024-05-06T06:51:26.141 INFO:teuthology.orchestra.run.smithi070.stdout:[==========] Running 20 tests from 1 test suite. 2024-05-06T06:51:26.141 INFO:teuthology.orchestra.run.smithi070.stdout:[----------] Global test environment set-up. 2024-05-06T06:51:26.141 INFO:teuthology.orchestra.run.smithi070.stdout:[----------] 20 tests from CephSQLiteTest 2024-05-06T06:51:31.149 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.Create 2024-05-06T06:51:31.166 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/8029a16c-0725-4e6b-9214-c7c594084658.db?vfs=ceph 2024-05-06T06:51:31.166 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:31.176 INFO:teuthology.orchestra.run.smithi070.stdout:CREATE TABLE foo (a INT); 2024-05-06T06:51:31.210 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.Create (62 ms) 2024-05-06T06:51:31.210 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.InsertBulk4096 2024-05-06T06:51:31.225 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/15528c8f-d380-40e5-b4d7-645e2a0d4da1.db?vfs=ceph 2024-05-06T06:51:31.225 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:31.234 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA page_size = 4096;CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOM() FROM c LIMIT 1000000;PRAGMA page_size; 2024-05-06T06:51:34.284 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.InsertBulk4096 (3074 ms) 2024-05-06T06:51:34.285 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.InsertBulk 2024-05-06T06:51:34.296 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/0a45d2d1-5bd4-4062-bb21-c6e91dde74b3.db?vfs=ceph 2024-05-06T06:51:34.296 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:34.302 INFO:teuthology.orchestra.run.smithi070.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOM() FROM c LIMIT 1000000; 2024-05-06T06:51:34.963 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.InsertBulk (679 ms) 2024-05-06T06:51:34.964 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.UpdateBulk 2024-05-06T06:51:34.972 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/4e6f894d-35a5-4510-bc68-cd635cd40fe1.db?vfs=ceph 2024-05-06T06:51:34.972 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:34.976 INFO:teuthology.orchestra.run.smithi070.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;SELECT SUM(a) FROM foo;UPDATE foo SET a = a+a;SELECT SUM(a) FROM foo; 2024-05-06T06:51:36.219 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.UpdateBulk (1255 ms) 2024-05-06T06:51:36.219 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.InsertRate 2024-05-06T06:51:36.230 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/be1f9b62-3387-454c-8e4f-4772767d0c60.db?vfs=ceph 2024-05-06T06:51:36.230 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:36.234 INFO:teuthology.orchestra.run.smithi070.stdout:CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2024-05-06T06:51:39.494 INFO:teuthology.orchestra.run.smithi070.stdout:transactions per second: 30.8264 2024-05-06T06:51:39.496 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.InsertRate (3277 ms) 2024-05-06T06:51:39.496 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.DatabaseShrink 2024-05-06T06:51:39.508 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/4cf2ba86-11a8-4880-9430-7b9dd44f1fca.db?vfs=ceph 2024-05-06T06:51:39.508 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:39.514 INFO:teuthology.orchestra.run.smithi070.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;DELETE FROM foo WHERE RANDOM()%4 < 3;VACUUM; 2024-05-06T06:51:41.051 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.DatabaseShrink (1556 ms) 2024-05-06T06:51:41.052 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveRate 2024-05-06T06:51:41.061 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/52f85a6c-834b-4f61-bc4d-500a079b1628.db?vfs=ceph 2024-05-06T06:51:41.061 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:41.068 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA locking_mode=EXCLUSIVE;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2024-05-06T06:51:42.563 INFO:teuthology.orchestra.run.smithi070.stdout:transactions per second: 67.9354 2024-05-06T06:51:42.568 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.InsertExclusiveRate (1517 ms) 2024-05-06T06:51:42.568 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveWALRate 2024-05-06T06:51:42.584 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/7fd8f41c-b4ce-40f5-acd9-b4e9ddc5dd48.db?vfs=ceph 2024-05-06T06:51:42.584 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:42.592 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA locking_mode=EXCLUSIVE;PRAGMA journal_mode=WAL;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM()); 2024-05-06T06:51:42.937 INFO:teuthology.orchestra.run.smithi070.stdout:transactions per second: 337.841 2024-05-06T06:51:42.970 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.InsertExclusiveWALRate (402 ms) 2024-05-06T06:51:42.971 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.WALTransactionSync 2024-05-06T06:51:42.981 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/1684ff9f-957b-4be5-8717-b6c7efb6c909.db?vfs=ceph 2024-05-06T06:51:42.981 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:42.986 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA locking_mode=EXCLUSIVE;PRAGMA journal_mode=WAL;CREATE TABLE foo (a INT);INSERT INTO perf (v) VALUES (ceph_perf());BEGIN TRANSACTION;INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount'; 2024-05-06T06:51:43.081 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.WALTransactionSync (110 ms) 2024-05-06T06:51:43.081 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.PersistTransactionSync 2024-05-06T06:51:43.093 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/b318d25f-d5bd-49dd-a22c-983a96fa41fd.db?vfs=ceph 2024-05-06T06:51:43.093 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:43.099 INFO:teuthology.orchestra.run.smithi070.stdout:BEGIN TRANSACTION;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_sync.avgcount'; 2024-05-06T06:51:43.131 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.PersistTransactionSync (49 ms) 2024-05-06T06:51:43.131 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.InsertExclusiveLock 2024-05-06T06:51:43.143 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/02a5155a-0d09-4819-b919-8ffb5ab9bb33.db?vfs=ceph 2024-05-06T06:51:43.143 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:43.154 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA locking_mode=EXCLUSIVE;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_vfs.opf_lock.avgcount' AND b.fullkey = '$.libcephsqlite_vfs.opf_lock.avgcount';SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.lock' AND b.fullkey = '$.libcephsqlite_striper.lock'; 2024-05-06T06:51:43.203 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.InsertExclusiveLock (73 ms) 2024-05-06T06:51:43.204 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.TransactionSizeUpdate 2024-05-06T06:51:43.220 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/5f132813-c5a5-41a2-8b5b-dd3327d6c2f1.db?vfs=ceph 2024-05-06T06:51:43.220 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:43.228 INFO:teuthology.orchestra.run.smithi070.stdout:BEGIN TRANSACTION;CREATE TABLE foo (a INT);INSERT INTO foo (a) VALUES (RANDOM());END TRANSACTION;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.update_size' AND b.fullkey = '$.libcephsqlite_striper.update_size'; 2024-05-06T06:51:43.275 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.TransactionSizeUpdate (71 ms) 2024-05-06T06:51:43.275 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.AllocatedGrowth 2024-05-06T06:51:43.287 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/a1e8b3d4-d8f3-4a99-b813-e595515de3e5.db?vfs=ceph 2024-05-06T06:51:43.287 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:43.293 INFO:teuthology.orchestra.run.smithi070.stdout:CREATE TABLE foo (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom, a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.update_allocated' AND b.fullkey = '$.libcephsqlite_striper.update_allocated'; 2024-05-06T06:51:50.797 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.AllocatedGrowth (7522 ms) 2024-05-06T06:51:50.797 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.DeleteBulk 2024-05-06T06:51:50.805 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/5211e3f3-d0f7-425c-91e9-d14c2687c139.db?vfs=ceph 2024-05-06T06:51:50.805 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:50.809 INFO:teuthology.orchestra.run.smithi070.stdout:CREATE TABLE foo (a INT);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT x FROM c LIMIT 1000000;DELETE FROM foo WHERE RANDOM()%2 == 0; 2024-05-06T06:51:51.723 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.DeleteBulk (927 ms) 2024-05-06T06:51:51.724 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.DropMassive 2024-05-06T06:51:51.732 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/c0bfd954-4e63-42d6-bccc-d6874272dd06.db?vfs=ceph 2024-05-06T06:51:51.732 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:51:51.735 INFO:teuthology.orchestra.run.smithi070.stdout:CREATE TABLE foo (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO foo (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;DROP TABLE foo;VACUUM;INSERT INTO perf (v) VALUES (ceph_perf());SELECT a.atom, b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.shrink' AND b.fullkey = '$.libcephsqlite_striper.shrink';SELECT a.atom-b.atom FROM p AS a, p AS b WHERE a.i = ? AND b.i = ? AND a.fullkey = '$.libcephsqlite_striper.shrink_bytes' AND b.fullkey = '$.libcephsqlite_striper.shrink_bytes'; 2024-05-06T06:52:29.449 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.DropMassive (37721 ms) 2024-05-06T06:52:29.449 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.InsertMassiveVerify 2024-05-06T06:52:29.458 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/cdb452da-71d4-4446-92e4-a06d94c11e01.db?vfs=ceph 2024-05-06T06:52:29.458 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:52:29.464 INFO:teuthology.orchestra.run.smithi070.stdout:CREATE TABLE foo (a BLOB);CREATE TEMPORARY TABLE bar (a BLOB);WITH RECURSIVE c(x) AS ( VALUES(1) UNION ALL SELECT x+1 FROM c )INSERT INTO bar (a) SELECT RANDOMBLOB(1<<20) FROM c LIMIT 1024;SELECT a FROM bar;INSERT INTO foo (a) SELECT a FROM bar;SELECT a FROM foo; 2024-05-06T06:52:43.667 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.InsertMassiveVerify (14218 ms) 2024-05-06T06:52:43.667 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.PerfValid 2024-05-06T06:52:43.675 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/cfe4dba8-f3fe-482c-83af-7c2aafbc15e8.db?vfs=ceph 2024-05-06T06:52:43.676 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:52:43.682 INFO:teuthology.orchestra.run.smithi070.stdout:SELECT json_valid(ceph_perf()); 2024-05-06T06:52:43.682 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.PerfValid (16 ms) 2024-05-06T06:52:43.682 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.StatusValid 2024-05-06T06:52:43.691 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/cb5e2b78-e3f3-4b9c-9186-5b7416ed1251.db?vfs=ceph 2024-05-06T06:52:43.731 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:52:43.732 INFO:teuthology.orchestra.run.smithi070.stdout:SELECT json_valid(ceph_status()); 2024-05-06T06:52:43.732 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.StatusValid (14 ms) 2024-05-06T06:52:43.732 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.CurrentTime 2024-05-06T06:52:43.732 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/96fbd7f5-2f2f-429a-9259-95169c518b50.db?vfs=ceph 2024-05-06T06:52:43.732 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:52:43.732 INFO:teuthology.orchestra.run.smithi070.stdout:SELECT strftime('%s', 'now'); 2024-05-06T06:52:43.732 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.CurrentTime (24 ms) 2024-05-06T06:52:43.732 INFO:teuthology.orchestra.run.smithi070.stdout:[ RUN ] CephSQLiteTest.StatusFields 2024-05-06T06:52:43.735 INFO:teuthology.orchestra.run.smithi070.stdout:using database: file:cephsqlite:/69d3537d-a5c2-4f97-9fa0-faa24ddb7910.db?vfs=ceph 2024-05-06T06:52:43.735 INFO:teuthology.orchestra.run.smithi070.stdout:PRAGMA journal_mode = PERSIST;PRAGMA page_size = 65536;PRAGMA cache_size = 32768;PRAGMA temp_store = memory;CREATE TEMPORARY TABLE perf (i INTEGER PRIMARY KEY, v TEXT);CREATE TEMPORARY VIEW p AS SELECT perf.i, J.* FROM perf, json_tree(perf.v) AS J;INSERT INTO perf (v) VALUES (ceph_perf()); 2024-05-06T06:52:43.746 INFO:teuthology.orchestra.run.smithi070.stdout:SELECT json_extract(ceph_status(), '$.addr');SELECT json_extract(ceph_status(), '$.id'); 2024-05-06T06:52:43.747 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1249092557 2024-05-06T06:52:43.747 INFO:teuthology.orchestra.run.smithi070.stdout:4437 2024-05-06T06:52:43.747 INFO:teuthology.orchestra.run.smithi070.stdout:[ OK ] CephSQLiteTest.StatusFields (27 ms) 2024-05-06T06:52:43.747 INFO:teuthology.orchestra.run.smithi070.stdout:[----------] 20 tests from CephSQLiteTest (72595 ms total) 2024-05-06T06:52:43.747 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:52:43.747 INFO:teuthology.orchestra.run.smithi070.stdout:[----------] Global test environment tear-down 2024-05-06T06:52:43.747 INFO:teuthology.orchestra.run.smithi070.stdout:[==========] 20 tests from 1 test suite ran. (77603 ms total) 2024-05-06T06:52:43.748 INFO:teuthology.orchestra.run.smithi070.stdout:[ PASSED ] 20 tests. 2024-05-06T06:52:43.787 INFO:teuthology.run_tasks:Running task workunit... 2024-05-06T06:52:43.800 INFO:tasks.workunit:Pulling workunits from ref e08cbbf6fd79a8dd2949f340bce25e28ea3db004 2024-05-06T06:52:43.801 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-06T06:52:43.801 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-06T06:52:43.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:52:43.833 INFO:teuthology.orchestra.run.smithi070.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-05-06T06:52:43.833 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-05-06T06:52:43.880 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-05-06T06:52:43.881 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-05-06T06:52:43.929 INFO:tasks.workunit:timeout=3h 2024-05-06T06:52:43.929 INFO:tasks.workunit:cleanup=True 2024-05-06T06:52:43.929 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e08cbbf6fd79a8dd2949f340bce25e28ea3db004 2024-05-06T06:52:43.981 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-06T06:53:29.546 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to 'e08cbbf6fd79a8dd2949f340bce25e28ea3db004'. 2024-05-06T06:53:29.546 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-06T06:53:29.547 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-06T06:53:29.548 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-06T06:53:29.548 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at e08cbbf6fd7 Merge PR #54968 into wip-yuriw-testing-20240503.181540-main 2024-05-06T06:53:29.552 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-06T06:53:29.604 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-06T06:53:29.607 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-06T06:53:29.608 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-06T06:53:30.390 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-06T06:53:30.479 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-06T06:53:30.536 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-06T06:53:30.537 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-06T06:53:30.537 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-06T06:53:30.590 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-06T06:53:30.594 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-06T06:53:30.594 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-06T06:53:30.647 INFO:tasks.workunit:Running workunits matching rados/test_libcephsqlite.sh on client.0... 2024-05-06T06:53:30.648 INFO:tasks.workunit:Running workunit rados/test_libcephsqlite.sh... 2024-05-06T06:53:30.649 DEBUG:teuthology.orchestra.run.smithi070:workunit test rados/test_libcephsqlite.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e08cbbf6fd79a8dd2949f340bce25e28ea3db004 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CEPH_ARGS='--id libcephsqlite --no-log-to-stderr' adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh cephsqlite 2024-05-06T06:53:30.703 INFO:tasks.workunit.client.0.smithi070.stderr:+ pool=cephsqlite 2024-05-06T06:53:30.703 INFO:tasks.workunit.client.0.smithi070.stderr:++ basename /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh 2024-05-06T06:53:30.704 INFO:tasks.workunit.client.0.smithi070.stderr:+ ns=test_libcephsqlite.sh 2024-05-06T06:53:30.704 INFO:tasks.workunit.client.0.smithi070.stderr:+ striper rm baz.db 2024-05-06T06:53:30.704 INFO:tasks.workunit.client.0.smithi070.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-05-06T06:53:30.762 INFO:tasks.workunit.client.0.smithi070.stderr:+ sqlite 2024-05-06T06:53:30.763 INFO:tasks.workunit.client.0.smithi070.stderr:+ background= 2024-05-06T06:53:30.763 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' '' = b ']' 2024-05-06T06:53:30.763 INFO:tasks.workunit.client.0.smithi070.stderr:++ cat 2024-05-06T06:53:30.764 INFO:tasks.workunit.client.0.smithi070.stderr:+ a='create table if not exists foo (a INT); 2024-05-06T06:53:30.764 INFO:tasks.workunit.client.0.smithi070.stderr:insert into foo (a) values (RANDOM()); 2024-05-06T06:53:30.764 INFO:tasks.workunit.client.0.smithi070.stderr:drop table foo;' 2024-05-06T06:53:30.764 INFO:tasks.workunit.client.0.smithi070.stderr:+ printf %s 'create table if not exists foo (a INT); 2024-05-06T06:53:30.764 INFO:tasks.workunit.client.0.smithi070.stderr:insert into foo (a) values (RANDOM()); 2024-05-06T06:53:30.764 INFO:tasks.workunit.client.0.smithi070.stderr:drop table foo;' 2024-05-06T06:53:30.764 INFO:tasks.workunit.client.0.smithi070.stderr:create table if not exists foo (a INT); 2024-05-06T06:53:30.764 INFO:tasks.workunit.client.0.smithi070.stderr:insert into foo (a) values (RANDOM()); 2024-05-06T06:53:30.764 INFO:tasks.workunit.client.0.smithi070.stderr:drop table foo;+ '[' '' '!=' b ']' 2024-05-06T06:53:30.764 INFO:tasks.workunit.client.0.smithi070.stderr:+ wait 2024-05-06T06:53:30.764 INFO:tasks.workunit.client.0.smithi070.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-05-06T06:53:31.124 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-06T06:53:31.124 INFO:tasks.workunit.client.0.smithi070.stderr:real 0m0.362s 2024-05-06T06:53:31.124 INFO:tasks.workunit.client.0.smithi070.stderr:user 0m0.046s 2024-05-06T06:53:31.124 INFO:tasks.workunit.client.0.smithi070.stderr:sys 0m0.030s 2024-05-06T06:53:31.125 INFO:tasks.workunit.client.0.smithi070.stderr:+ striper stat baz.db 2024-05-06T06:53:31.125 INFO:tasks.workunit.client.0.smithi070.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper stat baz.db 2024-05-06T06:53:31.166 INFO:tasks.workunit.client.0.smithi070.stdout:cephsqlite/baz.db mtime 2024-05-06T06:53:31.000000+0000, size 8192 2024-05-06T06:53:31.169 INFO:tasks.workunit.client.0.smithi070.stderr:+ striper rm baz.db 2024-05-06T06:53:31.169 INFO:tasks.workunit.client.0.smithi070.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-05-06T06:53:31.219 INFO:tasks.workunit.client.0.smithi070.stderr:+ sqlite 2024-05-06T06:53:31.219 INFO:tasks.workunit.client.0.smithi070.stderr:++ repeat 10 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:31.219 INFO:tasks.workunit.client.0.smithi070.stderr:++ n=10 2024-05-06T06:53:31.219 INFO:tasks.workunit.client.0.smithi070.stderr:++ shift 2024-05-06T06:53:31.219 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i = 0 )) 2024-05-06T06:53:31.219 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 10 )) 2024-05-06T06:53:31.219 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:31.219 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 10 )) 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 10 )) 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 10 )) 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 10 )) 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 10 )) 2024-05-06T06:53:31.220 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:31.221 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:31.221 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 10 )) 2024-05-06T06:53:31.221 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:31.221 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:31.221 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 10 )) 2024-05-06T06:53:31.221 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:31.221 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:31.221 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 10 )) 2024-05-06T06:53:31.221 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 10 )) 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 10 )) 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:+ background= 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' '' = b ']' 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:++ cat 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:+ a='CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.222 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:SELECT LENGTH(text) FROM rand; 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:DROP TABLE rand;' 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:+ printf %s 'CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.223 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.224 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.224 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.224 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.224 INFO:tasks.workunit.client.0.smithi070.stderr:SELECT LENGTH(text) FROM rand; 2024-05-06T06:53:31.224 INFO:tasks.workunit.client.0.smithi070.stderr:DROP TABLE rand;' 2024-05-06T06:53:31.224 INFO:tasks.workunit.client.0.smithi070.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-05-06T06:53:31.224 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.224 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.224 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.224 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.224 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.224 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.225 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.225 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.225 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.225 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:31.225 INFO:tasks.workunit.client.0.smithi070.stderr:SELECT LENGTH(text) FROM rand; 2024-05-06T06:53:31.225 INFO:tasks.workunit.client.0.smithi070.stderr:DROP TABLE rand;+ '[' '' '!=' b ']' 2024-05-06T06:53:31.225 INFO:tasks.workunit.client.0.smithi070.stderr:+ wait 2024-05-06T06:53:31.225 INFO:tasks.workunit.client.0.smithi070.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-05-06T06:53:32.500 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:32.501 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:32.501 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:32.501 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:32.501 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:32.501 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:32.501 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:32.501 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:32.501 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:32.501 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:32.791 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-06T06:53:32.791 INFO:tasks.workunit.client.0.smithi070.stderr:real 0m1.574s 2024-05-06T06:53:32.791 INFO:tasks.workunit.client.0.smithi070.stderr:user 0m0.142s 2024-05-06T06:53:32.791 INFO:tasks.workunit.client.0.smithi070.stderr:sys 0m0.085s 2024-05-06T06:53:32.791 INFO:tasks.workunit.client.0.smithi070.stderr:+ sqlite 2024-05-06T06:53:32.799 INFO:tasks.workunit.client.0.smithi070.stderr:++ repeat 100 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.799 INFO:tasks.workunit.client.0.smithi070.stderr:++ n=100 2024-05-06T06:53:32.799 INFO:tasks.workunit.client.0.smithi070.stderr:++ shift 2024-05-06T06:53:32.799 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i = 0 )) 2024-05-06T06:53:32.799 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.799 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.800 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.801 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.802 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.803 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.804 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.805 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.806 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.807 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.808 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.809 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.810 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.811 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.812 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.813 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.814 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.815 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.816 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.817 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.818 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ echo 'INSERT INTO rand (text) VALUES (RANDOMBLOB(4096));' 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( ++i )) 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:++ (( i < 100 )) 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:+ background= 2024-05-06T06:53:32.819 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' '' = b ']' 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:++ cat 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:+ a='BEGIN TRANSACTION; 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.820 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.821 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.822 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.823 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.824 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.824 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.824 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.824 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.824 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.824 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.824 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.824 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.824 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.824 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.825 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.826 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.826 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.826 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.826 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.826 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.826 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.826 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.826 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.826 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.826 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.826 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.827 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.827 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.827 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.827 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.827 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.827 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.827 INFO:tasks.workunit.client.0.smithi070.stderr:COMMIT; 2024-05-06T06:53:32.827 INFO:tasks.workunit.client.0.smithi070.stderr:SELECT LENGTH(text) FROM rand; 2024-05-06T06:53:32.827 INFO:tasks.workunit.client.0.smithi070.stderr:DROP TABLE rand;' 2024-05-06T06:53:32.827 INFO:tasks.workunit.client.0.smithi070.stderr:+ printf %s 'BEGIN TRANSACTION; 2024-05-06T06:53:32.827 INFO:tasks.workunit.client.0.smithi070.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-05-06T06:53:32.827 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.828 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.829 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.830 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.831 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.832 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.833 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:COMMIT; 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:SELECT LENGTH(text) FROM rand; 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:DROP TABLE rand;' 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:BEGIN TRANSACTION; 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:CREATE TABLE IF NOT EXISTS rand(text BLOB NOT NULL); 2024-05-06T06:53:32.834 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.835 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.836 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.837 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.838 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.839 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.840 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO rand (text) VALUES (RANDOMBLOB(4096)); 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:COMMIT; 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:SELECT LENGTH(text) FROM rand; 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:DROP TABLE rand;+ '[' '' '!=' b ']' 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:+ wait 2024-05-06T06:53:32.841 INFO:tasks.workunit.client.0.smithi070.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-05-06T06:53:33.405 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.405 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.405 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.405 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.405 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.405 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.406 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.406 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.406 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.406 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.406 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.406 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.406 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.407 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.407 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.407 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.407 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.407 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.407 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.407 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.408 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.408 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.408 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.408 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.408 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.408 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.409 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.409 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.409 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.409 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.409 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.409 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.410 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.410 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.410 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.410 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.410 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.410 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.410 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.411 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.411 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.411 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.411 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.411 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.411 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.412 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.412 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.412 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.412 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.412 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.412 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.412 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.413 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.413 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.413 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.413 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.413 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.413 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.414 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.414 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.414 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.414 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.414 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.414 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.415 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.415 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.415 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.415 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.415 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.415 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.416 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.416 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.416 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.416 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.416 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.416 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.416 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.417 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.417 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.417 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.417 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.417 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.417 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.417 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.418 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.418 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.418 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.418 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.418 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.418 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.419 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.419 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.419 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.419 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.419 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.419 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:4096 2024-05-06T06:53:35.181 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-06T06:53:35.181 INFO:tasks.workunit.client.0.smithi070.stderr:real 0m2.390s 2024-05-06T06:53:35.181 INFO:tasks.workunit.client.0.smithi070.stderr:user 0m0.180s 2024-05-06T06:53:35.181 INFO:tasks.workunit.client.0.smithi070.stderr:sys 0m0.120s 2024-05-06T06:53:35.181 INFO:tasks.workunit.client.0.smithi070.stderr:+ striper rm baz.db 2024-05-06T06:53:35.181 INFO:tasks.workunit.client.0.smithi070.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-05-06T06:53:35.235 INFO:tasks.workunit.client.0.smithi070.stderr:+ date 2024-05-06T06:53:35.236 INFO:tasks.workunit.client.0.smithi070.stdout:Mon May 6 06:53:35 AM UTC 2024 2024-05-06T06:53:35.236 INFO:tasks.workunit.client.0.smithi070.stderr:+ sqlite b 2024-05-06T06:53:35.236 INFO:tasks.workunit.client.0.smithi070.stderr:+ background=b 2024-05-06T06:53:35.236 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' b = b ']' 2024-05-06T06:53:35.237 INFO:tasks.workunit.client.0.smithi070.stderr:+ shift 2024-05-06T06:53:35.237 INFO:tasks.workunit.client.0.smithi070.stderr:++ cat 2024-05-06T06:53:35.237 INFO:tasks.workunit.client.0.smithi070.stderr:+ a='CREATE TABLE foo (a BLOB); 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO foo VALUES ("start"); 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr:WITH RECURSIVE c(x) AS 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr: ( 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr: VALUES(1) 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr: UNION ALL 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr: SELECT x+1 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr: FROM c 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr: ) 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO foo (a) 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr: SELECT RANDOMBLOB(1<<20) 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr: FROM c 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr: LIMIT (1<<20);' 2024-05-06T06:53:35.238 INFO:tasks.workunit.client.0.smithi070.stderr:+ printf %s 'CREATE TABLE foo (a BLOB); 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO foo VALUES ("start"); 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr:WITH RECURSIVE c(x) AS 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr: ( 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr: VALUES(1) 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr: UNION ALL 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr: SELECT x+1 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr: FROM c 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr: ) 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO foo (a) 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr: SELECT RANDOMBLOB(1<<20) 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr: FROM c 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr: LIMIT (1<<20);' 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr:CREATE TABLE foo (a BLOB); 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO foo VALUES ("start"); 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr:WITH RECURSIVE c(x) AS 2024-05-06T06:53:35.239 INFO:tasks.workunit.client.0.smithi070.stderr: ( 2024-05-06T06:53:35.240 INFO:tasks.workunit.client.0.smithi070.stderr: VALUES(1) 2024-05-06T06:53:35.240 INFO:tasks.workunit.client.0.smithi070.stderr: UNION ALL 2024-05-06T06:53:35.240 INFO:tasks.workunit.client.0.smithi070.stderr: SELECT x+1 2024-05-06T06:53:35.240 INFO:tasks.workunit.client.0.smithi070.stderr: FROM c 2024-05-06T06:53:35.240 INFO:tasks.workunit.client.0.smithi070.stderr: ) 2024-05-06T06:53:35.240 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO foo (a) 2024-05-06T06:53:35.240 INFO:tasks.workunit.client.0.smithi070.stderr: SELECT RANDOMBLOB(1<<20) 2024-05-06T06:53:35.240 INFO:tasks.workunit.client.0.smithi070.stderr: FROM c 2024-05-06T06:53:35.240 INFO:tasks.workunit.client.0.smithi070.stderr: LIMIT (1<<20);+ '[' b '!=' b ']' 2024-05-06T06:53:35.240 INFO:tasks.workunit.client.0.smithi070.stderr:+ sleep 10 2024-05-06T06:53:35.240 INFO:tasks.workunit.client.0.smithi070.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-05-06T06:53:45.239 INFO:tasks.workunit.client.0.smithi070.stdout:done 2024-05-06T06:53:45.239 INFO:tasks.workunit.client.0.smithi070.stderr:+ echo done 2024-05-06T06:53:45.239 INFO:tasks.workunit.client.0.smithi070.stderr:+ jobs -l 2024-05-06T06:53:45.240 INFO:tasks.workunit.client.0.smithi070.stdout:[1]+ 30261 Running sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" & 2024-05-06T06:53:45.240 INFO:tasks.workunit.client.0.smithi070.stderr:++ jobs -p 2024-05-06T06:53:45.240 INFO:tasks.workunit.client.0.smithi070.stderr:+ kill -KILL -- 30261 2024-05-06T06:53:45.240 INFO:tasks.workunit.client.0.smithi070.stderr:+ date 2024-05-06T06:53:45.241 INFO:tasks.workunit.client.0.smithi070.stdout:Mon May 6 06:53:45 AM UTC 2024 2024-05-06T06:53:45.241 INFO:tasks.workunit.client.0.smithi070.stderr:+ wait 2024-05-06T06:53:45.244 INFO:tasks.workunit.client.0.smithi070.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh: line 95: 30261 Killed sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" 2024-05-06T06:53:45.245 INFO:tasks.workunit.client.0.smithi070.stderr:+ date 2024-05-06T06:53:45.245 INFO:tasks.workunit.client.0.smithi070.stdout:Mon May 6 06:53:45 AM UTC 2024 2024-05-06T06:53:45.246 INFO:tasks.workunit.client.0.smithi070.stderr:++ sqlite 2024-05-06T06:53:45.246 INFO:tasks.workunit.client.0.smithi070.stderr:++ background= 2024-05-06T06:53:45.246 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' '' = b ']' 2024-05-06T06:53:45.247 INFO:tasks.workunit.client.0.smithi070.stderr:+++ cat 2024-05-06T06:53:45.247 INFO:tasks.workunit.client.0.smithi070.stderr:++ a='SELECT COUNT(*) FROM foo;' 2024-05-06T06:53:45.248 INFO:tasks.workunit.client.0.smithi070.stderr:++ printf %s 'SELECT COUNT(*) FROM foo;' 2024-05-06T06:53:45.248 INFO:tasks.workunit.client.0.smithi070.stderr:SELECT COUNT(*) FROM foo;++ '[' '' '!=' b ']' 2024-05-06T06:53:45.248 INFO:tasks.workunit.client.0.smithi070.stderr:++ wait 2024-05-06T06:53:45.248 INFO:tasks.workunit.client.0.smithi070.stderr:++ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-05-06T06:54:14.832 INFO:tasks.workunit.client.0.smithi070.stderr:+ n=1 2024-05-06T06:54:14.832 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' 1 -eq 1 ']' 2024-05-06T06:54:14.832 INFO:tasks.workunit.client.0.smithi070.stderr:+ striper rm baz.db 2024-05-06T06:54:14.832 INFO:tasks.workunit.client.0.smithi070.stderr:+ rados --pool=cephsqlite --namespace=test_libcephsqlite.sh --striper rm baz.db 2024-05-06T06:54:14.891 INFO:tasks.workunit.client.0.smithi070.stderr:+ date 2024-05-06T06:54:14.892 INFO:tasks.workunit.client.0.smithi070.stdout:Mon May 6 06:54:14 AM UTC 2024 2024-05-06T06:54:14.892 INFO:tasks.workunit.client.0.smithi070.stderr:+ sqlite b 2024-05-06T06:54:14.892 INFO:tasks.workunit.client.0.smithi070.stderr:+ background=b 2024-05-06T06:54:14.893 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' b = b ']' 2024-05-06T06:54:14.893 INFO:tasks.workunit.client.0.smithi070.stderr:+ shift 2024-05-06T06:54:14.893 INFO:tasks.workunit.client.0.smithi070.stderr:++ cat 2024-05-06T06:54:14.894 INFO:tasks.workunit.client.0.smithi070.stderr:+ a='CREATE TABLE foo (a BLOB); 2024-05-06T06:54:14.894 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO foo VALUES ("start"); 2024-05-06T06:54:14.894 INFO:tasks.workunit.client.0.smithi070.stderr:WITH RECURSIVE c(x) AS 2024-05-06T06:54:14.894 INFO:tasks.workunit.client.0.smithi070.stderr: ( 2024-05-06T06:54:14.894 INFO:tasks.workunit.client.0.smithi070.stderr: VALUES(1) 2024-05-06T06:54:14.894 INFO:tasks.workunit.client.0.smithi070.stderr: UNION ALL 2024-05-06T06:54:14.894 INFO:tasks.workunit.client.0.smithi070.stderr: SELECT x+1 2024-05-06T06:54:14.894 INFO:tasks.workunit.client.0.smithi070.stderr: FROM c 2024-05-06T06:54:14.894 INFO:tasks.workunit.client.0.smithi070.stderr: ) 2024-05-06T06:54:14.894 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO foo (a) 2024-05-06T06:54:14.894 INFO:tasks.workunit.client.0.smithi070.stderr: SELECT RANDOMBLOB(1<<20) 2024-05-06T06:54:14.894 INFO:tasks.workunit.client.0.smithi070.stderr: FROM c 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr: LIMIT (1<<20);' 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr:+ printf %s 'CREATE TABLE foo (a BLOB); 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO foo VALUES ("start"); 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr:WITH RECURSIVE c(x) AS 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr: ( 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr: VALUES(1) 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr: UNION ALL 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr: SELECT x+1 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr: FROM c 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr: ) 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO foo (a) 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr: SELECT RANDOMBLOB(1<<20) 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr: FROM c 2024-05-06T06:54:14.895 INFO:tasks.workunit.client.0.smithi070.stderr: LIMIT (1<<20);' 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr:CREATE TABLE foo (a BLOB); 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO foo VALUES ("start"); 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr:WITH RECURSIVE c(x) AS 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr: ( 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr: VALUES(1) 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr: UNION ALL 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr: SELECT x+1 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr: FROM c 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr: ) 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr:INSERT INTO foo (a) 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr: SELECT RANDOMBLOB(1<<20) 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr: FROM c 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr: LIMIT (1<<20);+ '[' b '!=' b ']' 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr:+ sleep 20 2024-05-06T06:54:14.896 INFO:tasks.workunit.client.0.smithi070.stderr:+ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-05-06T06:54:34.894 INFO:tasks.workunit.client.0.smithi070.stderr:+ jobs -l 2024-05-06T06:54:34.895 INFO:tasks.workunit.client.0.smithi070.stdout:[1]+ 30330 Running sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd ".open file:///$pool:$ns/baz.db?vfs=ceph" -cmd '.output stdout' <<< "$a" & 2024-05-06T06:54:34.895 INFO:tasks.workunit.client.0.smithi070.stderr:++ jobs -p 2024-05-06T06:54:34.895 INFO:tasks.workunit.client.0.smithi070.stderr:+ kill -STOP -- 30330 2024-05-06T06:54:34.895 INFO:tasks.workunit.client.0.smithi070.stderr:+ sleep 45 2024-05-06T06:55:19.896 INFO:tasks.workunit.client.0.smithi070.stderr:+ date 2024-05-06T06:55:19.896 INFO:tasks.workunit.client.0.smithi070.stdout:Mon May 6 06:55:19 AM UTC 2024 2024-05-06T06:55:19.898 INFO:tasks.workunit.client.0.smithi070.stderr:++ jobs -p 2024-05-06T06:55:19.898 INFO:tasks.workunit.client.0.smithi070.stderr:+ kill -CONT -- 30330 2024-05-06T06:55:19.898 INFO:tasks.workunit.client.0.smithi070.stderr:+ sleep 10 2024-05-06T06:55:20.012 INFO:tasks.workunit.client.0.smithi070.stderr:Error: near line 3: stepping, disk I/O error (10) 2024-05-06T06:55:29.899 INFO:tasks.workunit.client.0.smithi070.stderr:+ date 2024-05-06T06:55:29.900 INFO:tasks.workunit.client.0.smithi070.stdout:Mon May 6 06:55:29 AM UTC 2024 2024-05-06T06:55:29.900 INFO:tasks.workunit.client.0.smithi070.stderr:+ wait 2024-05-06T06:55:29.900 INFO:tasks.workunit.client.0.smithi070.stderr:+ date 2024-05-06T06:55:29.901 INFO:tasks.workunit.client.0.smithi070.stdout:Mon May 6 06:55:29 AM UTC 2024 2024-05-06T06:55:29.902 INFO:tasks.workunit.client.0.smithi070.stderr:++ sqlite 2024-05-06T06:55:29.902 INFO:tasks.workunit.client.0.smithi070.stderr:++ background= 2024-05-06T06:55:29.902 INFO:tasks.workunit.client.0.smithi070.stderr:++ '[' '' = b ']' 2024-05-06T06:55:29.903 INFO:tasks.workunit.client.0.smithi070.stderr:+++ cat 2024-05-06T06:55:29.904 INFO:tasks.workunit.client.0.smithi070.stderr:++ a='SELECT COUNT(*) FROM foo;' 2024-05-06T06:55:29.904 INFO:tasks.workunit.client.0.smithi070.stderr:++ printf %s 'SELECT COUNT(*) FROM foo;' 2024-05-06T06:55:29.904 INFO:tasks.workunit.client.0.smithi070.stderr:SELECT COUNT(*) FROM foo;++ '[' '' '!=' b ']' 2024-05-06T06:55:29.904 INFO:tasks.workunit.client.0.smithi070.stderr:++ wait 2024-05-06T06:55:29.905 INFO:tasks.workunit.client.0.smithi070.stderr:++ sqlite3 -cmd '.output /dev/null' -cmd '.load libcephsqlite.so' -cmd 'pragma journal_mode = PERSIST' -cmd '.open file:///cephsqlite:test_libcephsqlite.sh/baz.db?vfs=ceph' -cmd '.output stdout' 2024-05-06T06:55:31.015 INFO:tasks.workunit.client.0.smithi070.stderr:+ n=1 2024-05-06T06:55:31.015 INFO:tasks.workunit.client.0.smithi070.stderr:+ '[' 1 -eq 1 ']' 2024-05-06T06:55:31.015 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-06T06:55:31.015 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-06T06:55:31.070 INFO:tasks.workunit:Stopping ['rados/test_libcephsqlite.sh cephsqlite'] on client.0... 2024-05-06T06:55:31.070 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-06T06:55:31.426 DEBUG:teuthology.parallel:result is None 2024-05-06T06:55:31.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-06T06:55:31.439 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-06T06:55:31.439 DEBUG:teuthology.orchestra.run.smithi070:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-05-06T06:55:31.501 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-05-06T06:55:31.502 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-06T06:55:31.512 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-06T06:55:31.512 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-06T06:55:31.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd01ac69640 1 Processor -- start 2024-05-06T06:55:31.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd01ac69640 1 -- start start 2024-05-06T06:55:31.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd01ac69640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0141475f0 con 0x7fd014072340 2024-05-06T06:55:31.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd01ac69640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd014070b40 con 0x7fd014147210 2024-05-06T06:55:31.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd01ac69640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd014073df0 con 0x7fd014142d50 2024-05-06T06:55:31.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00bfff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd014072340 0x7fd014070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49596/0 (socket says 172.21.15.70:49596) 2024-05-06T06:55:31.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00bfff640 1 -- 172.21.15.70:0/1978010009 learned_addr learned my addr 172.21.15.70:0/1978010009 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:31.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00b7fe640 1 -- 172.21.15.70:0/1978010009 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4287196747 0 0) 0x7fd014073df0 con 0x7fd014142d50 2024-05-06T06:55:31.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00b7fe640 1 -- 172.21.15.70:0/1978010009 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcffc003530 con 0x7fd014142d50 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00b7fe640 1 -- 172.21.15.70:0/1978010009 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263830510 0 0) 0x7fd004001120 con 0x7fd014072340 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00b7fe640 1 -- 172.21.15.70:0/1978010009 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd014073df0 con 0x7fd014072340 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00b7fe640 1 -- 172.21.15.70:0/1978010009 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4088145825 0 0) 0x7fcffc003530 con 0x7fd014142d50 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00b7fe640 1 -- 172.21.15.70:0/1978010009 >> v1:172.21.15.184:6789/0 conn(0x7fd014147210 legacy=0x7fd0141478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00b7fe640 1 -- 172.21.15.70:0/1978010009 >> v1:172.21.15.70:6789/0 conn(0x7fd014072340 legacy=0x7fd014070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00b7fe640 1 -- 172.21.15.70:0/1978010009 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0140740d0 con 0x7fd014142d50 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00b7fe640 1 -- 172.21.15.70:0/1978010009 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd00c001950 con 0x7fd014142d50 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00b7fe640 1 -- 172.21.15.70:0/1978010009 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd00c001b70 con 0x7fd014142d50 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd00b7fe640 1 -- 172.21.15.70:0/1978010009 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd00c001f40 con 0x7fd014142d50 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd01ac69640 1 -- 172.21.15.70:0/1978010009 >> v1:172.21.15.70:6790/0 conn(0x7fd014142d50 legacy=0x7fd0141431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd01ac69640 1 -- 172.21.15.70:0/1978010009 shutdown_connections 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd01ac69640 1 -- 172.21.15.70:0/1978010009 >> 172.21.15.70:0/1978010009 conn(0x7fd0140b6150 msgr2=0x7fd0140b6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd01ac69640 1 -- 172.21.15.70:0/1978010009 shutdown_connections 2024-05-06T06:55:31.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.667+0000 7fd01ac69640 1 -- 172.21.15.70:0/1978010009 wait complete. 2024-05-06T06:55:31.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd01ac69640 1 Processor -- start 2024-05-06T06:55:31.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd01ac69640 1 -- start start 2024-05-06T06:55:31.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd01ac69640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd01413f830 con 0x7fd014142d50 2024-05-06T06:55:31.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd01ac69640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd014138230 con 0x7fd014146160 2024-05-06T06:55:31.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd01ac69640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd014138510 con 0x7fd014147210 2024-05-06T06:55:31.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd018a05640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd014142d50 0x7fd014136820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49612/0 (socket says 172.21.15.70:49612) 2024-05-06T06:55:31.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd018a05640 1 -- 172.21.15.70:0/1763869499 learned_addr learned my addr 172.21.15.70:0/1763869499 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:31.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 775788073 0 0) 0x7fd014138510 con 0x7fd014147210 2024-05-06T06:55:31.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd000003530 con 0x7fd014147210 2024-05-06T06:55:31.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3339452764 0 0) 0x7fd01413f830 con 0x7fd014142d50 2024-05-06T06:55:31.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd014138510 con 0x7fd014142d50 2024-05-06T06:55:31.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2083488037 0 0) 0x7fd000003530 con 0x7fd014147210 2024-05-06T06:55:31.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd01413f830 con 0x7fd014147210 2024-05-06T06:55:31.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd004001b10 con 0x7fd014147210 2024-05-06T06:55:31.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4057892315 0 0) 0x7fd014138510 con 0x7fd014142d50 2024-05-06T06:55:31.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd000003530 con 0x7fd014142d50 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd0100018a0 con 0x7fd014142d50 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 657161573 0 0) 0x7fd014138230 con 0x7fd014146160 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd014138510 con 0x7fd014146160 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 308414304 0 0) 0x7fd01413f830 con 0x7fd014147210 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 >> v1:172.21.15.184:6789/0 conn(0x7fd014146160 legacy=0x7fd0141e35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 >> v1:172.21.15.70:6789/0 conn(0x7fd014142d50 legacy=0x7fd014136820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0141387f0 con 0x7fd014147210 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd01ac69640 1 -- 172.21.15.70:0/1763869499 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd014136020 con 0x7fd014147210 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd01ac69640 1 -- 172.21.15.70:0/1763869499 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd0141e4ed0 con 0x7fd014147210 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0040047f0 con 0x7fd014147210 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd004004b40 con 0x7fd014147210 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd01ac69640 1 -- 172.21.15.70:0/1763869499 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff4005090 con 0x7fd014147210 2024-05-06T06:55:31.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fd00401b8e0 con 0x7fd014147210 2024-05-06T06:55:31.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.671+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7fd00408a820 con 0x7fd014147210 2024-05-06T06:55:31.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.679+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fd0141475f0 con 0x7fd014147210 2024-05-06T06:55:31.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.835+0000 7fd01ac69640 1 -- 172.21.15.70:0/1763869499 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcff4000ba0 con 0x7fd000070080 2024-05-06T06:55:31.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.839+0000 7fd0097fa640 1 -- 172.21.15.70:0/1763869499 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117578 (unknown 2965378022 0 250132621) 0x7fcff4000ba0 con 0x7fd000070080 2024-05-06T06:55:31.843 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:55:31.844 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-06T06:55:31.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.839+0000 7fd01ac69640 1 -- 172.21.15.70:0/1763869499 >> v1:172.21.15.70:6816/2757942729 conn(0x7fd000070080 legacy=0x7fd000072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:31.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.839+0000 7fd01ac69640 1 -- 172.21.15.70:0/1763869499 >> v1:172.21.15.70:6790/0 conn(0x7fd014147210 legacy=0x7fd014138c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:31.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.839+0000 7fd01ac69640 1 -- 172.21.15.70:0/1763869499 shutdown_connections 2024-05-06T06:55:31.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.839+0000 7fd01ac69640 1 -- 172.21.15.70:0/1763869499 >> 172.21.15.70:0/1763869499 conn(0x7fd0140b6150 msgr2=0x7fd014075e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:31.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.843+0000 7fd01ac69640 1 -- 172.21.15.70:0/1763869499 shutdown_connections 2024-05-06T06:55:31.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.843+0000 7fd01ac69640 1 -- 172.21.15.70:0/1763869499 wait complete. 2024-05-06T06:55:31.861 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-05-06T06:55:30.874248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3568751912,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":0,"num_read":2560,"num_read_kb":2560,"num_write":157373,"num_write_kb":5628441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":803710944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158530,"ondisk_log_size":158530,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8584200,"kb_used_data":6681992,"kb_used_omap":12,"kb_used_meta":1902131,"kb_avail":746390520,"statfs":{"total":773094113280,"available":764303892480,"internally_reserved":0,"allocated":6842359808,"data_stored":6836421336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1947782706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":57344,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.217641"},"pg_stats":[{"pgid":"3.1f","version":"31'2969","reported_seq":3006,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.709247+0000","last_change":"2024-05-06T06:51:26.754879+0000","last_active":"2024-05-06T06:54:14.709247+0000","last_peered":"2024-05-06T06:54:14.709247+0000","last_clean":"2024-05-06T06:54:14.709247+0000","last_became_active":"2024-05-06T06:51:26.752788+0000","last_became_peered":"2024-05-06T06:51:26.752788+0000","last_unstale":"2024-05-06T06:54:14.709247+0000","last_undegraded":"2024-05-06T06:54:14.709247+0000","last_fullsized":"2024-05-06T06:54:14.709247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":2969,"log_dups_size":0,"ondisk_log_size":2969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:35:28.118229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":2975,"num_write_kb":148098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'6529","reported_seq":6597,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:22.863349+0000","last_change":"2024-05-06T06:51:26.753516+0000","last_active":"2024-05-06T06:54:22.863349+0000","last_peered":"2024-05-06T06:54:22.863349+0000","last_clean":"2024-05-06T06:54:22.863349+0000","last_became_active":"2024-05-06T06:51:26.752122+0000","last_became_peered":"2024-05-06T06:51:26.752122+0000","last_unstale":"2024-05-06T06:54:22.863349+0000","last_undegraded":"2024-05-06T06:54:22.863349+0000","last_fullsized":"2024-05-06T06:54:22.863349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":6529,"log_dups_size":0,"ondisk_log_size":6529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:03:49.598052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113386000,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":120,"num_read_kb":227,"num_write":6557,"num_write_kb":229051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4538","reported_seq":4573,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:27.666196+0000","last_change":"2024-05-06T06:51:26.741411+0000","last_active":"2024-05-06T06:54:27.666196+0000","last_peered":"2024-05-06T06:54:27.666196+0000","last_clean":"2024-05-06T06:54:27.666196+0000","last_became_active":"2024-05-06T06:51:26.740563+0000","last_became_peered":"2024-05-06T06:51:26.740563+0000","last_unstale":"2024-05-06T06:54:27.666196+0000","last_undegraded":"2024-05-06T06:54:27.666196+0000","last_fullsized":"2024-05-06T06:54:27.666196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4538,"log_dups_size":0,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:16:06.472308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99223376,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4514,"num_write_kb":149245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2965","reported_seq":3043,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.774270+0000","last_change":"2024-05-06T06:52:18.729663+0000","last_active":"2024-05-06T06:54:14.774270+0000","last_peered":"2024-05-06T06:54:14.774270+0000","last_clean":"2024-05-06T06:54:14.774270+0000","last_became_active":"2024-05-06T06:52:18.728975+0000","last_became_peered":"2024-05-06T06:52:18.728975+0000","last_unstale":"2024-05-06T06:54:14.774270+0000","last_undegraded":"2024-05-06T06:54:14.774270+0000","last_fullsized":"2024-05-06T06:54:14.774270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":2965,"log_dups_size":0,"ondisk_log_size":2965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:33:32.914971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2956,"num_write_kb":148097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71285744,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3511","reported_seq":3547,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.137926+0000","last_change":"2024-05-06T06:51:26.742049+0000","last_active":"2024-05-06T06:54:15.137926+0000","last_peered":"2024-05-06T06:54:15.137926+0000","last_clean":"2024-05-06T06:54:15.137926+0000","last_became_active":"2024-05-06T06:51:26.739617+0000","last_became_peered":"2024-05-06T06:51:26.739617+0000","last_unstale":"2024-05-06T06:54:15.137926+0000","last_undegraded":"2024-05-06T06:54:15.137926+0000","last_fullsized":"2024-05-06T06:54:15.137926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3511,"log_dups_size":0,"ondisk_log_size":3511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:08:25.394244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109117960,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":3468,"num_write_kb":138775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"32'5825","reported_seq":5907,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:21.468054+0000","last_change":"2024-05-06T06:52:20.775208+0000","last_active":"2024-05-06T06:54:21.468054+0000","last_peered":"2024-05-06T06:54:21.468054+0000","last_clean":"2024-05-06T06:54:21.468054+0000","last_became_active":"2024-05-06T06:52:20.774523+0000","last_became_peered":"2024-05-06T06:52:20.774523+0000","last_unstale":"2024-05-06T06:54:21.468054+0000","last_undegraded":"2024-05-06T06:54:21.468054+0000","last_fullsized":"2024-05-06T06:54:21.468054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5825,"log_dups_size":0,"ondisk_log_size":5825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:10:28.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":74,"num_read_kb":59,"num_write":5831,"num_write_kb":173444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":76111888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"32'4106","reported_seq":4144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:32.487603+0000","last_change":"2024-05-06T06:51:26.749392+0000","last_active":"2024-05-06T06:54:32.487603+0000","last_peered":"2024-05-06T06:54:32.487603+0000","last_clean":"2024-05-06T06:54:32.487603+0000","last_became_active":"2024-05-06T06:51:26.748230+0000","last_became_peered":"2024-05-06T06:51:26.748230+0000","last_unstale":"2024-05-06T06:54:32.487603+0000","last_undegraded":"2024-05-06T06:54:32.487603+0000","last_fullsized":"2024-05-06T06:54:32.487603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4106,"log_dups_size":0,"ondisk_log_size":4106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:25:50.342372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104989200,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":4066,"num_write_kb":140299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"32'7187","reported_seq":7222,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:32.390822+0000","last_change":"2024-05-06T06:51:26.751423+0000","last_active":"2024-05-06T06:54:32.390822+0000","last_peered":"2024-05-06T06:54:32.390822+0000","last_clean":"2024-05-06T06:54:32.390822+0000","last_became_active":"2024-05-06T06:51:26.750654+0000","last_became_peered":"2024-05-06T06:51:26.750654+0000","last_unstale":"2024-05-06T06:54:32.390822+0000","last_undegraded":"2024-05-06T06:54:32.390822+0000","last_fullsized":"2024-05-06T06:54:32.390822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":7187,"log_dups_size":0,"ondisk_log_size":7187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:19:30.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7185,"num_write_kb":217990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'7408","reported_seq":7455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:55:20.041464+0000","last_change":"2024-05-06T06:51:26.753573+0000","last_active":"2024-05-06T06:55:20.041464+0000","last_peered":"2024-05-06T06:55:20.041464+0000","last_clean":"2024-05-06T06:55:20.041464+0000","last_became_active":"2024-05-06T06:51:26.748155+0000","last_became_peered":"2024-05-06T06:51:26.748155+0000","last_unstale":"2024-05-06T06:55:20.041464+0000","last_undegraded":"2024-05-06T06:55:20.041464+0000","last_fullsized":"2024-05-06T06:55:20.041464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":7408,"log_dups_size":0,"ondisk_log_size":7408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:05:08.144920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153731072,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":7429,"num_write_kb":226728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'3681","reported_seq":3708,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.144504+0000","last_change":"2024-05-06T06:52:18.738992+0000","last_active":"2024-05-06T06:54:15.144504+0000","last_peered":"2024-05-06T06:54:15.144504+0000","last_clean":"2024-05-06T06:54:15.144504+0000","last_became_active":"2024-05-06T06:52:18.736778+0000","last_became_peered":"2024-05-06T06:52:18.736778+0000","last_unstale":"2024-05-06T06:54:15.144504+0000","last_undegraded":"2024-05-06T06:54:15.144504+0000","last_fullsized":"2024-05-06T06:54:15.144504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3681,"log_dups_size":0,"ondisk_log_size":3681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:39:38.190258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":3674,"num_write_kb":159628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":73965900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"32'7465","reported_seq":7506,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:32.437036+0000","last_change":"2024-05-06T06:51:26.746880+0000","last_active":"2024-05-06T06:54:32.437036+0000","last_peered":"2024-05-06T06:54:32.437036+0000","last_clean":"2024-05-06T06:54:32.437036+0000","last_became_active":"2024-05-06T06:51:26.746151+0000","last_became_peered":"2024-05-06T06:51:26.746151+0000","last_unstale":"2024-05-06T06:54:32.437036+0000","last_undegraded":"2024-05-06T06:54:32.437036+0000","last_fullsized":"2024-05-06T06:54:32.437036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":7465,"log_dups_size":0,"ondisk_log_size":7465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:13:48.503450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":7477,"num_write_kb":218253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"32'6671","reported_seq":6728,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:25.949441+0000","last_change":"2024-05-06T06:51:26.746657+0000","last_active":"2024-05-06T06:54:25.949441+0000","last_peered":"2024-05-06T06:54:25.949441+0000","last_clean":"2024-05-06T06:54:25.949441+0000","last_became_active":"2024-05-06T06:51:26.742366+0000","last_became_peered":"2024-05-06T06:51:26.742366+0000","last_unstale":"2024-05-06T06:54:25.949441+0000","last_undegraded":"2024-05-06T06:54:25.949441+0000","last_fullsized":"2024-05-06T06:54:25.949441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":6671,"log_dups_size":0,"ondisk_log_size":6671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:21:22.835580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118949544,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":66,"num_read_kb":180,"num_write":6679,"num_write_kb":179976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.769379+0000","last_change":"2024-05-06T06:51:20.687085+0000","last_active":"2024-05-06T06:54:14.769379+0000","last_peered":"2024-05-06T06:54:14.769379+0000","last_clean":"2024-05-06T06:54:14.769379+0000","last_became_active":"2024-05-06T06:51:20.686210+0000","last_became_peered":"2024-05-06T06:51:20.686210+0000","last_unstale":"2024-05-06T06:54:14.769379+0000","last_undegraded":"2024-05-06T06:54:14.769379+0000","last_fullsized":"2024-05-06T06:54:14.769379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:25:00.217824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"32'5440","reported_seq":5480,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:29.001250+0000","last_change":"2024-05-06T06:51:26.743483+0000","last_active":"2024-05-06T06:54:29.001250+0000","last_peered":"2024-05-06T06:54:29.001250+0000","last_clean":"2024-05-06T06:54:29.001250+0000","last_became_active":"2024-05-06T06:51:26.742236+0000","last_became_peered":"2024-05-06T06:51:26.742236+0000","last_unstale":"2024-05-06T06:54:29.001250+0000","last_undegraded":"2024-05-06T06:54:29.001250+0000","last_fullsized":"2024-05-06T06:54:29.001250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5440,"log_dups_size":0,"ondisk_log_size":5440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:50:36.854004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":5423,"num_write_kb":147572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.774801+0000","last_change":"2024-05-06T06:51:20.689651+0000","last_active":"2024-05-06T06:54:14.774801+0000","last_peered":"2024-05-06T06:54:14.774801+0000","last_clean":"2024-05-06T06:54:14.774801+0000","last_became_active":"2024-05-06T06:51:20.689362+0000","last_became_peered":"2024-05-06T06:51:20.689362+0000","last_unstale":"2024-05-06T06:54:14.774801+0000","last_undegraded":"2024-05-06T06:54:14.774801+0000","last_fullsized":"2024-05-06T06:54:14.774801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T16:42:56.711253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'3344","reported_seq":3396,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.135233+0000","last_change":"2024-05-06T06:51:26.760042+0000","last_active":"2024-05-06T06:54:15.135233+0000","last_peered":"2024-05-06T06:54:15.135233+0000","last_clean":"2024-05-06T06:54:15.135233+0000","last_became_active":"2024-05-06T06:51:26.759151+0000","last_became_peered":"2024-05-06T06:51:26.759151+0000","last_unstale":"2024-05-06T06:54:15.135233+0000","last_undegraded":"2024-05-06T06:54:15.135233+0000","last_fullsized":"2024-05-06T06:54:15.135233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:47:45.966056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":62,"num_read_kb":52,"num_write":3319,"num_write_kb":144515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.767478+0000","last_change":"2024-05-06T06:51:20.681448+0000","last_active":"2024-05-06T06:54:14.767478+0000","last_peered":"2024-05-06T06:54:14.767478+0000","last_clean":"2024-05-06T06:54:14.767478+0000","last_became_active":"2024-05-06T06:51:20.680436+0000","last_became_peered":"2024-05-06T06:51:20.680436+0000","last_unstale":"2024-05-06T06:54:14.767478+0000","last_undegraded":"2024-05-06T06:54:14.767478+0000","last_fullsized":"2024-05-06T06:54:14.767478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:23:10.287147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"32'6226","reported_seq":6261,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:34.687973+0000","last_change":"2024-05-06T06:51:26.752252+0000","last_active":"2024-05-06T06:54:34.687973+0000","last_peered":"2024-05-06T06:54:34.687973+0000","last_clean":"2024-05-06T06:54:34.687973+0000","last_became_active":"2024-05-06T06:51:26.749599+0000","last_became_peered":"2024-05-06T06:51:26.749599+0000","last_unstale":"2024-05-06T06:54:34.687973+0000","last_undegraded":"2024-05-06T06:54:34.687973+0000","last_fullsized":"2024-05-06T06:54:34.687973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":6226,"log_dups_size":0,"ondisk_log_size":6226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:46:39.000857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6220,"num_write_kb":148484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.778648+0000","last_change":"2024-05-06T06:51:20.686480+0000","last_active":"2024-05-06T06:54:14.778648+0000","last_peered":"2024-05-06T06:54:14.778648+0000","last_clean":"2024-05-06T06:54:14.778648+0000","last_became_active":"2024-05-06T06:51:20.686231+0000","last_became_peered":"2024-05-06T06:51:20.686231+0000","last_unstale":"2024-05-06T06:54:14.778648+0000","last_undegraded":"2024-05-06T06:54:14.778648+0000","last_fullsized":"2024-05-06T06:54:14.778648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:07:14.251359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'3600","reported_seq":3635,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.770875+0000","last_change":"2024-05-06T06:51:26.750208+0000","last_active":"2024-05-06T06:54:14.770875+0000","last_peered":"2024-05-06T06:54:14.770875+0000","last_clean":"2024-05-06T06:54:14.770875+0000","last_became_active":"2024-05-06T06:51:26.744763+0000","last_became_peered":"2024-05-06T06:51:26.744763+0000","last_unstale":"2024-05-06T06:54:14.770875+0000","last_undegraded":"2024-05-06T06:54:14.770875+0000","last_fullsized":"2024-05-06T06:54:14.770875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:46:18.695132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3599,"num_write_kb":189058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"31'2476","reported_seq":2540,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.715665+0000","last_change":"2024-05-06T06:52:22.736330+0000","last_active":"2024-05-06T06:54:14.715665+0000","last_peered":"2024-05-06T06:54:14.715665+0000","last_clean":"2024-05-06T06:54:14.715665+0000","last_became_active":"2024-05-06T06:52:22.735643+0000","last_became_peered":"2024-05-06T06:52:22.735643+0000","last_unstale":"2024-05-06T06:54:14.715665+0000","last_undegraded":"2024-05-06T06:54:14.715665+0000","last_fullsized":"2024-05-06T06:54:14.715665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":2476,"log_dups_size":0,"ondisk_log_size":2476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:27:09.052165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78252880,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":52,"num_read_kb":42,"num_write":2515,"num_write_kb":118108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":69827576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.773819+0000","last_change":"2024-05-06T06:51:20.689365+0000","last_active":"2024-05-06T06:54:14.773819+0000","last_peered":"2024-05-06T06:54:14.773819+0000","last_clean":"2024-05-06T06:54:14.773819+0000","last_became_active":"2024-05-06T06:51:20.688666+0000","last_became_peered":"2024-05-06T06:51:20.688666+0000","last_unstale":"2024-05-06T06:54:14.773819+0000","last_undegraded":"2024-05-06T06:54:14.773819+0000","last_fullsized":"2024-05-06T06:54:14.773819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:39:52.485414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"32'3847","reported_seq":4194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.133558+0000","last_change":"2024-05-06T06:51:26.751274+0000","last_active":"2024-05-06T06:54:15.133558+0000","last_peered":"2024-05-06T06:54:15.133558+0000","last_clean":"2024-05-06T06:54:15.133558+0000","last_became_active":"2024-05-06T06:51:26.750274+0000","last_became_peered":"2024-05-06T06:51:26.750274+0000","last_unstale":"2024-05-06T06:54:15.133558+0000","last_undegraded":"2024-05-06T06:54:15.133558+0000","last_fullsized":"2024-05-06T06:54:15.133558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3847,"log_dups_size":0,"ondisk_log_size":3847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:09:24.523363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92405760,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1046,"num_read_kb":996,"num_write":4130,"num_write_kb":185537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.719033+0000","last_change":"2024-05-06T06:51:20.784004+0000","last_active":"2024-05-06T06:54:14.719033+0000","last_peered":"2024-05-06T06:54:14.719033+0000","last_clean":"2024-05-06T06:54:14.719033+0000","last_became_active":"2024-05-06T06:51:20.783638+0000","last_became_peered":"2024-05-06T06:51:20.783638+0000","last_unstale":"2024-05-06T06:54:14.719033+0000","last_undegraded":"2024-05-06T06:54:14.719033+0000","last_fullsized":"2024-05-06T06:54:14.719033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:37:19.323657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"32'3973","reported_seq":4011,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.027530+0000","last_change":"2024-05-06T06:52:23.743952+0000","last_active":"2024-05-06T06:54:15.027530+0000","last_peered":"2024-05-06T06:54:15.027530+0000","last_clean":"2024-05-06T06:54:15.027530+0000","last_became_active":"2024-05-06T06:52:23.740914+0000","last_became_peered":"2024-05-06T06:52:23.740914+0000","last_unstale":"2024-05-06T06:54:15.027530+0000","last_undegraded":"2024-05-06T06:54:15.027530+0000","last_fullsized":"2024-05-06T06:54:15.027530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:09:00.463938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93716480,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3945,"num_write_kb":170630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":106208624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.764791+0000","last_change":"2024-05-06T06:52:13.882588+0000","last_active":"2024-05-06T06:54:14.764791+0000","last_peered":"2024-05-06T06:54:14.764791+0000","last_clean":"2024-05-06T06:54:14.764791+0000","last_became_active":"2024-05-06T06:52:13.882153+0000","last_became_peered":"2024-05-06T06:52:13.882153+0000","last_unstale":"2024-05-06T06:54:14.764791+0000","last_undegraded":"2024-05-06T06:54:14.764791+0000","last_fullsized":"2024-05-06T06:54:14.764791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:27:44.287577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"32'3396","reported_seq":3451,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:29.114982+0000","last_change":"2024-05-06T06:51:26.760565+0000","last_active":"2024-05-06T06:54:29.114982+0000","last_peered":"2024-05-06T06:54:29.114982+0000","last_clean":"2024-05-06T06:54:29.114982+0000","last_became_active":"2024-05-06T06:51:26.759766+0000","last_became_peered":"2024-05-06T06:51:26.759766+0000","last_unstale":"2024-05-06T06:54:29.114982+0000","last_undegraded":"2024-05-06T06:54:29.114982+0000","last_fullsized":"2024-05-06T06:54:29.114982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3396,"log_dups_size":0,"ondisk_log_size":3396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:41:18.774836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92275200,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":83,"num_read_kb":68,"num_write":3435,"num_write_kb":120903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.773983+0000","last_change":"2024-05-06T06:51:20.691287+0000","last_active":"2024-05-06T06:54:14.773983+0000","last_peered":"2024-05-06T06:54:14.773983+0000","last_clean":"2024-05-06T06:54:14.773983+0000","last_became_active":"2024-05-06T06:51:20.690621+0000","last_became_peered":"2024-05-06T06:51:20.690621+0000","last_unstale":"2024-05-06T06:54:14.773983+0000","last_undegraded":"2024-05-06T06:54:14.773983+0000","last_fullsized":"2024-05-06T06:54:14.773983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:05:07.506405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.764973+0000","last_change":"2024-05-06T06:51:19.660034+0000","last_active":"2024-05-06T06:54:14.764973+0000","last_peered":"2024-05-06T06:54:14.764973+0000","last_clean":"2024-05-06T06:54:14.764973+0000","last_became_active":"2024-05-06T06:51:19.659348+0000","last_became_peered":"2024-05-06T06:51:19.659348+0000","last_unstale":"2024-05-06T06:54:14.764973+0000","last_undegraded":"2024-05-06T06:54:14.764973+0000","last_fullsized":"2024-05-06T06:54:14.764973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:18.638703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:18.638703+0000","last_clean_scrub_stamp":"2024-05-06T06:51:18.638703+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:35:56.572278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"32'4378","reported_seq":4413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.134491+0000","last_change":"2024-05-06T06:51:26.746845+0000","last_active":"2024-05-06T06:54:15.134491+0000","last_peered":"2024-05-06T06:54:15.134491+0000","last_clean":"2024-05-06T06:54:15.134491+0000","last_became_active":"2024-05-06T06:51:26.745914+0000","last_became_peered":"2024-05-06T06:51:26.745914+0000","last_unstale":"2024-05-06T06:54:15.134491+0000","last_undegraded":"2024-05-06T06:54:15.134491+0000","last_fullsized":"2024-05-06T06:54:15.134491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4378,"log_dups_size":0,"ondisk_log_size":4378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:33:19.445869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4306,"num_write_kb":201861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"32'9661","reported_seq":9797,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:32.970363+0000","last_change":"2024-05-06T06:51:26.757115+0000","last_active":"2024-05-06T06:54:32.970363+0000","last_peered":"2024-05-06T06:54:32.970363+0000","last_clean":"2024-05-06T06:54:32.970363+0000","last_became_active":"2024-05-06T06:51:26.756313+0000","last_became_peered":"2024-05-06T06:51:26.756313+0000","last_unstale":"2024-05-06T06:54:32.970363+0000","last_undegraded":"2024-05-06T06:54:32.970363+0000","last_fullsized":"2024-05-06T06:54:32.970363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":9661,"log_dups_size":0,"ondisk_log_size":9661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:44:03.780875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116760576,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":348,"num_read_kb":309,"num_write":7836,"num_write_kb":190582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'4782","reported_seq":4817,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:34.382503+0000","last_change":"2024-05-06T06:51:26.734244+0000","last_active":"2024-05-06T06:54:34.382503+0000","last_peered":"2024-05-06T06:54:34.382503+0000","last_clean":"2024-05-06T06:54:34.382503+0000","last_became_active":"2024-05-06T06:51:26.733532+0000","last_became_peered":"2024-05-06T06:51:26.733532+0000","last_unstale":"2024-05-06T06:54:34.382503+0000","last_undegraded":"2024-05-06T06:54:34.382503+0000","last_fullsized":"2024-05-06T06:54:34.382503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4782,"log_dups_size":0,"ondisk_log_size":4782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:22:36.526433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4754,"num_write_kb":177154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"31'3418","reported_seq":3456,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.709710+0000","last_change":"2024-05-06T06:51:26.750922+0000","last_active":"2024-05-06T06:54:14.709710+0000","last_peered":"2024-05-06T06:54:14.709710+0000","last_clean":"2024-05-06T06:54:14.709710+0000","last_became_active":"2024-05-06T06:51:26.750141+0000","last_became_peered":"2024-05-06T06:51:26.750141+0000","last_unstale":"2024-05-06T06:54:14.709710+0000","last_undegraded":"2024-05-06T06:54:14.709710+0000","last_fullsized":"2024-05-06T06:54:14.709710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3418,"log_dups_size":0,"ondisk_log_size":3418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:17:36.917319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":3420,"num_write_kb":144515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"32'3809","reported_seq":3989,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.141963+0000","last_change":"2024-05-06T06:52:19.746032+0000","last_active":"2024-05-06T06:54:15.141963+0000","last_peered":"2024-05-06T06:54:15.141963+0000","last_clean":"2024-05-06T06:54:15.141963+0000","last_became_active":"2024-05-06T06:52:19.741673+0000","last_became_peered":"2024-05-06T06:52:19.741673+0000","last_unstale":"2024-05-06T06:54:15.141963+0000","last_undegraded":"2024-05-06T06:54:15.141963+0000","last_fullsized":"2024-05-06T06:54:15.141963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3809,"log_dups_size":0,"ondisk_log_size":3809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:28:54.584381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96076832,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":3780,"num_write_kb":136805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":58106356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"32'5194","reported_seq":5238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.027378+0000","last_change":"2024-05-06T06:51:26.753097+0000","last_active":"2024-05-06T06:54:15.027378+0000","last_peered":"2024-05-06T06:54:15.027378+0000","last_clean":"2024-05-06T06:54:15.027378+0000","last_became_active":"2024-05-06T06:51:26.752302+0000","last_became_peered":"2024-05-06T06:51:26.752302+0000","last_unstale":"2024-05-06T06:54:15.027378+0000","last_undegraded":"2024-05-06T06:54:15.027378+0000","last_fullsized":"2024-05-06T06:54:15.027378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:24:16.771568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134414856,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":5188,"num_write_kb":206925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"32'5643","reported_seq":5813,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.233926+0000","last_change":"2024-05-06T06:52:21.773538+0000","last_active":"2024-05-06T06:54:15.233926+0000","last_peered":"2024-05-06T06:54:15.233926+0000","last_clean":"2024-05-06T06:54:15.233926+0000","last_became_active":"2024-05-06T06:52:21.771225+0000","last_became_peered":"2024-05-06T06:52:21.771225+0000","last_unstale":"2024-05-06T06:54:15.233926+0000","last_undegraded":"2024-05-06T06:54:15.233926+0000","last_fullsized":"2024-05-06T06:54:15.233926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5643,"log_dups_size":0,"ondisk_log_size":5643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:48:13.235907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132784656,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":259,"num_read_kb":194,"num_write":5888,"num_write_kb":245104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":117780368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"32'4161","reported_seq":4201,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.146426+0000","last_change":"2024-05-06T06:51:26.750495+0000","last_active":"2024-05-06T06:54:15.146426+0000","last_peered":"2024-05-06T06:54:15.146426+0000","last_clean":"2024-05-06T06:54:15.146426+0000","last_became_active":"2024-05-06T06:51:26.748874+0000","last_became_peered":"2024-05-06T06:51:26.748874+0000","last_unstale":"2024-05-06T06:54:15.146426+0000","last_undegraded":"2024-05-06T06:54:15.146426+0000","last_fullsized":"2024-05-06T06:54:15.146426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4161,"log_dups_size":0,"ondisk_log_size":4161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T16:00:13.973581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90965840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":4127,"num_write_kb":138968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"32'3923","reported_seq":3958,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.133957+0000","last_change":"2024-05-06T06:51:26.726150+0000","last_active":"2024-05-06T06:54:15.133957+0000","last_peered":"2024-05-06T06:54:15.133957+0000","last_clean":"2024-05-06T06:54:15.133957+0000","last_became_active":"2024-05-06T06:51:26.725309+0000","last_became_peered":"2024-05-06T06:51:26.725309+0000","last_unstale":"2024-05-06T06:54:15.133957+0000","last_undegraded":"2024-05-06T06:54:15.133957+0000","last_fullsized":"2024-05-06T06:54:15.133957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3923,"log_dups_size":0,"ondisk_log_size":3923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:32:07.768752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124452864,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3876,"num_write_kb":158405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"31'4205","reported_seq":4270,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.764861+0000","last_change":"2024-05-06T06:52:22.764048+0000","last_active":"2024-05-06T06:54:14.764861+0000","last_peered":"2024-05-06T06:54:14.764861+0000","last_clean":"2024-05-06T06:54:14.764861+0000","last_became_active":"2024-05-06T06:52:22.744107+0000","last_became_peered":"2024-05-06T06:52:22.744107+0000","last_unstale":"2024-05-06T06:54:14.764861+0000","last_undegraded":"2024-05-06T06:54:14.764861+0000","last_fullsized":"2024-05-06T06:54:14.764861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4205,"log_dups_size":0,"ondisk_log_size":4205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:39:24.414582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134479872,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":45,"num_read_kb":96,"num_write":4222,"num_write_kb":185991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":117274564,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"32'4030","reported_seq":4067,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.139200+0000","last_change":"2024-05-06T06:52:18.765028+0000","last_active":"2024-05-06T06:54:15.139200+0000","last_peered":"2024-05-06T06:54:15.139200+0000","last_clean":"2024-05-06T06:54:15.139200+0000","last_became_active":"2024-05-06T06:52:18.751926+0000","last_became_peered":"2024-05-06T06:52:18.751926+0000","last_unstale":"2024-05-06T06:54:15.139200+0000","last_undegraded":"2024-05-06T06:54:15.139200+0000","last_fullsized":"2024-05-06T06:54:15.139200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4030,"log_dups_size":0,"ondisk_log_size":4030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:02:54.706552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3984,"num_write_kb":181381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":113149924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"32'10497","reported_seq":10545,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:29.238671+0000","last_change":"2024-05-06T06:51:26.750110+0000","last_active":"2024-05-06T06:54:29.238671+0000","last_peered":"2024-05-06T06:54:29.238671+0000","last_clean":"2024-05-06T06:54:29.238671+0000","last_became_active":"2024-05-06T06:51:26.749358+0000","last_became_peered":"2024-05-06T06:51:26.749358+0000","last_unstale":"2024-05-06T06:54:29.238671+0000","last_undegraded":"2024-05-06T06:54:29.238671+0000","last_fullsized":"2024-05-06T06:54:29.238671+0000","mapping_epoch":19,"log_start":"21'400","ondisk_log_start":"21'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:58:55.322246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188874752,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":54,"num_read_kb":41,"num_write":10494,"num_write_kb":304731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3568161544,"num_objects":878,"num_object_clones":0,"num_object_copies":1756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":878,"num_whiteouts":0,"num_read":2494,"num_read_kb":2505,"num_write":157272,"num_write_kb":5626813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":803710944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6838673408,"data_stored":6834406552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158458,"ondisk_log_size":158458,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1242388,"kb_used_data":926732,"kb_used_omap":1,"kb_used_meta":315646,"kb_avail":93129452,"statfs":{"total":96636764160,"available":95364558848,"internally_reserved":0,"allocated":948973568,"data_stored":948133452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":323221962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1380420,"kb_used_data":1006460,"kb_used_omap":1,"kb_used_meta":373950,"kb_avail":92991420,"statfs":{"total":96636764160,"available":95223214080,"internally_reserved":0,"allocated":1030615040,"data_stored":1029732096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":382925253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":836812,"kb_used_data":729348,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":93535028,"statfs":{"total":96636764160,"available":95779868672,"internally_reserved":0,"allocated":746852352,"data_stored":746088080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542197,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048192,"kb_used_data":796344,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93323648,"statfs":{"total":96636764160,"available":95563415552,"internally_reserved":0,"allocated":815456256,"data_stored":814789176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257882567},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1155416,"kb_used_data":903568,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93216424,"statfs":{"total":96636764160,"available":95453618176,"internally_reserved":0,"allocated":925253632,"data_stored":924506972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257882567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":830984,"kb_used_data":687424,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":93540856,"statfs":{"total":96636764160,"available":95785836544,"internally_reserved":0,"allocated":703922176,"data_stored":703332976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":926152,"kb_used_data":742336,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93445688,"statfs":{"total":96636764160,"available":95688384512,"internally_reserved":0,"allocated":760152064,"data_stored":759556524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163836,"kb_used_data":889780,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93208004,"statfs":{"total":96636764160,"available":95444996096,"internally_reserved":0,"allocated":911134720,"data_stored":910282060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":910274560,"data_stored":909633516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":759824384,"data_stored":759436908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":703594496,"data_stored":703213360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":924925952,"data_stored":924387356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1030287360,"data_stored":1029612480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":815128576,"data_stored":814669560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":746524672,"data_stored":745968464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":948113408,"data_stored":947484908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T06:55:31.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-06T06:55:31.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bf21f640 1 Processor -- start 2024-05-06T06:55:31.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bf21f640 1 -- start start 2024-05-06T06:55:31.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bf21f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b80aaaa0 con 0x7fb2b8141780 2024-05-06T06:55:31.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bf21f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b8071d40 con 0x7fb2b80aa6c0 2024-05-06T06:55:31.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bf21f640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b80ab160 con 0x7fb2b813b1b0 2024-05-06T06:55:31.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bd7bc640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fb2b813b1b0 0x7fb2b813b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47632/0 (socket says 172.21.15.70:47632) 2024-05-06T06:55:31.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2b7fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb2b8141780 0x7fb2b8071630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49628/0 (socket says 172.21.15.70:49628) 2024-05-06T06:55:31.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bd7bc640 1 -- 172.21.15.70:0/4017112364 learned_addr learned my addr 172.21.15.70:0/4017112364 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:31.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2b77fe640 1 -- 172.21.15.70:0/4017112364 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 916344133 0 0) 0x7fb2a8001120 con 0x7fb2b8141780 2024-05-06T06:55:31.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2b77fe640 1 -- 172.21.15.70:0/4017112364 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a0003530 con 0x7fb2b8141780 2024-05-06T06:55:31.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2b77fe640 1 -- 172.21.15.70:0/4017112364 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2149227374 0 0) 0x7fb2b80ab160 con 0x7fb2b813b1b0 2024-05-06T06:55:31.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2b77fe640 1 -- 172.21.15.70:0/4017112364 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a8001120 con 0x7fb2b813b1b0 2024-05-06T06:55:31.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2b77fe640 1 -- 172.21.15.70:0/4017112364 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2846520119 0 0) 0x7fb2a0003530 con 0x7fb2b8141780 2024-05-06T06:55:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2b77fe640 1 -- 172.21.15.70:0/4017112364 >> v1:172.21.15.70:6790/0 conn(0x7fb2b813b1b0 legacy=0x7fb2b813b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2b77fe640 1 -- 172.21.15.70:0/4017112364 >> v1:172.21.15.184:6789/0 conn(0x7fb2b80aa6c0 legacy=0x7fb2b8142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2b77fe640 1 -- 172.21.15.70:0/4017112364 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b80b3f90 con 0x7fb2b8141780 2024-05-06T06:55:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2b77fe640 1 -- 172.21.15.70:0/4017112364 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb2a8001870 con 0x7fb2b8141780 2024-05-06T06:55:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2b77fe640 1 -- 172.21.15.70:0/4017112364 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2a8001a90 con 0x7fb2b8141780 2024-05-06T06:55:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2b77fe640 1 -- 172.21.15.70:0/4017112364 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb2a80047f0 con 0x7fb2b8141780 2024-05-06T06:55:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bf21f640 1 -- 172.21.15.70:0/4017112364 >> v1:172.21.15.70:6789/0 conn(0x7fb2b8141780 legacy=0x7fb2b8071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bf21f640 1 -- 172.21.15.70:0/4017112364 shutdown_connections 2024-05-06T06:55:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bf21f640 1 -- 172.21.15.70:0/4017112364 >> 172.21.15.70:0/4017112364 conn(0x7fb2b80b7730 msgr2=0x7fb2b80b7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bf21f640 1 -- 172.21.15.70:0/4017112364 shutdown_connections 2024-05-06T06:55:31.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bf21f640 1 -- 172.21.15.70:0/4017112364 wait complete. 2024-05-06T06:55:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bf21f640 1 Processor -- start 2024-05-06T06:55:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.983+0000 7fb2bf21f640 1 -- start start 2024-05-06T06:55:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2bf21f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b8136df0 con 0x7fb2b81302a0 2024-05-06T06:55:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2bf21f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b8134ee0 con 0x7fb2b80aa6c0 2024-05-06T06:55:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2bf21f640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b81350b0 con 0x7fb2b813b1b0 2024-05-06T06:55:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b7fff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fb2b813b1b0 0x7fb2b812fb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47634/0 (socket says 172.21.15.70:47634) 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b7fff640 1 -- 172.21.15.70:0/2417067542 learned_addr learned my addr 172.21.15.70:0/2417067542 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512183587 0 0) 0x7fb2b8136df0 con 0x7fb2b81302a0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a4003530 con 0x7fb2b81302a0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419918486 0 0) 0x7fb2b81350b0 con 0x7fb2b813b1b0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2b8136df0 con 0x7fb2b813b1b0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1963617566 0 0) 0x7fb2a4003530 con 0x7fb2b81302a0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2b81350b0 con 0x7fb2b81302a0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3706341928 0 0) 0x7fb2b8136df0 con 0x7fb2b813b1b0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2a4003530 con 0x7fb2b813b1b0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb2b0001d50 con 0x7fb2b81302a0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb2a8001190 con 0x7fb2b813b1b0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2553045402 0 0) 0x7fb2b8134ee0 con 0x7fb2b80aa6c0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2b8136df0 con 0x7fb2b80aa6c0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1306689702 0 0) 0x7fb2b81350b0 con 0x7fb2b81302a0 2024-05-06T06:55:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 >> v1:172.21.15.70:6790/0 conn(0x7fb2b813b1b0 legacy=0x7fb2b812fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 >> v1:172.21.15.184:6789/0 conn(0x7fb2b80aa6c0 legacy=0x7fb2b81357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b8135280 con 0x7fb2b81302a0 2024-05-06T06:55:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2bf21f640 1 -- 172.21.15.70:0/2417067542 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b81e54d0 con 0x7fb2b81302a0 2024-05-06T06:55:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2bf21f640 1 -- 172.21.15.70:0/2417067542 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2b81e5870 con 0x7fb2b81302a0 2024-05-06T06:55:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2b0004b70 con 0x7fb2b81302a0 2024-05-06T06:55:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb2b0004ec0 con 0x7fb2b81302a0 2024-05-06T06:55:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2bf21f640 1 -- 172.21.15.70:0/2417067542 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b80640c0 con 0x7fb2b81302a0 2024-05-06T06:55:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fb2b001bc60 con 0x7fb2b81302a0 2024-05-06T06:55:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.987+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7fb2b008ac50 con 0x7fb2b81302a0 2024-05-06T06:55:31.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:31.995+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fb2b0057de0 con 0x7fb2b81302a0 2024-05-06T06:55:32.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.151+0000 7fb2bf21f640 1 -- 172.21.15.70:0/2417067542 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2b8136270 con 0x7fb2a4070110 2024-05-06T06:55:32.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.159+0000 7fb2b57fa640 1 -- 172.21.15.70:0/2417067542 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117578 (unknown 2965378022 0 250132621) 0x7fb2b8136270 con 0x7fb2a4070110 2024-05-06T06:55:32.165 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:55:32.165 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-06T06:55:32.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.163+0000 7fb2bf21f640 1 -- 172.21.15.70:0/2417067542 >> v1:172.21.15.70:6816/2757942729 conn(0x7fb2a4070110 legacy=0x7fb2a40725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.163+0000 7fb2bf21f640 1 -- 172.21.15.70:0/2417067542 >> v1:172.21.15.70:6789/0 conn(0x7fb2b81302a0 legacy=0x7fb2b81e3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.163+0000 7fb2bf21f640 1 -- 172.21.15.70:0/2417067542 shutdown_connections 2024-05-06T06:55:32.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.163+0000 7fb2bf21f640 1 -- 172.21.15.70:0/2417067542 >> 172.21.15.70:0/2417067542 conn(0x7fb2b80b7730 msgr2=0x7fb2b80b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:32.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.163+0000 7fb2bf21f640 1 -- 172.21.15.70:0/2417067542 shutdown_connections 2024-05-06T06:55:32.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.163+0000 7fb2bf21f640 1 -- 172.21.15.70:0/2417067542 wait complete. 2024-05-06T06:55:32.184 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-05-06T06:55:30.874248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3568751912,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":0,"num_read":2560,"num_read_kb":2560,"num_write":157373,"num_write_kb":5628441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":803710944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158530,"ondisk_log_size":158530,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8584200,"kb_used_data":6681992,"kb_used_omap":12,"kb_used_meta":1902131,"kb_avail":746390520,"statfs":{"total":773094113280,"available":764303892480,"internally_reserved":0,"allocated":6842359808,"data_stored":6836421336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1947782706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":57344,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.217641"},"pg_stats":[{"pgid":"3.1f","version":"31'2969","reported_seq":3006,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.709247+0000","last_change":"2024-05-06T06:51:26.754879+0000","last_active":"2024-05-06T06:54:14.709247+0000","last_peered":"2024-05-06T06:54:14.709247+0000","last_clean":"2024-05-06T06:54:14.709247+0000","last_became_active":"2024-05-06T06:51:26.752788+0000","last_became_peered":"2024-05-06T06:51:26.752788+0000","last_unstale":"2024-05-06T06:54:14.709247+0000","last_undegraded":"2024-05-06T06:54:14.709247+0000","last_fullsized":"2024-05-06T06:54:14.709247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":2969,"log_dups_size":0,"ondisk_log_size":2969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:35:28.118229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":2975,"num_write_kb":148098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'6529","reported_seq":6597,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:22.863349+0000","last_change":"2024-05-06T06:51:26.753516+0000","last_active":"2024-05-06T06:54:22.863349+0000","last_peered":"2024-05-06T06:54:22.863349+0000","last_clean":"2024-05-06T06:54:22.863349+0000","last_became_active":"2024-05-06T06:51:26.752122+0000","last_became_peered":"2024-05-06T06:51:26.752122+0000","last_unstale":"2024-05-06T06:54:22.863349+0000","last_undegraded":"2024-05-06T06:54:22.863349+0000","last_fullsized":"2024-05-06T06:54:22.863349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":6529,"log_dups_size":0,"ondisk_log_size":6529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:03:49.598052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113386000,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":120,"num_read_kb":227,"num_write":6557,"num_write_kb":229051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4538","reported_seq":4573,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:27.666196+0000","last_change":"2024-05-06T06:51:26.741411+0000","last_active":"2024-05-06T06:54:27.666196+0000","last_peered":"2024-05-06T06:54:27.666196+0000","last_clean":"2024-05-06T06:54:27.666196+0000","last_became_active":"2024-05-06T06:51:26.740563+0000","last_became_peered":"2024-05-06T06:51:26.740563+0000","last_unstale":"2024-05-06T06:54:27.666196+0000","last_undegraded":"2024-05-06T06:54:27.666196+0000","last_fullsized":"2024-05-06T06:54:27.666196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4538,"log_dups_size":0,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:16:06.472308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99223376,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4514,"num_write_kb":149245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2965","reported_seq":3043,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.774270+0000","last_change":"2024-05-06T06:52:18.729663+0000","last_active":"2024-05-06T06:54:14.774270+0000","last_peered":"2024-05-06T06:54:14.774270+0000","last_clean":"2024-05-06T06:54:14.774270+0000","last_became_active":"2024-05-06T06:52:18.728975+0000","last_became_peered":"2024-05-06T06:52:18.728975+0000","last_unstale":"2024-05-06T06:54:14.774270+0000","last_undegraded":"2024-05-06T06:54:14.774270+0000","last_fullsized":"2024-05-06T06:54:14.774270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":2965,"log_dups_size":0,"ondisk_log_size":2965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:33:32.914971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2956,"num_write_kb":148097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71285744,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3511","reported_seq":3547,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.137926+0000","last_change":"2024-05-06T06:51:26.742049+0000","last_active":"2024-05-06T06:54:15.137926+0000","last_peered":"2024-05-06T06:54:15.137926+0000","last_clean":"2024-05-06T06:54:15.137926+0000","last_became_active":"2024-05-06T06:51:26.739617+0000","last_became_peered":"2024-05-06T06:51:26.739617+0000","last_unstale":"2024-05-06T06:54:15.137926+0000","last_undegraded":"2024-05-06T06:54:15.137926+0000","last_fullsized":"2024-05-06T06:54:15.137926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3511,"log_dups_size":0,"ondisk_log_size":3511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:08:25.394244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109117960,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":3468,"num_write_kb":138775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"32'5825","reported_seq":5907,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:21.468054+0000","last_change":"2024-05-06T06:52:20.775208+0000","last_active":"2024-05-06T06:54:21.468054+0000","last_peered":"2024-05-06T06:54:21.468054+0000","last_clean":"2024-05-06T06:54:21.468054+0000","last_became_active":"2024-05-06T06:52:20.774523+0000","last_became_peered":"2024-05-06T06:52:20.774523+0000","last_unstale":"2024-05-06T06:54:21.468054+0000","last_undegraded":"2024-05-06T06:54:21.468054+0000","last_fullsized":"2024-05-06T06:54:21.468054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5825,"log_dups_size":0,"ondisk_log_size":5825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:10:28.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":74,"num_read_kb":59,"num_write":5831,"num_write_kb":173444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":76111888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"32'4106","reported_seq":4144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:32.487603+0000","last_change":"2024-05-06T06:51:26.749392+0000","last_active":"2024-05-06T06:54:32.487603+0000","last_peered":"2024-05-06T06:54:32.487603+0000","last_clean":"2024-05-06T06:54:32.487603+0000","last_became_active":"2024-05-06T06:51:26.748230+0000","last_became_peered":"2024-05-06T06:51:26.748230+0000","last_unstale":"2024-05-06T06:54:32.487603+0000","last_undegraded":"2024-05-06T06:54:32.487603+0000","last_fullsized":"2024-05-06T06:54:32.487603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4106,"log_dups_size":0,"ondisk_log_size":4106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:25:50.342372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104989200,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":4066,"num_write_kb":140299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"32'7187","reported_seq":7222,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:32.390822+0000","last_change":"2024-05-06T06:51:26.751423+0000","last_active":"2024-05-06T06:54:32.390822+0000","last_peered":"2024-05-06T06:54:32.390822+0000","last_clean":"2024-05-06T06:54:32.390822+0000","last_became_active":"2024-05-06T06:51:26.750654+0000","last_became_peered":"2024-05-06T06:51:26.750654+0000","last_unstale":"2024-05-06T06:54:32.390822+0000","last_undegraded":"2024-05-06T06:54:32.390822+0000","last_fullsized":"2024-05-06T06:54:32.390822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":7187,"log_dups_size":0,"ondisk_log_size":7187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:19:30.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7185,"num_write_kb":217990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'7408","reported_seq":7455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:55:20.041464+0000","last_change":"2024-05-06T06:51:26.753573+0000","last_active":"2024-05-06T06:55:20.041464+0000","last_peered":"2024-05-06T06:55:20.041464+0000","last_clean":"2024-05-06T06:55:20.041464+0000","last_became_active":"2024-05-06T06:51:26.748155+0000","last_became_peered":"2024-05-06T06:51:26.748155+0000","last_unstale":"2024-05-06T06:55:20.041464+0000","last_undegraded":"2024-05-06T06:55:20.041464+0000","last_fullsized":"2024-05-06T06:55:20.041464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":7408,"log_dups_size":0,"ondisk_log_size":7408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:05:08.144920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153731072,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":7429,"num_write_kb":226728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'3681","reported_seq":3708,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.144504+0000","last_change":"2024-05-06T06:52:18.738992+0000","last_active":"2024-05-06T06:54:15.144504+0000","last_peered":"2024-05-06T06:54:15.144504+0000","last_clean":"2024-05-06T06:54:15.144504+0000","last_became_active":"2024-05-06T06:52:18.736778+0000","last_became_peered":"2024-05-06T06:52:18.736778+0000","last_unstale":"2024-05-06T06:54:15.144504+0000","last_undegraded":"2024-05-06T06:54:15.144504+0000","last_fullsized":"2024-05-06T06:54:15.144504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3681,"log_dups_size":0,"ondisk_log_size":3681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:39:38.190258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":3674,"num_write_kb":159628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":73965900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"32'7465","reported_seq":7506,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:32.437036+0000","last_change":"2024-05-06T06:51:26.746880+0000","last_active":"2024-05-06T06:54:32.437036+0000","last_peered":"2024-05-06T06:54:32.437036+0000","last_clean":"2024-05-06T06:54:32.437036+0000","last_became_active":"2024-05-06T06:51:26.746151+0000","last_became_peered":"2024-05-06T06:51:26.746151+0000","last_unstale":"2024-05-06T06:54:32.437036+0000","last_undegraded":"2024-05-06T06:54:32.437036+0000","last_fullsized":"2024-05-06T06:54:32.437036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":7465,"log_dups_size":0,"ondisk_log_size":7465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:13:48.503450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":7477,"num_write_kb":218253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"32'6671","reported_seq":6728,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:25.949441+0000","last_change":"2024-05-06T06:51:26.746657+0000","last_active":"2024-05-06T06:54:25.949441+0000","last_peered":"2024-05-06T06:54:25.949441+0000","last_clean":"2024-05-06T06:54:25.949441+0000","last_became_active":"2024-05-06T06:51:26.742366+0000","last_became_peered":"2024-05-06T06:51:26.742366+0000","last_unstale":"2024-05-06T06:54:25.949441+0000","last_undegraded":"2024-05-06T06:54:25.949441+0000","last_fullsized":"2024-05-06T06:54:25.949441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":6671,"log_dups_size":0,"ondisk_log_size":6671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:21:22.835580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118949544,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":66,"num_read_kb":180,"num_write":6679,"num_write_kb":179976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.769379+0000","last_change":"2024-05-06T06:51:20.687085+0000","last_active":"2024-05-06T06:54:14.769379+0000","last_peered":"2024-05-06T06:54:14.769379+0000","last_clean":"2024-05-06T06:54:14.769379+0000","last_became_active":"2024-05-06T06:51:20.686210+0000","last_became_peered":"2024-05-06T06:51:20.686210+0000","last_unstale":"2024-05-06T06:54:14.769379+0000","last_undegraded":"2024-05-06T06:54:14.769379+0000","last_fullsized":"2024-05-06T06:54:14.769379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:25:00.217824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"32'5440","reported_seq":5480,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:29.001250+0000","last_change":"2024-05-06T06:51:26.743483+0000","last_active":"2024-05-06T06:54:29.001250+0000","last_peered":"2024-05-06T06:54:29.001250+0000","last_clean":"2024-05-06T06:54:29.001250+0000","last_became_active":"2024-05-06T06:51:26.742236+0000","last_became_peered":"2024-05-06T06:51:26.742236+0000","last_unstale":"2024-05-06T06:54:29.001250+0000","last_undegraded":"2024-05-06T06:54:29.001250+0000","last_fullsized":"2024-05-06T06:54:29.001250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5440,"log_dups_size":0,"ondisk_log_size":5440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:50:36.854004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":5423,"num_write_kb":147572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.774801+0000","last_change":"2024-05-06T06:51:20.689651+0000","last_active":"2024-05-06T06:54:14.774801+0000","last_peered":"2024-05-06T06:54:14.774801+0000","last_clean":"2024-05-06T06:54:14.774801+0000","last_became_active":"2024-05-06T06:51:20.689362+0000","last_became_peered":"2024-05-06T06:51:20.689362+0000","last_unstale":"2024-05-06T06:54:14.774801+0000","last_undegraded":"2024-05-06T06:54:14.774801+0000","last_fullsized":"2024-05-06T06:54:14.774801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T16:42:56.711253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'3344","reported_seq":3396,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.135233+0000","last_change":"2024-05-06T06:51:26.760042+0000","last_active":"2024-05-06T06:54:15.135233+0000","last_peered":"2024-05-06T06:54:15.135233+0000","last_clean":"2024-05-06T06:54:15.135233+0000","last_became_active":"2024-05-06T06:51:26.759151+0000","last_became_peered":"2024-05-06T06:51:26.759151+0000","last_unstale":"2024-05-06T06:54:15.135233+0000","last_undegraded":"2024-05-06T06:54:15.135233+0000","last_fullsized":"2024-05-06T06:54:15.135233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:47:45.966056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":62,"num_read_kb":52,"num_write":3319,"num_write_kb":144515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.767478+0000","last_change":"2024-05-06T06:51:20.681448+0000","last_active":"2024-05-06T06:54:14.767478+0000","last_peered":"2024-05-06T06:54:14.767478+0000","last_clean":"2024-05-06T06:54:14.767478+0000","last_became_active":"2024-05-06T06:51:20.680436+0000","last_became_peered":"2024-05-06T06:51:20.680436+0000","last_unstale":"2024-05-06T06:54:14.767478+0000","last_undegraded":"2024-05-06T06:54:14.767478+0000","last_fullsized":"2024-05-06T06:54:14.767478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:23:10.287147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"32'6226","reported_seq":6261,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:34.687973+0000","last_change":"2024-05-06T06:51:26.752252+0000","last_active":"2024-05-06T06:54:34.687973+0000","last_peered":"2024-05-06T06:54:34.687973+0000","last_clean":"2024-05-06T06:54:34.687973+0000","last_became_active":"2024-05-06T06:51:26.749599+0000","last_became_peered":"2024-05-06T06:51:26.749599+0000","last_unstale":"2024-05-06T06:54:34.687973+0000","last_undegraded":"2024-05-06T06:54:34.687973+0000","last_fullsized":"2024-05-06T06:54:34.687973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":6226,"log_dups_size":0,"ondisk_log_size":6226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:46:39.000857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6220,"num_write_kb":148484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.778648+0000","last_change":"2024-05-06T06:51:20.686480+0000","last_active":"2024-05-06T06:54:14.778648+0000","last_peered":"2024-05-06T06:54:14.778648+0000","last_clean":"2024-05-06T06:54:14.778648+0000","last_became_active":"2024-05-06T06:51:20.686231+0000","last_became_peered":"2024-05-06T06:51:20.686231+0000","last_unstale":"2024-05-06T06:54:14.778648+0000","last_undegraded":"2024-05-06T06:54:14.778648+0000","last_fullsized":"2024-05-06T06:54:14.778648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:07:14.251359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'3600","reported_seq":3635,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.770875+0000","last_change":"2024-05-06T06:51:26.750208+0000","last_active":"2024-05-06T06:54:14.770875+0000","last_peered":"2024-05-06T06:54:14.770875+0000","last_clean":"2024-05-06T06:54:14.770875+0000","last_became_active":"2024-05-06T06:51:26.744763+0000","last_became_peered":"2024-05-06T06:51:26.744763+0000","last_unstale":"2024-05-06T06:54:14.770875+0000","last_undegraded":"2024-05-06T06:54:14.770875+0000","last_fullsized":"2024-05-06T06:54:14.770875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:46:18.695132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3599,"num_write_kb":189058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"31'2476","reported_seq":2540,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.715665+0000","last_change":"2024-05-06T06:52:22.736330+0000","last_active":"2024-05-06T06:54:14.715665+0000","last_peered":"2024-05-06T06:54:14.715665+0000","last_clean":"2024-05-06T06:54:14.715665+0000","last_became_active":"2024-05-06T06:52:22.735643+0000","last_became_peered":"2024-05-06T06:52:22.735643+0000","last_unstale":"2024-05-06T06:54:14.715665+0000","last_undegraded":"2024-05-06T06:54:14.715665+0000","last_fullsized":"2024-05-06T06:54:14.715665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":2476,"log_dups_size":0,"ondisk_log_size":2476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:27:09.052165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78252880,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":52,"num_read_kb":42,"num_write":2515,"num_write_kb":118108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":69827576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.773819+0000","last_change":"2024-05-06T06:51:20.689365+0000","last_active":"2024-05-06T06:54:14.773819+0000","last_peered":"2024-05-06T06:54:14.773819+0000","last_clean":"2024-05-06T06:54:14.773819+0000","last_became_active":"2024-05-06T06:51:20.688666+0000","last_became_peered":"2024-05-06T06:51:20.688666+0000","last_unstale":"2024-05-06T06:54:14.773819+0000","last_undegraded":"2024-05-06T06:54:14.773819+0000","last_fullsized":"2024-05-06T06:54:14.773819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:39:52.485414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"32'3847","reported_seq":4194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.133558+0000","last_change":"2024-05-06T06:51:26.751274+0000","last_active":"2024-05-06T06:54:15.133558+0000","last_peered":"2024-05-06T06:54:15.133558+0000","last_clean":"2024-05-06T06:54:15.133558+0000","last_became_active":"2024-05-06T06:51:26.750274+0000","last_became_peered":"2024-05-06T06:51:26.750274+0000","last_unstale":"2024-05-06T06:54:15.133558+0000","last_undegraded":"2024-05-06T06:54:15.133558+0000","last_fullsized":"2024-05-06T06:54:15.133558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3847,"log_dups_size":0,"ondisk_log_size":3847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:09:24.523363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92405760,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1046,"num_read_kb":996,"num_write":4130,"num_write_kb":185537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.719033+0000","last_change":"2024-05-06T06:51:20.784004+0000","last_active":"2024-05-06T06:54:14.719033+0000","last_peered":"2024-05-06T06:54:14.719033+0000","last_clean":"2024-05-06T06:54:14.719033+0000","last_became_active":"2024-05-06T06:51:20.783638+0000","last_became_peered":"2024-05-06T06:51:20.783638+0000","last_unstale":"2024-05-06T06:54:14.719033+0000","last_undegraded":"2024-05-06T06:54:14.719033+0000","last_fullsized":"2024-05-06T06:54:14.719033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:37:19.323657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"32'3973","reported_seq":4011,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.027530+0000","last_change":"2024-05-06T06:52:23.743952+0000","last_active":"2024-05-06T06:54:15.027530+0000","last_peered":"2024-05-06T06:54:15.027530+0000","last_clean":"2024-05-06T06:54:15.027530+0000","last_became_active":"2024-05-06T06:52:23.740914+0000","last_became_peered":"2024-05-06T06:52:23.740914+0000","last_unstale":"2024-05-06T06:54:15.027530+0000","last_undegraded":"2024-05-06T06:54:15.027530+0000","last_fullsized":"2024-05-06T06:54:15.027530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:09:00.463938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93716480,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3945,"num_write_kb":170630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":106208624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.764791+0000","last_change":"2024-05-06T06:52:13.882588+0000","last_active":"2024-05-06T06:54:14.764791+0000","last_peered":"2024-05-06T06:54:14.764791+0000","last_clean":"2024-05-06T06:54:14.764791+0000","last_became_active":"2024-05-06T06:52:13.882153+0000","last_became_peered":"2024-05-06T06:52:13.882153+0000","last_unstale":"2024-05-06T06:54:14.764791+0000","last_undegraded":"2024-05-06T06:54:14.764791+0000","last_fullsized":"2024-05-06T06:54:14.764791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:27:44.287577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"32'3396","reported_seq":3451,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:29.114982+0000","last_change":"2024-05-06T06:51:26.760565+0000","last_active":"2024-05-06T06:54:29.114982+0000","last_peered":"2024-05-06T06:54:29.114982+0000","last_clean":"2024-05-06T06:54:29.114982+0000","last_became_active":"2024-05-06T06:51:26.759766+0000","last_became_peered":"2024-05-06T06:51:26.759766+0000","last_unstale":"2024-05-06T06:54:29.114982+0000","last_undegraded":"2024-05-06T06:54:29.114982+0000","last_fullsized":"2024-05-06T06:54:29.114982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3396,"log_dups_size":0,"ondisk_log_size":3396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:41:18.774836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92275200,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":83,"num_read_kb":68,"num_write":3435,"num_write_kb":120903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.773983+0000","last_change":"2024-05-06T06:51:20.691287+0000","last_active":"2024-05-06T06:54:14.773983+0000","last_peered":"2024-05-06T06:54:14.773983+0000","last_clean":"2024-05-06T06:54:14.773983+0000","last_became_active":"2024-05-06T06:51:20.690621+0000","last_became_peered":"2024-05-06T06:51:20.690621+0000","last_unstale":"2024-05-06T06:54:14.773983+0000","last_undegraded":"2024-05-06T06:54:14.773983+0000","last_fullsized":"2024-05-06T06:54:14.773983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:05:07.506405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.764973+0000","last_change":"2024-05-06T06:51:19.660034+0000","last_active":"2024-05-06T06:54:14.764973+0000","last_peered":"2024-05-06T06:54:14.764973+0000","last_clean":"2024-05-06T06:54:14.764973+0000","last_became_active":"2024-05-06T06:51:19.659348+0000","last_became_peered":"2024-05-06T06:51:19.659348+0000","last_unstale":"2024-05-06T06:54:14.764973+0000","last_undegraded":"2024-05-06T06:54:14.764973+0000","last_fullsized":"2024-05-06T06:54:14.764973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:18.638703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:18.638703+0000","last_clean_scrub_stamp":"2024-05-06T06:51:18.638703+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:35:56.572278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"32'4378","reported_seq":4413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.134491+0000","last_change":"2024-05-06T06:51:26.746845+0000","last_active":"2024-05-06T06:54:15.134491+0000","last_peered":"2024-05-06T06:54:15.134491+0000","last_clean":"2024-05-06T06:54:15.134491+0000","last_became_active":"2024-05-06T06:51:26.745914+0000","last_became_peered":"2024-05-06T06:51:26.745914+0000","last_unstale":"2024-05-06T06:54:15.134491+0000","last_undegraded":"2024-05-06T06:54:15.134491+0000","last_fullsized":"2024-05-06T06:54:15.134491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4378,"log_dups_size":0,"ondisk_log_size":4378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:33:19.445869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4306,"num_write_kb":201861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"32'9661","reported_seq":9797,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:32.970363+0000","last_change":"2024-05-06T06:51:26.757115+0000","last_active":"2024-05-06T06:54:32.970363+0000","last_peered":"2024-05-06T06:54:32.970363+0000","last_clean":"2024-05-06T06:54:32.970363+0000","last_became_active":"2024-05-06T06:51:26.756313+0000","last_became_peered":"2024-05-06T06:51:26.756313+0000","last_unstale":"2024-05-06T06:54:32.970363+0000","last_undegraded":"2024-05-06T06:54:32.970363+0000","last_fullsized":"2024-05-06T06:54:32.970363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":9661,"log_dups_size":0,"ondisk_log_size":9661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:44:03.780875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116760576,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":348,"num_read_kb":309,"num_write":7836,"num_write_kb":190582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'4782","reported_seq":4817,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:34.382503+0000","last_change":"2024-05-06T06:51:26.734244+0000","last_active":"2024-05-06T06:54:34.382503+0000","last_peered":"2024-05-06T06:54:34.382503+0000","last_clean":"2024-05-06T06:54:34.382503+0000","last_became_active":"2024-05-06T06:51:26.733532+0000","last_became_peered":"2024-05-06T06:51:26.733532+0000","last_unstale":"2024-05-06T06:54:34.382503+0000","last_undegraded":"2024-05-06T06:54:34.382503+0000","last_fullsized":"2024-05-06T06:54:34.382503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4782,"log_dups_size":0,"ondisk_log_size":4782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:22:36.526433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4754,"num_write_kb":177154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"31'3418","reported_seq":3456,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.709710+0000","last_change":"2024-05-06T06:51:26.750922+0000","last_active":"2024-05-06T06:54:14.709710+0000","last_peered":"2024-05-06T06:54:14.709710+0000","last_clean":"2024-05-06T06:54:14.709710+0000","last_became_active":"2024-05-06T06:51:26.750141+0000","last_became_peered":"2024-05-06T06:51:26.750141+0000","last_unstale":"2024-05-06T06:54:14.709710+0000","last_undegraded":"2024-05-06T06:54:14.709710+0000","last_fullsized":"2024-05-06T06:54:14.709710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3418,"log_dups_size":0,"ondisk_log_size":3418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:17:36.917319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":3420,"num_write_kb":144515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"32'3809","reported_seq":3989,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.141963+0000","last_change":"2024-05-06T06:52:19.746032+0000","last_active":"2024-05-06T06:54:15.141963+0000","last_peered":"2024-05-06T06:54:15.141963+0000","last_clean":"2024-05-06T06:54:15.141963+0000","last_became_active":"2024-05-06T06:52:19.741673+0000","last_became_peered":"2024-05-06T06:52:19.741673+0000","last_unstale":"2024-05-06T06:54:15.141963+0000","last_undegraded":"2024-05-06T06:54:15.141963+0000","last_fullsized":"2024-05-06T06:54:15.141963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3809,"log_dups_size":0,"ondisk_log_size":3809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:28:54.584381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96076832,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":3780,"num_write_kb":136805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":58106356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"32'5194","reported_seq":5238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.027378+0000","last_change":"2024-05-06T06:51:26.753097+0000","last_active":"2024-05-06T06:54:15.027378+0000","last_peered":"2024-05-06T06:54:15.027378+0000","last_clean":"2024-05-06T06:54:15.027378+0000","last_became_active":"2024-05-06T06:51:26.752302+0000","last_became_peered":"2024-05-06T06:51:26.752302+0000","last_unstale":"2024-05-06T06:54:15.027378+0000","last_undegraded":"2024-05-06T06:54:15.027378+0000","last_fullsized":"2024-05-06T06:54:15.027378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:24:16.771568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134414856,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":5188,"num_write_kb":206925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"32'5643","reported_seq":5813,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.233926+0000","last_change":"2024-05-06T06:52:21.773538+0000","last_active":"2024-05-06T06:54:15.233926+0000","last_peered":"2024-05-06T06:54:15.233926+0000","last_clean":"2024-05-06T06:54:15.233926+0000","last_became_active":"2024-05-06T06:52:21.771225+0000","last_became_peered":"2024-05-06T06:52:21.771225+0000","last_unstale":"2024-05-06T06:54:15.233926+0000","last_undegraded":"2024-05-06T06:54:15.233926+0000","last_fullsized":"2024-05-06T06:54:15.233926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5643,"log_dups_size":0,"ondisk_log_size":5643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:48:13.235907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132784656,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":259,"num_read_kb":194,"num_write":5888,"num_write_kb":245104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":117780368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"32'4161","reported_seq":4201,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.146426+0000","last_change":"2024-05-06T06:51:26.750495+0000","last_active":"2024-05-06T06:54:15.146426+0000","last_peered":"2024-05-06T06:54:15.146426+0000","last_clean":"2024-05-06T06:54:15.146426+0000","last_became_active":"2024-05-06T06:51:26.748874+0000","last_became_peered":"2024-05-06T06:51:26.748874+0000","last_unstale":"2024-05-06T06:54:15.146426+0000","last_undegraded":"2024-05-06T06:54:15.146426+0000","last_fullsized":"2024-05-06T06:54:15.146426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4161,"log_dups_size":0,"ondisk_log_size":4161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T16:00:13.973581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90965840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":4127,"num_write_kb":138968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"32'3923","reported_seq":3958,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.133957+0000","last_change":"2024-05-06T06:51:26.726150+0000","last_active":"2024-05-06T06:54:15.133957+0000","last_peered":"2024-05-06T06:54:15.133957+0000","last_clean":"2024-05-06T06:54:15.133957+0000","last_became_active":"2024-05-06T06:51:26.725309+0000","last_became_peered":"2024-05-06T06:51:26.725309+0000","last_unstale":"2024-05-06T06:54:15.133957+0000","last_undegraded":"2024-05-06T06:54:15.133957+0000","last_fullsized":"2024-05-06T06:54:15.133957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3923,"log_dups_size":0,"ondisk_log_size":3923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:32:07.768752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124452864,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3876,"num_write_kb":158405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"31'4205","reported_seq":4270,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.764861+0000","last_change":"2024-05-06T06:52:22.764048+0000","last_active":"2024-05-06T06:54:14.764861+0000","last_peered":"2024-05-06T06:54:14.764861+0000","last_clean":"2024-05-06T06:54:14.764861+0000","last_became_active":"2024-05-06T06:52:22.744107+0000","last_became_peered":"2024-05-06T06:52:22.744107+0000","last_unstale":"2024-05-06T06:54:14.764861+0000","last_undegraded":"2024-05-06T06:54:14.764861+0000","last_fullsized":"2024-05-06T06:54:14.764861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4205,"log_dups_size":0,"ondisk_log_size":4205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:39:24.414582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134479872,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":45,"num_read_kb":96,"num_write":4222,"num_write_kb":185991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":117274564,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"32'4030","reported_seq":4067,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.139200+0000","last_change":"2024-05-06T06:52:18.765028+0000","last_active":"2024-05-06T06:54:15.139200+0000","last_peered":"2024-05-06T06:54:15.139200+0000","last_clean":"2024-05-06T06:54:15.139200+0000","last_became_active":"2024-05-06T06:52:18.751926+0000","last_became_peered":"2024-05-06T06:52:18.751926+0000","last_unstale":"2024-05-06T06:54:15.139200+0000","last_undegraded":"2024-05-06T06:54:15.139200+0000","last_fullsized":"2024-05-06T06:54:15.139200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4030,"log_dups_size":0,"ondisk_log_size":4030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:02:54.706552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3984,"num_write_kb":181381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":113149924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"32'10497","reported_seq":10545,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:29.238671+0000","last_change":"2024-05-06T06:51:26.750110+0000","last_active":"2024-05-06T06:54:29.238671+0000","last_peered":"2024-05-06T06:54:29.238671+0000","last_clean":"2024-05-06T06:54:29.238671+0000","last_became_active":"2024-05-06T06:51:26.749358+0000","last_became_peered":"2024-05-06T06:51:26.749358+0000","last_unstale":"2024-05-06T06:54:29.238671+0000","last_undegraded":"2024-05-06T06:54:29.238671+0000","last_fullsized":"2024-05-06T06:54:29.238671+0000","mapping_epoch":19,"log_start":"21'400","ondisk_log_start":"21'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:58:55.322246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188874752,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":54,"num_read_kb":41,"num_write":10494,"num_write_kb":304731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3568161544,"num_objects":878,"num_object_clones":0,"num_object_copies":1756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":878,"num_whiteouts":0,"num_read":2494,"num_read_kb":2505,"num_write":157272,"num_write_kb":5626813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":803710944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6838673408,"data_stored":6834406552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158458,"ondisk_log_size":158458,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1242388,"kb_used_data":926732,"kb_used_omap":1,"kb_used_meta":315646,"kb_avail":93129452,"statfs":{"total":96636764160,"available":95364558848,"internally_reserved":0,"allocated":948973568,"data_stored":948133452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":323221962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1380420,"kb_used_data":1006460,"kb_used_omap":1,"kb_used_meta":373950,"kb_avail":92991420,"statfs":{"total":96636764160,"available":95223214080,"internally_reserved":0,"allocated":1030615040,"data_stored":1029732096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":382925253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":836812,"kb_used_data":729348,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":93535028,"statfs":{"total":96636764160,"available":95779868672,"internally_reserved":0,"allocated":746852352,"data_stored":746088080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542197,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048192,"kb_used_data":796344,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93323648,"statfs":{"total":96636764160,"available":95563415552,"internally_reserved":0,"allocated":815456256,"data_stored":814789176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257882567},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1155416,"kb_used_data":903568,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93216424,"statfs":{"total":96636764160,"available":95453618176,"internally_reserved":0,"allocated":925253632,"data_stored":924506972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257882567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":830984,"kb_used_data":687424,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":93540856,"statfs":{"total":96636764160,"available":95785836544,"internally_reserved":0,"allocated":703922176,"data_stored":703332976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":926152,"kb_used_data":742336,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93445688,"statfs":{"total":96636764160,"available":95688384512,"internally_reserved":0,"allocated":760152064,"data_stored":759556524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163836,"kb_used_data":889780,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93208004,"statfs":{"total":96636764160,"available":95444996096,"internally_reserved":0,"allocated":911134720,"data_stored":910282060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":910274560,"data_stored":909633516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":759824384,"data_stored":759436908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":703594496,"data_stored":703213360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":924925952,"data_stored":924387356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1030287360,"data_stored":1029612480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":815128576,"data_stored":814669560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":746524672,"data_stored":745968464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":948113408,"data_stored":947484908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T06:55:32.186 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-06T06:55:32.186 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-06T06:55:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226cf7b640 1 Processor -- start 2024-05-06T06:55:32.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226cf7b640 1 -- start start 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226cf7b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22680aa870 con 0x7f2268144f70 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226cf7b640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22680aab30 con 0x7f22680aa460 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226cf7b640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2268070b40 con 0x7f22681459f0 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f2265d9b640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f22681459f0 0x7f2268070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47638/0 (socket says 172.21.15.70:47638) 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f2265d9b640 1 -- 172.21.15.70:0/2367329519 learned_addr learned my addr 172.21.15.70:0/2367329519 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f2266d9d640 1 -- 172.21.15.70:0/2367329519 >> v1:172.21.15.184:6789/0 conn(0x7f22680aa460 legacy=0x7f2268071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f2266d9d640 1 -- 172.21.15.70:0/2367329519 >> v1:172.21.15.184:6789/0 conn(0x7f22680aa460 legacy=0x7f2268071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f2266d9d640 1 --1- 172.21.15.70:0/2367329519 >> v1:172.21.15.184:6789/0 conn(0x7f22680aa460 0x7f2268071200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify read banner and identify addresses failed 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226559a640 1 -- 172.21.15.70:0/2367329519 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 750718222 0 0) 0x7f2268070b40 con 0x7f22681459f0 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226559a640 1 -- 172.21.15.70:0/2367329519 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2254003530 con 0x7f22681459f0 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226559a640 1 -- 172.21.15.70:0/2367329519 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1879542490 0 0) 0x7f22680aa870 con 0x7f2268144f70 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226559a640 1 -- 172.21.15.70:0/2367329519 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2268070b40 con 0x7f2268144f70 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226559a640 1 -- 172.21.15.70:0/2367329519 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1627571118 0 0) 0x7f2254003530 con 0x7f22681459f0 2024-05-06T06:55:32.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226559a640 1 -- 172.21.15.70:0/2367329519 >> v1:172.21.15.184:6789/0 conn(0x7f22680aa460 legacy=0x7f2268071200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-06T06:55:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226559a640 1 -- 172.21.15.70:0/2367329519 >> v1:172.21.15.70:6789/0 conn(0x7f2268144f70 legacy=0x7f22680ab050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226559a640 1 -- 172.21.15.70:0/2367329519 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2268074050 con 0x7f22681459f0 2024-05-06T06:55:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226559a640 1 -- 172.21.15.70:0/2367329519 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f22580016a0 con 0x7f22681459f0 2024-05-06T06:55:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226559a640 1 -- 172.21.15.70:0/2367329519 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22580018c0 con 0x7f22681459f0 2024-05-06T06:55:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226559a640 1 -- 172.21.15.70:0/2367329519 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2258001d50 con 0x7f22681459f0 2024-05-06T06:55:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226cf7b640 1 -- 172.21.15.70:0/2367329519 >> v1:172.21.15.70:6790/0 conn(0x7f22681459f0 legacy=0x7f2268070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226cf7b640 1 -- 172.21.15.70:0/2367329519 shutdown_connections 2024-05-06T06:55:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226cf7b640 1 -- 172.21.15.70:0/2367329519 >> 172.21.15.70:0/2367329519 conn(0x7f22680b1d40 msgr2=0x7f22680b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226cf7b640 1 -- 172.21.15.70:0/2367329519 shutdown_connections 2024-05-06T06:55:32.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226cf7b640 1 -- 172.21.15.70:0/2367329519 wait complete. 2024-05-06T06:55:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226cf7b640 1 Processor -- start 2024-05-06T06:55:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.299+0000 7f226cf7b640 1 -- start start 2024-05-06T06:55:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f226cf7b640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f226813b310 con 0x7f22680aa460 2024-05-06T06:55:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f226cf7b640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2268137c80 con 0x7f2268144f70 2024-05-06T06:55:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f226cf7b640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2268137e50 con 0x7f22681459f0 2024-05-06T06:55:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f226659c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f22680aa460 0x7f226813a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49666/0 (socket says 172.21.15.70:49666) 2024-05-06T06:55:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f226659c640 1 -- 172.21.15.70:0/2756526452 learned_addr learned my addr 172.21.15.70:0/2756526452 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013891127 0 0) 0x7f226813b310 con 0x7f22680aa460 2024-05-06T06:55:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2248003530 con 0x7f22680aa460 2024-05-06T06:55:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2940292684 0 0) 0x7f2268137e50 con 0x7f22681459f0 2024-05-06T06:55:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f226813b310 con 0x7f22681459f0 2024-05-06T06:55:32.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2829007169 0 0) 0x7f2248003530 con 0x7f22680aa460 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2268137e50 con 0x7f22680aa460 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2260001740 con 0x7f22680aa460 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3778561317 0 0) 0x7f226813b310 con 0x7f22681459f0 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2248003530 con 0x7f22681459f0 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2250001710 con 0x7f22681459f0 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990290639 0 0) 0x7f2268137c80 con 0x7f2268144f70 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f226813b310 con 0x7f2268144f70 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3096545803 0 0) 0x7f2268137e50 con 0x7f22680aa460 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 >> v1:172.21.15.70:6790/0 conn(0x7f22681459f0 legacy=0x7f226813ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 >> v1:172.21.15.184:6789/0 conn(0x7f2268144f70 legacy=0x7f22681385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226813e7b0 con 0x7f22680aa460 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f226cf7b640 1 -- 172.21.15.70:0/2756526452 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f226813ea60 con 0x7f22680aa460 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f226cf7b640 1 -- 172.21.15.70:0/2756526452 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2268131700 con 0x7f22680aa460 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2260003c30 con 0x7f22680aa460 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f2260003ea0 con 0x7f22680aa460 2024-05-06T06:55:32.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f226cf7b640 1 -- 172.21.15.70:0/2756526452 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224c005090 con 0x7f22680aa460 2024-05-06T06:55:32.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f2260004040 con 0x7f22680aa460 2024-05-06T06:55:32.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.303+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7f226008ae20 con 0x7f22680aa460 2024-05-06T06:55:32.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.307+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f2260057fb0 con 0x7f22680aa460 2024-05-06T06:55:32.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.467+0000 7f226cf7b640 1 -- 172.21.15.70:0/2756526452 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f224c000ba0 con 0x7f2248070130 2024-05-06T06:55:32.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.471+0000 7f225effd640 1 -- 172.21.15.70:0/2756526452 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117578 (unknown 2965378022 0 250132621) 0x7f224c000ba0 con 0x7f2248070130 2024-05-06T06:55:32.477 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:55:32.478 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-06T06:55:32.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.475+0000 7f226cf7b640 1 -- 172.21.15.70:0/2756526452 >> v1:172.21.15.70:6816/2757942729 conn(0x7f2248070130 legacy=0x7f22480725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.475+0000 7f226cf7b640 1 -- 172.21.15.70:0/2756526452 >> v1:172.21.15.70:6789/0 conn(0x7f22680aa460 legacy=0x7f226813a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.475+0000 7f226cf7b640 1 -- 172.21.15.70:0/2756526452 shutdown_connections 2024-05-06T06:55:32.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.475+0000 7f226cf7b640 1 -- 172.21.15.70:0/2756526452 >> 172.21.15.70:0/2756526452 conn(0x7f22680b1d40 msgr2=0x7f22680b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:32.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.475+0000 7f226cf7b640 1 -- 172.21.15.70:0/2756526452 shutdown_connections 2024-05-06T06:55:32.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.475+0000 7f226cf7b640 1 -- 172.21.15.70:0/2756526452 wait complete. 2024-05-06T06:55:32.496 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-05-06T06:55:30.874248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3568751912,"num_objects":880,"num_object_clones":0,"num_object_copies":1760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":880,"num_whiteouts":0,"num_read":2560,"num_read_kb":2560,"num_write":157373,"num_write_kb":5628441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":803710944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158530,"ondisk_log_size":158530,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8584200,"kb_used_data":6681992,"kb_used_omap":12,"kb_used_meta":1902131,"kb_avail":746390520,"statfs":{"total":773094113280,"available":764303892480,"internally_reserved":0,"allocated":6842359808,"data_stored":6836421336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1947782706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":57344,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.217641"},"pg_stats":[{"pgid":"3.1f","version":"31'2969","reported_seq":3006,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.709247+0000","last_change":"2024-05-06T06:51:26.754879+0000","last_active":"2024-05-06T06:54:14.709247+0000","last_peered":"2024-05-06T06:54:14.709247+0000","last_clean":"2024-05-06T06:54:14.709247+0000","last_became_active":"2024-05-06T06:51:26.752788+0000","last_became_peered":"2024-05-06T06:51:26.752788+0000","last_unstale":"2024-05-06T06:54:14.709247+0000","last_undegraded":"2024-05-06T06:54:14.709247+0000","last_fullsized":"2024-05-06T06:54:14.709247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":2969,"log_dups_size":0,"ondisk_log_size":2969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:35:28.118229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":2975,"num_write_kb":148098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'6529","reported_seq":6597,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:22.863349+0000","last_change":"2024-05-06T06:51:26.753516+0000","last_active":"2024-05-06T06:54:22.863349+0000","last_peered":"2024-05-06T06:54:22.863349+0000","last_clean":"2024-05-06T06:54:22.863349+0000","last_became_active":"2024-05-06T06:51:26.752122+0000","last_became_peered":"2024-05-06T06:51:26.752122+0000","last_unstale":"2024-05-06T06:54:22.863349+0000","last_undegraded":"2024-05-06T06:54:22.863349+0000","last_fullsized":"2024-05-06T06:54:22.863349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":6529,"log_dups_size":0,"ondisk_log_size":6529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:03:49.598052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113386000,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":120,"num_read_kb":227,"num_write":6557,"num_write_kb":229051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4538","reported_seq":4573,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:27.666196+0000","last_change":"2024-05-06T06:51:26.741411+0000","last_active":"2024-05-06T06:54:27.666196+0000","last_peered":"2024-05-06T06:54:27.666196+0000","last_clean":"2024-05-06T06:54:27.666196+0000","last_became_active":"2024-05-06T06:51:26.740563+0000","last_became_peered":"2024-05-06T06:51:26.740563+0000","last_unstale":"2024-05-06T06:54:27.666196+0000","last_undegraded":"2024-05-06T06:54:27.666196+0000","last_fullsized":"2024-05-06T06:54:27.666196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4538,"log_dups_size":0,"ondisk_log_size":4538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:16:06.472308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99223376,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4514,"num_write_kb":149245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2965","reported_seq":3043,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.774270+0000","last_change":"2024-05-06T06:52:18.729663+0000","last_active":"2024-05-06T06:54:14.774270+0000","last_peered":"2024-05-06T06:54:14.774270+0000","last_clean":"2024-05-06T06:54:14.774270+0000","last_became_active":"2024-05-06T06:52:18.728975+0000","last_became_peered":"2024-05-06T06:52:18.728975+0000","last_unstale":"2024-05-06T06:54:14.774270+0000","last_undegraded":"2024-05-06T06:54:14.774270+0000","last_fullsized":"2024-05-06T06:54:14.774270+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":2965,"log_dups_size":0,"ondisk_log_size":2965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:33:32.914971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2956,"num_write_kb":148097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71285744,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"32'3511","reported_seq":3547,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.137926+0000","last_change":"2024-05-06T06:51:26.742049+0000","last_active":"2024-05-06T06:54:15.137926+0000","last_peered":"2024-05-06T06:54:15.137926+0000","last_clean":"2024-05-06T06:54:15.137926+0000","last_became_active":"2024-05-06T06:51:26.739617+0000","last_became_peered":"2024-05-06T06:51:26.739617+0000","last_unstale":"2024-05-06T06:54:15.137926+0000","last_undegraded":"2024-05-06T06:54:15.137926+0000","last_fullsized":"2024-05-06T06:54:15.137926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3511,"log_dups_size":0,"ondisk_log_size":3511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:08:25.394244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109117960,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":3468,"num_write_kb":138775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"32'5825","reported_seq":5907,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:21.468054+0000","last_change":"2024-05-06T06:52:20.775208+0000","last_active":"2024-05-06T06:54:21.468054+0000","last_peered":"2024-05-06T06:54:21.468054+0000","last_clean":"2024-05-06T06:54:21.468054+0000","last_became_active":"2024-05-06T06:52:20.774523+0000","last_became_peered":"2024-05-06T06:52:20.774523+0000","last_unstale":"2024-05-06T06:54:21.468054+0000","last_undegraded":"2024-05-06T06:54:21.468054+0000","last_fullsized":"2024-05-06T06:54:21.468054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5825,"log_dups_size":0,"ondisk_log_size":5825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:10:28.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":74,"num_read_kb":59,"num_write":5831,"num_write_kb":173444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":76111888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"32'4106","reported_seq":4144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:32.487603+0000","last_change":"2024-05-06T06:51:26.749392+0000","last_active":"2024-05-06T06:54:32.487603+0000","last_peered":"2024-05-06T06:54:32.487603+0000","last_clean":"2024-05-06T06:54:32.487603+0000","last_became_active":"2024-05-06T06:51:26.748230+0000","last_became_peered":"2024-05-06T06:51:26.748230+0000","last_unstale":"2024-05-06T06:54:32.487603+0000","last_undegraded":"2024-05-06T06:54:32.487603+0000","last_fullsized":"2024-05-06T06:54:32.487603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4106,"log_dups_size":0,"ondisk_log_size":4106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:25:50.342372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104989200,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":4066,"num_write_kb":140299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"32'7187","reported_seq":7222,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:32.390822+0000","last_change":"2024-05-06T06:51:26.751423+0000","last_active":"2024-05-06T06:54:32.390822+0000","last_peered":"2024-05-06T06:54:32.390822+0000","last_clean":"2024-05-06T06:54:32.390822+0000","last_became_active":"2024-05-06T06:51:26.750654+0000","last_became_peered":"2024-05-06T06:51:26.750654+0000","last_unstale":"2024-05-06T06:54:32.390822+0000","last_undegraded":"2024-05-06T06:54:32.390822+0000","last_fullsized":"2024-05-06T06:54:32.390822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":7187,"log_dups_size":0,"ondisk_log_size":7187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:19:30.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7185,"num_write_kb":217990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'7408","reported_seq":7455,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:55:20.041464+0000","last_change":"2024-05-06T06:51:26.753573+0000","last_active":"2024-05-06T06:55:20.041464+0000","last_peered":"2024-05-06T06:55:20.041464+0000","last_clean":"2024-05-06T06:55:20.041464+0000","last_became_active":"2024-05-06T06:51:26.748155+0000","last_became_peered":"2024-05-06T06:51:26.748155+0000","last_unstale":"2024-05-06T06:55:20.041464+0000","last_undegraded":"2024-05-06T06:55:20.041464+0000","last_fullsized":"2024-05-06T06:55:20.041464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":7408,"log_dups_size":0,"ondisk_log_size":7408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:05:08.144920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153731072,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":7429,"num_write_kb":226728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"32'3681","reported_seq":3708,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.144504+0000","last_change":"2024-05-06T06:52:18.738992+0000","last_active":"2024-05-06T06:54:15.144504+0000","last_peered":"2024-05-06T06:54:15.144504+0000","last_clean":"2024-05-06T06:54:15.144504+0000","last_became_active":"2024-05-06T06:52:18.736778+0000","last_became_peered":"2024-05-06T06:52:18.736778+0000","last_unstale":"2024-05-06T06:54:15.144504+0000","last_undegraded":"2024-05-06T06:54:15.144504+0000","last_fullsized":"2024-05-06T06:54:15.144504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3681,"log_dups_size":0,"ondisk_log_size":3681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:39:38.190258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":3674,"num_write_kb":159628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":73965900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"32'7465","reported_seq":7506,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:32.437036+0000","last_change":"2024-05-06T06:51:26.746880+0000","last_active":"2024-05-06T06:54:32.437036+0000","last_peered":"2024-05-06T06:54:32.437036+0000","last_clean":"2024-05-06T06:54:32.437036+0000","last_became_active":"2024-05-06T06:51:26.746151+0000","last_became_peered":"2024-05-06T06:51:26.746151+0000","last_unstale":"2024-05-06T06:54:32.437036+0000","last_undegraded":"2024-05-06T06:54:32.437036+0000","last_fullsized":"2024-05-06T06:54:32.437036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":7465,"log_dups_size":0,"ondisk_log_size":7465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:13:48.503450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":7477,"num_write_kb":218253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"32'6671","reported_seq":6728,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:25.949441+0000","last_change":"2024-05-06T06:51:26.746657+0000","last_active":"2024-05-06T06:54:25.949441+0000","last_peered":"2024-05-06T06:54:25.949441+0000","last_clean":"2024-05-06T06:54:25.949441+0000","last_became_active":"2024-05-06T06:51:26.742366+0000","last_became_peered":"2024-05-06T06:51:26.742366+0000","last_unstale":"2024-05-06T06:54:25.949441+0000","last_undegraded":"2024-05-06T06:54:25.949441+0000","last_fullsized":"2024-05-06T06:54:25.949441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":6671,"log_dups_size":0,"ondisk_log_size":6671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:21:22.835580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118949544,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":66,"num_read_kb":180,"num_write":6679,"num_write_kb":179976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.769379+0000","last_change":"2024-05-06T06:51:20.687085+0000","last_active":"2024-05-06T06:54:14.769379+0000","last_peered":"2024-05-06T06:54:14.769379+0000","last_clean":"2024-05-06T06:54:14.769379+0000","last_became_active":"2024-05-06T06:51:20.686210+0000","last_became_peered":"2024-05-06T06:51:20.686210+0000","last_unstale":"2024-05-06T06:54:14.769379+0000","last_undegraded":"2024-05-06T06:54:14.769379+0000","last_fullsized":"2024-05-06T06:54:14.769379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:25:00.217824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"32'5440","reported_seq":5480,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:29.001250+0000","last_change":"2024-05-06T06:51:26.743483+0000","last_active":"2024-05-06T06:54:29.001250+0000","last_peered":"2024-05-06T06:54:29.001250+0000","last_clean":"2024-05-06T06:54:29.001250+0000","last_became_active":"2024-05-06T06:51:26.742236+0000","last_became_peered":"2024-05-06T06:51:26.742236+0000","last_unstale":"2024-05-06T06:54:29.001250+0000","last_undegraded":"2024-05-06T06:54:29.001250+0000","last_fullsized":"2024-05-06T06:54:29.001250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5440,"log_dups_size":0,"ondisk_log_size":5440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:50:36.854004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":5423,"num_write_kb":147572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.774801+0000","last_change":"2024-05-06T06:51:20.689651+0000","last_active":"2024-05-06T06:54:14.774801+0000","last_peered":"2024-05-06T06:54:14.774801+0000","last_clean":"2024-05-06T06:54:14.774801+0000","last_became_active":"2024-05-06T06:51:20.689362+0000","last_became_peered":"2024-05-06T06:51:20.689362+0000","last_unstale":"2024-05-06T06:54:14.774801+0000","last_undegraded":"2024-05-06T06:54:14.774801+0000","last_fullsized":"2024-05-06T06:54:14.774801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T16:42:56.711253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'3344","reported_seq":3396,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.135233+0000","last_change":"2024-05-06T06:51:26.760042+0000","last_active":"2024-05-06T06:54:15.135233+0000","last_peered":"2024-05-06T06:54:15.135233+0000","last_clean":"2024-05-06T06:54:15.135233+0000","last_became_active":"2024-05-06T06:51:26.759151+0000","last_became_peered":"2024-05-06T06:51:26.759151+0000","last_unstale":"2024-05-06T06:54:15.135233+0000","last_undegraded":"2024-05-06T06:54:15.135233+0000","last_fullsized":"2024-05-06T06:54:15.135233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3344,"log_dups_size":0,"ondisk_log_size":3344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:47:45.966056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":62,"num_read_kb":52,"num_write":3319,"num_write_kb":144515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.767478+0000","last_change":"2024-05-06T06:51:20.681448+0000","last_active":"2024-05-06T06:54:14.767478+0000","last_peered":"2024-05-06T06:54:14.767478+0000","last_clean":"2024-05-06T06:54:14.767478+0000","last_became_active":"2024-05-06T06:51:20.680436+0000","last_became_peered":"2024-05-06T06:51:20.680436+0000","last_unstale":"2024-05-06T06:54:14.767478+0000","last_undegraded":"2024-05-06T06:54:14.767478+0000","last_fullsized":"2024-05-06T06:54:14.767478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:23:10.287147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"32'6226","reported_seq":6261,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:34.687973+0000","last_change":"2024-05-06T06:51:26.752252+0000","last_active":"2024-05-06T06:54:34.687973+0000","last_peered":"2024-05-06T06:54:34.687973+0000","last_clean":"2024-05-06T06:54:34.687973+0000","last_became_active":"2024-05-06T06:51:26.749599+0000","last_became_peered":"2024-05-06T06:51:26.749599+0000","last_unstale":"2024-05-06T06:54:34.687973+0000","last_undegraded":"2024-05-06T06:54:34.687973+0000","last_fullsized":"2024-05-06T06:54:34.687973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":6226,"log_dups_size":0,"ondisk_log_size":6226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:46:39.000857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6220,"num_write_kb":148484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.778648+0000","last_change":"2024-05-06T06:51:20.686480+0000","last_active":"2024-05-06T06:54:14.778648+0000","last_peered":"2024-05-06T06:54:14.778648+0000","last_clean":"2024-05-06T06:54:14.778648+0000","last_became_active":"2024-05-06T06:51:20.686231+0000","last_became_peered":"2024-05-06T06:51:20.686231+0000","last_unstale":"2024-05-06T06:54:14.778648+0000","last_undegraded":"2024-05-06T06:54:14.778648+0000","last_fullsized":"2024-05-06T06:54:14.778648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:07:14.251359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'3600","reported_seq":3635,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.770875+0000","last_change":"2024-05-06T06:51:26.750208+0000","last_active":"2024-05-06T06:54:14.770875+0000","last_peered":"2024-05-06T06:54:14.770875+0000","last_clean":"2024-05-06T06:54:14.770875+0000","last_became_active":"2024-05-06T06:51:26.744763+0000","last_became_peered":"2024-05-06T06:51:26.744763+0000","last_unstale":"2024-05-06T06:54:14.770875+0000","last_undegraded":"2024-05-06T06:54:14.770875+0000","last_fullsized":"2024-05-06T06:54:14.770875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:46:18.695132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3599,"num_write_kb":189058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"31'2476","reported_seq":2540,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.715665+0000","last_change":"2024-05-06T06:52:22.736330+0000","last_active":"2024-05-06T06:54:14.715665+0000","last_peered":"2024-05-06T06:54:14.715665+0000","last_clean":"2024-05-06T06:54:14.715665+0000","last_became_active":"2024-05-06T06:52:22.735643+0000","last_became_peered":"2024-05-06T06:52:22.735643+0000","last_unstale":"2024-05-06T06:54:14.715665+0000","last_undegraded":"2024-05-06T06:54:14.715665+0000","last_fullsized":"2024-05-06T06:54:14.715665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":2476,"log_dups_size":0,"ondisk_log_size":2476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:27:09.052165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78252880,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":52,"num_read_kb":42,"num_write":2515,"num_write_kb":118108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":69827576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.773819+0000","last_change":"2024-05-06T06:51:20.689365+0000","last_active":"2024-05-06T06:54:14.773819+0000","last_peered":"2024-05-06T06:54:14.773819+0000","last_clean":"2024-05-06T06:54:14.773819+0000","last_became_active":"2024-05-06T06:51:20.688666+0000","last_became_peered":"2024-05-06T06:51:20.688666+0000","last_unstale":"2024-05-06T06:54:14.773819+0000","last_undegraded":"2024-05-06T06:54:14.773819+0000","last_fullsized":"2024-05-06T06:54:14.773819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:39:52.485414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"32'3847","reported_seq":4194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.133558+0000","last_change":"2024-05-06T06:51:26.751274+0000","last_active":"2024-05-06T06:54:15.133558+0000","last_peered":"2024-05-06T06:54:15.133558+0000","last_clean":"2024-05-06T06:54:15.133558+0000","last_became_active":"2024-05-06T06:51:26.750274+0000","last_became_peered":"2024-05-06T06:51:26.750274+0000","last_unstale":"2024-05-06T06:54:15.133558+0000","last_undegraded":"2024-05-06T06:54:15.133558+0000","last_fullsized":"2024-05-06T06:54:15.133558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3847,"log_dups_size":0,"ondisk_log_size":3847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:09:24.523363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92405760,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1046,"num_read_kb":996,"num_write":4130,"num_write_kb":185537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.719033+0000","last_change":"2024-05-06T06:51:20.784004+0000","last_active":"2024-05-06T06:54:14.719033+0000","last_peered":"2024-05-06T06:54:14.719033+0000","last_clean":"2024-05-06T06:54:14.719033+0000","last_became_active":"2024-05-06T06:51:20.783638+0000","last_became_peered":"2024-05-06T06:51:20.783638+0000","last_unstale":"2024-05-06T06:54:14.719033+0000","last_undegraded":"2024-05-06T06:54:14.719033+0000","last_fullsized":"2024-05-06T06:54:14.719033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:37:19.323657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"32'3973","reported_seq":4011,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.027530+0000","last_change":"2024-05-06T06:52:23.743952+0000","last_active":"2024-05-06T06:54:15.027530+0000","last_peered":"2024-05-06T06:54:15.027530+0000","last_clean":"2024-05-06T06:54:15.027530+0000","last_became_active":"2024-05-06T06:52:23.740914+0000","last_became_peered":"2024-05-06T06:52:23.740914+0000","last_unstale":"2024-05-06T06:54:15.027530+0000","last_undegraded":"2024-05-06T06:54:15.027530+0000","last_fullsized":"2024-05-06T06:54:15.027530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3973,"log_dups_size":0,"ondisk_log_size":3973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:09:00.463938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93716480,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3945,"num_write_kb":170630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":106208624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.764791+0000","last_change":"2024-05-06T06:52:13.882588+0000","last_active":"2024-05-06T06:54:14.764791+0000","last_peered":"2024-05-06T06:54:14.764791+0000","last_clean":"2024-05-06T06:54:14.764791+0000","last_became_active":"2024-05-06T06:52:13.882153+0000","last_became_peered":"2024-05-06T06:52:13.882153+0000","last_unstale":"2024-05-06T06:54:14.764791+0000","last_undegraded":"2024-05-06T06:54:14.764791+0000","last_fullsized":"2024-05-06T06:54:14.764791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:27:44.287577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"32'3396","reported_seq":3451,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:29.114982+0000","last_change":"2024-05-06T06:51:26.760565+0000","last_active":"2024-05-06T06:54:29.114982+0000","last_peered":"2024-05-06T06:54:29.114982+0000","last_clean":"2024-05-06T06:54:29.114982+0000","last_became_active":"2024-05-06T06:51:26.759766+0000","last_became_peered":"2024-05-06T06:51:26.759766+0000","last_unstale":"2024-05-06T06:54:29.114982+0000","last_undegraded":"2024-05-06T06:54:29.114982+0000","last_fullsized":"2024-05-06T06:54:29.114982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3396,"log_dups_size":0,"ondisk_log_size":3396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:41:18.774836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92275200,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":83,"num_read_kb":68,"num_write":3435,"num_write_kb":120903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.773983+0000","last_change":"2024-05-06T06:51:20.691287+0000","last_active":"2024-05-06T06:54:14.773983+0000","last_peered":"2024-05-06T06:54:14.773983+0000","last_clean":"2024-05-06T06:54:14.773983+0000","last_became_active":"2024-05-06T06:51:20.690621+0000","last_became_peered":"2024-05-06T06:51:20.690621+0000","last_unstale":"2024-05-06T06:54:14.773983+0000","last_undegraded":"2024-05-06T06:54:14.773983+0000","last_fullsized":"2024-05-06T06:54:14.773983+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:05:07.506405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.764973+0000","last_change":"2024-05-06T06:51:19.660034+0000","last_active":"2024-05-06T06:54:14.764973+0000","last_peered":"2024-05-06T06:54:14.764973+0000","last_clean":"2024-05-06T06:54:14.764973+0000","last_became_active":"2024-05-06T06:51:19.659348+0000","last_became_peered":"2024-05-06T06:51:19.659348+0000","last_unstale":"2024-05-06T06:54:14.764973+0000","last_undegraded":"2024-05-06T06:54:14.764973+0000","last_fullsized":"2024-05-06T06:54:14.764973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:18.638703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:18.638703+0000","last_clean_scrub_stamp":"2024-05-06T06:51:18.638703+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:35:56.572278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"32'4378","reported_seq":4413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.134491+0000","last_change":"2024-05-06T06:51:26.746845+0000","last_active":"2024-05-06T06:54:15.134491+0000","last_peered":"2024-05-06T06:54:15.134491+0000","last_clean":"2024-05-06T06:54:15.134491+0000","last_became_active":"2024-05-06T06:51:26.745914+0000","last_became_peered":"2024-05-06T06:51:26.745914+0000","last_unstale":"2024-05-06T06:54:15.134491+0000","last_undegraded":"2024-05-06T06:54:15.134491+0000","last_fullsized":"2024-05-06T06:54:15.134491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4378,"log_dups_size":0,"ondisk_log_size":4378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:33:19.445869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4306,"num_write_kb":201861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"32'9661","reported_seq":9797,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:32.970363+0000","last_change":"2024-05-06T06:51:26.757115+0000","last_active":"2024-05-06T06:54:32.970363+0000","last_peered":"2024-05-06T06:54:32.970363+0000","last_clean":"2024-05-06T06:54:32.970363+0000","last_became_active":"2024-05-06T06:51:26.756313+0000","last_became_peered":"2024-05-06T06:51:26.756313+0000","last_unstale":"2024-05-06T06:54:32.970363+0000","last_undegraded":"2024-05-06T06:54:32.970363+0000","last_fullsized":"2024-05-06T06:54:32.970363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":9661,"log_dups_size":0,"ondisk_log_size":9661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:44:03.780875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116760576,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":348,"num_read_kb":309,"num_write":7836,"num_write_kb":190582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'4782","reported_seq":4817,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:34.382503+0000","last_change":"2024-05-06T06:51:26.734244+0000","last_active":"2024-05-06T06:54:34.382503+0000","last_peered":"2024-05-06T06:54:34.382503+0000","last_clean":"2024-05-06T06:54:34.382503+0000","last_became_active":"2024-05-06T06:51:26.733532+0000","last_became_peered":"2024-05-06T06:51:26.733532+0000","last_unstale":"2024-05-06T06:54:34.382503+0000","last_undegraded":"2024-05-06T06:54:34.382503+0000","last_fullsized":"2024-05-06T06:54:34.382503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4782,"log_dups_size":0,"ondisk_log_size":4782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:22:36.526433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4754,"num_write_kb":177154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"31'3418","reported_seq":3456,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.709710+0000","last_change":"2024-05-06T06:51:26.750922+0000","last_active":"2024-05-06T06:54:14.709710+0000","last_peered":"2024-05-06T06:54:14.709710+0000","last_clean":"2024-05-06T06:54:14.709710+0000","last_became_active":"2024-05-06T06:51:26.750141+0000","last_became_peered":"2024-05-06T06:51:26.750141+0000","last_unstale":"2024-05-06T06:54:14.709710+0000","last_undegraded":"2024-05-06T06:54:14.709710+0000","last_fullsized":"2024-05-06T06:54:14.709710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3418,"log_dups_size":0,"ondisk_log_size":3418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:17:36.917319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":3420,"num_write_kb":144515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"32'3809","reported_seq":3989,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.141963+0000","last_change":"2024-05-06T06:52:19.746032+0000","last_active":"2024-05-06T06:54:15.141963+0000","last_peered":"2024-05-06T06:54:15.141963+0000","last_clean":"2024-05-06T06:54:15.141963+0000","last_became_active":"2024-05-06T06:52:19.741673+0000","last_became_peered":"2024-05-06T06:52:19.741673+0000","last_unstale":"2024-05-06T06:54:15.141963+0000","last_undegraded":"2024-05-06T06:54:15.141963+0000","last_fullsized":"2024-05-06T06:54:15.141963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3809,"log_dups_size":0,"ondisk_log_size":3809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:28:54.584381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96076832,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":3780,"num_write_kb":136805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":58106356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"32'5194","reported_seq":5238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.027378+0000","last_change":"2024-05-06T06:51:26.753097+0000","last_active":"2024-05-06T06:54:15.027378+0000","last_peered":"2024-05-06T06:54:15.027378+0000","last_clean":"2024-05-06T06:54:15.027378+0000","last_became_active":"2024-05-06T06:51:26.752302+0000","last_became_peered":"2024-05-06T06:51:26.752302+0000","last_unstale":"2024-05-06T06:54:15.027378+0000","last_undegraded":"2024-05-06T06:54:15.027378+0000","last_fullsized":"2024-05-06T06:54:15.027378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5194,"log_dups_size":0,"ondisk_log_size":5194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:24:16.771568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134414856,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":5188,"num_write_kb":206925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"32'5643","reported_seq":5813,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.233926+0000","last_change":"2024-05-06T06:52:21.773538+0000","last_active":"2024-05-06T06:54:15.233926+0000","last_peered":"2024-05-06T06:54:15.233926+0000","last_clean":"2024-05-06T06:54:15.233926+0000","last_became_active":"2024-05-06T06:52:21.771225+0000","last_became_peered":"2024-05-06T06:52:21.771225+0000","last_unstale":"2024-05-06T06:54:15.233926+0000","last_undegraded":"2024-05-06T06:54:15.233926+0000","last_fullsized":"2024-05-06T06:54:15.233926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5643,"log_dups_size":0,"ondisk_log_size":5643,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:48:13.235907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132784656,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":259,"num_read_kb":194,"num_write":5888,"num_write_kb":245104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":117780368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"32'4161","reported_seq":4201,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.146426+0000","last_change":"2024-05-06T06:51:26.750495+0000","last_active":"2024-05-06T06:54:15.146426+0000","last_peered":"2024-05-06T06:54:15.146426+0000","last_clean":"2024-05-06T06:54:15.146426+0000","last_became_active":"2024-05-06T06:51:26.748874+0000","last_became_peered":"2024-05-06T06:51:26.748874+0000","last_unstale":"2024-05-06T06:54:15.146426+0000","last_undegraded":"2024-05-06T06:54:15.146426+0000","last_fullsized":"2024-05-06T06:54:15.146426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4161,"log_dups_size":0,"ondisk_log_size":4161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T16:00:13.973581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90965840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":4127,"num_write_kb":138968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"32'3923","reported_seq":3958,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.133957+0000","last_change":"2024-05-06T06:51:26.726150+0000","last_active":"2024-05-06T06:54:15.133957+0000","last_peered":"2024-05-06T06:54:15.133957+0000","last_clean":"2024-05-06T06:54:15.133957+0000","last_became_active":"2024-05-06T06:51:26.725309+0000","last_became_peered":"2024-05-06T06:51:26.725309+0000","last_unstale":"2024-05-06T06:54:15.133957+0000","last_undegraded":"2024-05-06T06:54:15.133957+0000","last_fullsized":"2024-05-06T06:54:15.133957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3923,"log_dups_size":0,"ondisk_log_size":3923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:32:07.768752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124452864,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3876,"num_write_kb":158405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"31'4205","reported_seq":4270,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:14.764861+0000","last_change":"2024-05-06T06:52:22.764048+0000","last_active":"2024-05-06T06:54:14.764861+0000","last_peered":"2024-05-06T06:54:14.764861+0000","last_clean":"2024-05-06T06:54:14.764861+0000","last_became_active":"2024-05-06T06:52:22.744107+0000","last_became_peered":"2024-05-06T06:52:22.744107+0000","last_unstale":"2024-05-06T06:54:14.764861+0000","last_undegraded":"2024-05-06T06:54:14.764861+0000","last_fullsized":"2024-05-06T06:54:14.764861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4205,"log_dups_size":0,"ondisk_log_size":4205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:39:24.414582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134479872,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":45,"num_read_kb":96,"num_write":4222,"num_write_kb":185991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":117274564,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"32'4030","reported_seq":4067,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:15.139200+0000","last_change":"2024-05-06T06:52:18.765028+0000","last_active":"2024-05-06T06:54:15.139200+0000","last_peered":"2024-05-06T06:54:15.139200+0000","last_clean":"2024-05-06T06:54:15.139200+0000","last_became_active":"2024-05-06T06:52:18.751926+0000","last_became_peered":"2024-05-06T06:52:18.751926+0000","last_unstale":"2024-05-06T06:54:15.139200+0000","last_undegraded":"2024-05-06T06:54:15.139200+0000","last_fullsized":"2024-05-06T06:54:15.139200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4030,"log_dups_size":0,"ondisk_log_size":4030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:02:54.706552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3984,"num_write_kb":181381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":113149924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"32'10497","reported_seq":10545,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-06T06:54:29.238671+0000","last_change":"2024-05-06T06:51:26.750110+0000","last_active":"2024-05-06T06:54:29.238671+0000","last_peered":"2024-05-06T06:54:29.238671+0000","last_clean":"2024-05-06T06:54:29.238671+0000","last_became_active":"2024-05-06T06:51:26.749358+0000","last_became_peered":"2024-05-06T06:51:26.749358+0000","last_unstale":"2024-05-06T06:54:29.238671+0000","last_undegraded":"2024-05-06T06:54:29.238671+0000","last_fullsized":"2024-05-06T06:54:29.238671+0000","mapping_epoch":19,"log_start":"21'400","ondisk_log_start":"21'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:58:55.322246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188874752,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":54,"num_read_kb":41,"num_write":10494,"num_write_kb":304731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3568161544,"num_objects":878,"num_object_clones":0,"num_object_copies":1756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":878,"num_whiteouts":0,"num_read":2494,"num_read_kb":2505,"num_write":157272,"num_write_kb":5626813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":803710944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6838673408,"data_stored":6834406552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158458,"ondisk_log_size":158458,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1242388,"kb_used_data":926732,"kb_used_omap":1,"kb_used_meta":315646,"kb_avail":93129452,"statfs":{"total":96636764160,"available":95364558848,"internally_reserved":0,"allocated":948973568,"data_stored":948133452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":323221962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1380420,"kb_used_data":1006460,"kb_used_omap":1,"kb_used_meta":373950,"kb_avail":92991420,"statfs":{"total":96636764160,"available":95223214080,"internally_reserved":0,"allocated":1030615040,"data_stored":1029732096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":382925253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":836812,"kb_used_data":729348,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":93535028,"statfs":{"total":96636764160,"available":95779868672,"internally_reserved":0,"allocated":746852352,"data_stored":746088080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542197,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048192,"kb_used_data":796344,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93323648,"statfs":{"total":96636764160,"available":95563415552,"internally_reserved":0,"allocated":815456256,"data_stored":814789176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257882567},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1155416,"kb_used_data":903568,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93216424,"statfs":{"total":96636764160,"available":95453618176,"internally_reserved":0,"allocated":925253632,"data_stored":924506972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257882567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":830984,"kb_used_data":687424,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":93540856,"statfs":{"total":96636764160,"available":95785836544,"internally_reserved":0,"allocated":703922176,"data_stored":703332976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":926152,"kb_used_data":742336,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93445688,"statfs":{"total":96636764160,"available":95688384512,"internally_reserved":0,"allocated":760152064,"data_stored":759556524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163836,"kb_used_data":889780,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93208004,"statfs":{"total":96636764160,"available":95444996096,"internally_reserved":0,"allocated":911134720,"data_stored":910282060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":910274560,"data_stored":909633516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":759824384,"data_stored":759436908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":703594496,"data_stored":703213360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":924925952,"data_stored":924387356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1030287360,"data_stored":1029612480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":815128576,"data_stored":814669560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":746524672,"data_stored":745968464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":948113408,"data_stored":947484908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T06:55:32.497 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-06T06:55:32.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.607+0000 7f37d046a640 1 Processor -- start 2024-05-06T06:55:32.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.607+0000 7f37d046a640 1 -- start start 2024-05-06T06:55:32.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.607+0000 7f37d046a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c8070a70 con 0x7f37c81448a0 2024-05-06T06:55:32.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.607+0000 7f37d046a640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c80ab1a0 con 0x7f37c8070690 2024-05-06T06:55:32.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.607+0000 7f37d046a640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c80b2860 con 0x7f37c8144410 2024-05-06T06:55:32.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.607+0000 7f37cda05640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f37c8144410 0x7f37c813f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47658/0 (socket says 172.21.15.70:47658) 2024-05-06T06:55:32.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.607+0000 7f37cda05640 1 -- 172.21.15.70:0/2023956597 learned_addr learned my addr 172.21.15.70:0/2023956597 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:32.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.607+0000 7f37cd204640 1 -- 172.21.15.70:0/2023956597 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405605888 0 0) 0x7f37c80b2860 con 0x7f37c8144410 2024-05-06T06:55:32.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.607+0000 7f37cd204640 1 -- 172.21.15.70:0/2023956597 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37b4003530 con 0x7f37c8144410 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.607+0000 7f37cd204640 1 -- 172.21.15.70:0/2023956597 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333241505 0 0) 0x7f37c00014a0 con 0x7f37c81448a0 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.607+0000 7f37cd204640 1 -- 172.21.15.70:0/2023956597 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37c80b2860 con 0x7f37c81448a0 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37cd204640 1 -- 172.21.15.70:0/2023956597 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3334985236 0 0) 0x7f37b4003530 con 0x7f37c8144410 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37cd204640 1 -- 172.21.15.70:0/2023956597 >> v1:172.21.15.184:6789/0 conn(0x7f37c8070690 legacy=0x7f37c8140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37cd204640 1 -- 172.21.15.70:0/2023956597 >> v1:172.21.15.70:6789/0 conn(0x7f37c81448a0 legacy=0x7f37c814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37cd204640 1 -- 172.21.15.70:0/2023956597 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c80734c0 con 0x7f37c8144410 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37cd204640 1 -- 172.21.15.70:0/2023956597 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f37b80016a0 con 0x7f37c8144410 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37cd204640 1 -- 172.21.15.70:0/2023956597 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f37b8001840 con 0x7f37c8144410 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37cd204640 1 -- 172.21.15.70:0/2023956597 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f37b8001c50 con 0x7f37c8144410 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37d046a640 1 -- 172.21.15.70:0/2023956597 >> v1:172.21.15.70:6790/0 conn(0x7f37c8144410 legacy=0x7f37c813f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37d046a640 1 -- 172.21.15.70:0/2023956597 shutdown_connections 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37d046a640 1 -- 172.21.15.70:0/2023956597 >> 172.21.15.70:0/2023956597 conn(0x7f37c80b1d40 msgr2=0x7f37c80b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37d046a640 1 -- 172.21.15.70:0/2023956597 shutdown_connections 2024-05-06T06:55:32.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37d046a640 1 -- 172.21.15.70:0/2023956597 wait complete. 2024-05-06T06:55:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37d046a640 1 Processor -- start 2024-05-06T06:55:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37d046a640 1 -- start start 2024-05-06T06:55:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37d046a640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c813a9b0 con 0x7f37c8144410 2024-05-06T06:55:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37d046a640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c80b0360 con 0x7f37c81448a0 2024-05-06T06:55:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37d046a640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c81c9a10 con 0x7f37c8070690 2024-05-06T06:55:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37cda05640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f37c8144410 0x7f37c80ac800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49674/0 (socket says 172.21.15.70:49674) 2024-05-06T06:55:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37cda05640 1 -- 172.21.15.70:0/2686218993 learned_addr learned my addr 172.21.15.70:0/2686218993 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3122476553 0 0) 0x7f37c813a9b0 con 0x7f37c8144410 2024-05-06T06:55:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37ac003530 con 0x7f37c8144410 2024-05-06T06:55:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471532360 0 0) 0x7f37c81c9a10 con 0x7f37c8070690 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37c813a9b0 con 0x7f37c8070690 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2184371059 0 0) 0x7f37ac003530 con 0x7f37c8144410 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f37c81c9a10 con 0x7f37c8144410 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3919253323 0 0) 0x7f37c813a9b0 con 0x7f37c8070690 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f37ac003530 con 0x7f37c8070690 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f37b8001bd0 con 0x7f37c8144410 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f37c4001900 con 0x7f37c8070690 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1462309050 0 0) 0x7f37c80b0360 con 0x7f37c81448a0 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37c813a9b0 con 0x7f37c81448a0 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2620728178 0 0) 0x7f37c81c9a10 con 0x7f37c8144410 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 >> v1:172.21.15.70:6790/0 conn(0x7f37c8070690 legacy=0x7f37c8139b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 >> v1:172.21.15.184:6789/0 conn(0x7f37c81448a0 legacy=0x7f37c813a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c80af090 con 0x7f37c8144410 2024-05-06T06:55:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37d046a640 1 -- 172.21.15.70:0/2686218993 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f37c80aeab0 con 0x7f37c8144410 2024-05-06T06:55:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37d046a640 1 -- 172.21.15.70:0/2686218993 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f37c80b1700 con 0x7f37c8144410 2024-05-06T06:55:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f37b8001820 con 0x7f37c8144410 2024-05-06T06:55:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.611+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f37b8004da0 con 0x7f37c8144410 2024-05-06T06:55:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.615+0000 7f37d046a640 1 -- 172.21.15.70:0/2686218993 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b0005090 con 0x7f37c8144410 2024-05-06T06:55:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.615+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f37b8004fc0 con 0x7f37c8144410 2024-05-06T06:55:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.615+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7f37b808aaa0 con 0x7f37c8144410 2024-05-06T06:55:32.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.619+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f37b8057c30 con 0x7f37c8144410 2024-05-06T06:55:32.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.775+0000 7f37d046a640 1 -- 172.21.15.70:0/2686218993 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37b0005380 con 0x7f37c8144410 2024-05-06T06:55:32.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.775+0000 7f37beffd640 1 -- 172.21.15.70:0/2686218993 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+15083 (unknown 2892004667 0 1417393907) 0x7f37b8057530 con 0x7f37c8144410 2024-05-06T06:55:32.781 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:55:32.781 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":33,"fsid":"90193adb-e1e1-4e06-9c0d-7abb14f25fc6","created":"2024-05-06T06:51:08.019705+0000","modified":"2024-05-06T06:55:30.864235+0000","last_up_change":"2024-05-06T06:51:18.638703+0000","last_in_change":"2024-05-06T06:51:10.302012+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-06T06:51:18.627852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-06T06:51:19.074040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephsqlite","create_time":"2024-05-06T06:51:25.332373+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e2c1f594-6b3c-49a9-b307-6b6284d59048","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6804","nonce":3977328488}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6805","nonce":3977328488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6807","nonce":3977328488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6806","nonce":3977328488}]},"public_addr":"172.21.15.70:6804/3977328488","cluster_addr":"172.21.15.70:6805/3977328488","heartbeat_back_addr":"172.21.15.70:6807/3977328488","heartbeat_front_addr":"172.21.15.70:6806/3977328488","state":["exists","up"]},{"osd":1,"uuid":"fc494199-771b-4efe-85cf-edd309f73659","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6812","nonce":1567593695}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6813","nonce":1567593695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6815","nonce":1567593695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6814","nonce":1567593695}]},"public_addr":"172.21.15.70:6812/1567593695","cluster_addr":"172.21.15.70:6813/1567593695","heartbeat_back_addr":"172.21.15.70:6815/1567593695","heartbeat_front_addr":"172.21.15.70:6814/1567593695","state":["exists","up"]},{"osd":2,"uuid":"5f691dc1-d6f0-4c85-9544-86c9b7cfa3b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6800","nonce":1610479439}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6801","nonce":1610479439}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6803","nonce":1610479439}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6802","nonce":1610479439}]},"public_addr":"172.21.15.70:6800/1610479439","cluster_addr":"172.21.15.70:6801/1610479439","heartbeat_back_addr":"172.21.15.70:6803/1610479439","heartbeat_front_addr":"172.21.15.70:6802/1610479439","state":["exists","up"]},{"osd":3,"uuid":"36920237-b28f-4955-ab5a-c6fd2e74e74e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6808","nonce":3320203314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6809","nonce":3320203314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6811","nonce":3320203314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.70:6810","nonce":3320203314}]},"public_addr":"172.21.15.70:6808/3320203314","cluster_addr":"172.21.15.70:6809/3320203314","heartbeat_back_addr":"172.21.15.70:6811/3320203314","heartbeat_front_addr":"172.21.15.70:6810/3320203314","state":["exists","up"]},{"osd":4,"uuid":"00e3095d-4ffd-4184-a8e4-1a14d09e3e3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6808","nonce":1828934695}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6809","nonce":1828934695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6811","nonce":1828934695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6810","nonce":1828934695}]},"public_addr":"172.21.15.184:6808/1828934695","cluster_addr":"172.21.15.184:6809/1828934695","heartbeat_back_addr":"172.21.15.184:6811/1828934695","heartbeat_front_addr":"172.21.15.184:6810/1828934695","state":["exists","up"]},{"osd":5,"uuid":"091d4702-30c5-4c63-8529-92059782009a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6800","nonce":1533654869}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6801","nonce":1533654869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6803","nonce":1533654869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6802","nonce":1533654869}]},"public_addr":"172.21.15.184:6800/1533654869","cluster_addr":"172.21.15.184:6801/1533654869","heartbeat_back_addr":"172.21.15.184:6803/1533654869","heartbeat_front_addr":"172.21.15.184:6802/1533654869","state":["exists","up"]},{"osd":6,"uuid":"8067e1b6-71d1-4924-881b-4a38fe446858","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6804","nonce":3136453628}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6805","nonce":3136453628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6807","nonce":3136453628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6806","nonce":3136453628}]},"public_addr":"172.21.15.184:6804/3136453628","cluster_addr":"172.21.15.184:6805/3136453628","heartbeat_back_addr":"172.21.15.184:6807/3136453628","heartbeat_front_addr":"172.21.15.184:6806/3136453628","state":["exists","up"]},{"osd":7,"uuid":"dae86a11-8868-45b5-927f-f4233d632bb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6812","nonce":1421504082}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6813","nonce":1421504082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6815","nonce":1421504082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6814","nonce":1421504082}]},"public_addr":"172.21.15.184:6812/1421504082","cluster_addr":"172.21.15.184:6813/1421504082","heartbeat_back_addr":"172.21.15.184:6815/1421504082","heartbeat_front_addr":"172.21.15.184:6814/1421504082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:16.376779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.832124+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.560814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.688562+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.803482+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.572410+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.703574+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-06T06:51:15.878350+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":1,"to":4}]},{"pgid":"3.1","mappings":[{"from":4,"to":6}]},{"pgid":"3.3","mappings":[{"from":4,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":6}]},{"pgid":"3.12","mappings":[{"from":0,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":6}]},{"pgid":"3.1a","mappings":[{"from":4,"to":2}]},{"pgid":"3.1c","mappings":[{"from":4,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/3335374651":"2024-05-06T07:55:29.972078+0000","172.21.15.70:0/1836035707":"2024-05-06T07:54:13.818930+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-06T06:55:32.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.779+0000 7f37d046a640 1 -- 172.21.15.70:0/2686218993 >> v1:172.21.15.70:6816/2757942729 conn(0x7f37ac070110 legacy=0x7f37ac0725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.779+0000 7f37d046a640 1 -- 172.21.15.70:0/2686218993 >> v1:172.21.15.70:6789/0 conn(0x7f37c8144410 legacy=0x7f37c80ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:32.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.779+0000 7f37d046a640 1 -- 172.21.15.70:0/2686218993 shutdown_connections 2024-05-06T06:55:32.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.779+0000 7f37d046a640 1 -- 172.21.15.70:0/2686218993 >> 172.21.15.70:0/2686218993 conn(0x7f37c80b1d40 msgr2=0x7f37c8140490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:32.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.779+0000 7f37d046a640 1 -- 172.21.15.70:0/2686218993 shutdown_connections 2024-05-06T06:55:32.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:32.779+0000 7f37d046a640 1 -- 172.21.15.70:0/2686218993 wait complete. 2024-05-06T06:55:33.800 INFO:tasks.ceph:Scrubbing osd.0 2024-05-06T06:55:33.800 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-06T06:55:33.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde66cea640 1 Processor -- start 2024-05-06T06:55:33.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde66cea640 1 -- start start 2024-05-06T06:55:33.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde66cea640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde600aaab0 con 0x7fde601450e0 2024-05-06T06:55:33.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde66cea640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde601454c0 con 0x7fde600ab510 2024-05-06T06:55:33.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde66cea640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde60142910 con 0x7fde60145af0 2024-05-06T06:55:33.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde64a86640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fde601450e0 0x7fde600707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49676/0 (socket says 172.21.15.70:49676) 2024-05-06T06:55:33.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde64a86640 1 -- 172.21.15.70:0/4293268418 learned_addr learned my addr 172.21.15.70:0/4293268418 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:33.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde5f7fe640 1 -- 172.21.15.70:0/4293268418 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2421287746 0 0) 0x7fde600aaab0 con 0x7fde601450e0 2024-05-06T06:55:33.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde5f7fe640 1 -- 172.21.15.70:0/4293268418 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde48003530 con 0x7fde601450e0 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde5f7fe640 1 -- 172.21.15.70:0/4293268418 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 239232360 0 0) 0x7fde60142910 con 0x7fde60145af0 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde5f7fe640 1 -- 172.21.15.70:0/4293268418 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde600aaab0 con 0x7fde60145af0 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde5f7fe640 1 -- 172.21.15.70:0/4293268418 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3881693462 0 0) 0x7fde48003530 con 0x7fde601450e0 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde5f7fe640 1 -- 172.21.15.70:0/4293268418 >> v1:172.21.15.70:6790/0 conn(0x7fde60145af0 legacy=0x7fde6014d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde5f7fe640 1 -- 172.21.15.70:0/4293268418 >> v1:172.21.15.184:6789/0 conn(0x7fde600ab510 legacy=0x7fde60140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde5f7fe640 1 -- 172.21.15.70:0/4293268418 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde600743a0 con 0x7fde601450e0 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde5f7fe640 1 -- 172.21.15.70:0/4293268418 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fde500016a0 con 0x7fde601450e0 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde5f7fe640 1 -- 172.21.15.70:0/4293268418 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde50001840 con 0x7fde601450e0 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.935+0000 7fde5f7fe640 1 -- 172.21.15.70:0/4293268418 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fde50001cd0 con 0x7fde601450e0 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 -- 172.21.15.70:0/4293268418 >> v1:172.21.15.70:6789/0 conn(0x7fde601450e0 legacy=0x7fde600707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 -- 172.21.15.70:0/4293268418 shutdown_connections 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 -- 172.21.15.70:0/4293268418 >> 172.21.15.70:0/4293268418 conn(0x7fde600b1e20 msgr2=0x7fde600b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 -- 172.21.15.70:0/4293268418 shutdown_connections 2024-05-06T06:55:33.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 -- 172.21.15.70:0/4293268418 wait complete. 2024-05-06T06:55:33.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 Processor -- start 2024-05-06T06:55:33.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 -- start start 2024-05-06T06:55:33.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde6013a350 con 0x7fde600ab510 2024-05-06T06:55:33.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde60138c10 con 0x7fde601450e0 2024-05-06T06:55:33.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde600b1110 con 0x7fde60145af0 2024-05-06T06:55:33.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde64a86640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fde600ab510 0x7fde60138500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49680/0 (socket says 172.21.15.70:49680) 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde64a86640 1 -- 172.21.15.70:0/697749130 learned_addr learned my addr 172.21.15.70:0/697749130 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3635011738 0 0) 0x7fde6013a350 con 0x7fde600ab510 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde4c003530 con 0x7fde600ab510 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256325459 0 0) 0x7fde600b1110 con 0x7fde60145af0 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde6013a350 con 0x7fde60145af0 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1034045811 0 0) 0x7fde4c003530 con 0x7fde600ab510 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde600b1110 con 0x7fde600ab510 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fde50001b90 con 0x7fde600ab510 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 942064183 0 0) 0x7fde6013a350 con 0x7fde60145af0 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde4c003530 con 0x7fde60145af0 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fde58001b60 con 0x7fde60145af0 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4111553628 0 0) 0x7fde60138c10 con 0x7fde601450e0 2024-05-06T06:55:33.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde6013a350 con 0x7fde601450e0 2024-05-06T06:55:33.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 445765217 0 0) 0x7fde600b1110 con 0x7fde600ab510 2024-05-06T06:55:33.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 >> v1:172.21.15.70:6790/0 conn(0x7fde60145af0 legacy=0x7fde601dc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:33.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 >> v1:172.21.15.184:6789/0 conn(0x7fde601450e0 legacy=0x7fde601dc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:33.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde600b12e0 con 0x7fde600ab510 2024-05-06T06:55:33.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 -- 172.21.15.70:0/697749130 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fde601e4710 con 0x7fde600ab510 2024-05-06T06:55:33.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 -- 172.21.15.70:0/697749130 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fde601e4ab0 con 0x7fde600ab510 2024-05-06T06:55:33.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde500017a0 con 0x7fde600ab510 2024-05-06T06:55:33.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fde50004da0 con 0x7fde600ab510 2024-05-06T06:55:33.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.939+0000 7fde66cea640 1 -- 172.21.15.70:0/697749130 --> v1:172.21.15.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fde40000f90 con 0x7fde600ab510 2024-05-06T06:55:33.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.943+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fde5001bb40 con 0x7fde600ab510 2024-05-06T06:55:33.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.943+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7fde5008a910 con 0x7fde600ab510 2024-05-06T06:55:33.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.943+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 --> v1:172.21.15.70:6804/3977328488 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde4c07bec0 con 0x7fde4c078250 2024-05-06T06:55:33.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.943+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (unknown 758375209 0 0) 0x7fde5008ad20 con 0x7fde600ab510 2024-05-06T06:55:33.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.943+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== osd.0 v1:172.21.15.70:6804/3977328488 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fde4c07bec0 con 0x7fde4c078250 2024-05-06T06:55:33.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.955+0000 7fde66cea640 1 -- 172.21.15.70:0/697749130 --> v1:172.21.15.70:6804/3977328488 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fde40002ce0 con 0x7fde4c078250 2024-05-06T06:55:33.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.955+0000 7fde5d7fa640 1 -- 172.21.15.70:0/697749130 <== osd.0 v1:172.21.15.70:6804/3977328488 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fde40002ce0 con 0x7fde4c078250 2024-05-06T06:55:33.962 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-06T06:55:33.962 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-06T06:55:33.962 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-06T06:55:33.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.959+0000 7fde66cea640 1 -- 172.21.15.70:0/697749130 >> v1:172.21.15.70:6804/3977328488 conn(0x7fde4c078250 legacy=0x7fde4c07a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:33.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.959+0000 7fde66cea640 1 -- 172.21.15.70:0/697749130 >> v1:172.21.15.70:6816/2757942729 conn(0x7fde4c070100 legacy=0x7fde4c0725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:33.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.959+0000 7fde66cea640 1 -- 172.21.15.70:0/697749130 >> v1:172.21.15.70:6789/0 conn(0x7fde600ab510 legacy=0x7fde60138500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:33.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.959+0000 7fde65287640 1 -- 172.21.15.70:0/697749130 reap_dead start 2024-05-06T06:55:33.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.959+0000 7fde66cea640 1 -- 172.21.15.70:0/697749130 shutdown_connections 2024-05-06T06:55:33.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.959+0000 7fde66cea640 1 -- 172.21.15.70:0/697749130 >> 172.21.15.70:0/697749130 conn(0x7fde600b1e20 msgr2=0x7fde6013bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:33.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.959+0000 7fde66cea640 1 -- 172.21.15.70:0/697749130 shutdown_connections 2024-05-06T06:55:33.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:33.959+0000 7fde66cea640 1 -- 172.21.15.70:0/697749130 wait complete. 2024-05-06T06:55:33.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-06T06:55:34.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb80ae82640 1 Processor -- start 2024-05-06T06:55:34.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb80ae82640 1 -- start start 2024-05-06T06:55:34.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb80ae82640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8040b2cc0 con 0x7fb804141230 2024-05-06T06:55:34.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb80ae82640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8040ac3a0 con 0x7fb8040b28e0 2024-05-06T06:55:34.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb80ae82640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8040741f0 con 0x7fb804141810 2024-05-06T06:55:34.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb80941f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb804141230 0x7fb80414d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49696/0 (socket says 172.21.15.70:49696) 2024-05-06T06:55:34.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb803fff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fb804141810 0x7fb804140b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47702/0 (socket says 172.21.15.70:47702) 2024-05-06T06:55:34.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb80941f640 1 -- 172.21.15.70:0/472947784 learned_addr learned my addr 172.21.15.70:0/472947784 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:34.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb8037fe640 1 -- 172.21.15.70:0/472947784 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088673192 0 0) 0x7fb7fc0013d0 con 0x7fb804141230 2024-05-06T06:55:34.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb8037fe640 1 -- 172.21.15.70:0/472947784 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7ec003530 con 0x7fb804141230 2024-05-06T06:55:34.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb8037fe640 1 -- 172.21.15.70:0/472947784 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576165371 0 0) 0x7fb8040741f0 con 0x7fb804141810 2024-05-06T06:55:34.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb8037fe640 1 -- 172.21.15.70:0/472947784 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7fc0013d0 con 0x7fb804141810 2024-05-06T06:55:34.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb8037fe640 1 -- 172.21.15.70:0/472947784 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1008352397 0 0) 0x7fb7ec003530 con 0x7fb804141230 2024-05-06T06:55:34.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb8037fe640 1 -- 172.21.15.70:0/472947784 >> v1:172.21.15.70:6790/0 conn(0x7fb804141810 legacy=0x7fb804140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb8037fe640 1 -- 172.21.15.70:0/472947784 >> v1:172.21.15.184:6789/0 conn(0x7fb8040b28e0 legacy=0x7fb804145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb8037fe640 1 -- 172.21.15.70:0/472947784 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8040ab500 con 0x7fb804141230 2024-05-06T06:55:34.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb8037fe640 1 -- 172.21.15.70:0/472947784 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb7fc001b20 con 0x7fb804141230 2024-05-06T06:55:34.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb8037fe640 1 -- 172.21.15.70:0/472947784 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7fc001cc0 con 0x7fb804141230 2024-05-06T06:55:34.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb8037fe640 1 -- 172.21.15.70:0/472947784 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb7fc004c30 con 0x7fb804141230 2024-05-06T06:55:34.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb80ae82640 1 -- 172.21.15.70:0/472947784 >> v1:172.21.15.70:6789/0 conn(0x7fb804141230 legacy=0x7fb80414d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb80ae82640 1 -- 172.21.15.70:0/472947784 shutdown_connections 2024-05-06T06:55:34.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb80ae82640 1 -- 172.21.15.70:0/472947784 >> 172.21.15.70:0/472947784 conn(0x7fb8040b5c20 msgr2=0x7fb8040b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:34.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.091+0000 7fb80ae82640 1 -- 172.21.15.70:0/472947784 shutdown_connections 2024-05-06T06:55:34.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb80ae82640 1 -- 172.21.15.70:0/472947784 wait complete. 2024-05-06T06:55:34.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb80ae82640 1 Processor -- start 2024-05-06T06:55:34.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb80ae82640 1 -- start start 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb80ae82640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8041390a0 con 0x7fb8040b28e0 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb80ae82640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8040acb60 con 0x7fb804141810 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb80ae82640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8041dcd60 con 0x7fb804141230 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb808c1e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb8040b28e0 0x7fb8041443f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49698/0 (socket says 172.21.15.70:49698) 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb808c1e640 1 -- 172.21.15.70:0/1954852397 learned_addr learned my addr 172.21.15.70:0/1954852397 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3892554379 0 0) 0x7fb7f4001280 con 0x7fb8040b28e0 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7f0003530 con 0x7fb8040b28e0 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1323111479 0 0) 0x7fb8041dcd60 con 0x7fb804141230 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7f4001280 con 0x7fb804141230 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2055210920 0 0) 0x7fb7f0003530 con 0x7fb8040b28e0 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8041dcd60 con 0x7fb8040b28e0 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb7f4001b70 con 0x7fb8040b28e0 2024-05-06T06:55:34.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 182236774 0 0) 0x7fb7f4001280 con 0x7fb804141230 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7f0003530 con 0x7fb804141230 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb7f80017e0 con 0x7fb804141230 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454392995 0 0) 0x7fb8040acb60 con 0x7fb804141810 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7f4001280 con 0x7fb804141810 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2527497272 0 0) 0x7fb8041dcd60 con 0x7fb8040b28e0 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 >> v1:172.21.15.70:6790/0 conn(0x7fb804141230 legacy=0x7fb804138990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 >> v1:172.21.15.184:6789/0 conn(0x7fb804141810 legacy=0x7fb8041e0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8040730b0 con 0x7fb8040b28e0 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb80ae82640 1 -- 172.21.15.70:0/1954852397 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb8041e0d50 con 0x7fb8040b28e0 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb80ae82640 1 -- 172.21.15.70:0/1954852397 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb804072670 con 0x7fb8040b28e0 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7f40038d0 con 0x7fb8040b28e0 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb7f4003d20 con 0x7fb8040b28e0 2024-05-06T06:55:34.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.095+0000 7fb80ae82640 1 -- 172.21.15.70:0/1954852397 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e4005090 con 0x7fb8040b28e0 2024-05-06T06:55:34.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.099+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fb7f4003ec0 con 0x7fb8040b28e0 2024-05-06T06:55:34.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.099+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7fb7f408abf0 con 0x7fb8040b28e0 2024-05-06T06:55:34.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.103+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fb8041390a0 con 0x7fb8040b28e0 2024-05-06T06:55:34.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.259+0000 7fb80ae82640 1 -- 172.21.15.70:0/1954852397 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb7e4000ba0 con 0x7fb7f0070150 2024-05-06T06:55:34.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.259+0000 7fb8017fa640 1 -- 172.21.15.70:0/1954852397 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7fb7e4000ba0 con 0x7fb7f0070150 2024-05-06T06:55:34.262 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 0 to deep-scrub 2024-05-06T06:55:34.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.259+0000 7fb80ae82640 1 -- 172.21.15.70:0/1954852397 >> v1:172.21.15.70:6816/2757942729 conn(0x7fb7f0070150 legacy=0x7fb7f0072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.259+0000 7fb80ae82640 1 -- 172.21.15.70:0/1954852397 >> v1:172.21.15.70:6789/0 conn(0x7fb8040b28e0 legacy=0x7fb8041443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.259+0000 7fb80ae82640 1 -- 172.21.15.70:0/1954852397 shutdown_connections 2024-05-06T06:55:34.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.259+0000 7fb80ae82640 1 -- 172.21.15.70:0/1954852397 >> 172.21.15.70:0/1954852397 conn(0x7fb8040b5c20 msgr2=0x7fb8041408f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:34.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.259+0000 7fb80ae82640 1 -- 172.21.15.70:0/1954852397 shutdown_connections 2024-05-06T06:55:34.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.259+0000 7fb80ae82640 1 -- 172.21.15.70:0/1954852397 wait complete. 2024-05-06T06:55:34.280 INFO:tasks.ceph:Scrubbing osd.1 2024-05-06T06:55:34.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-06T06:55:34.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbccb148640 1 Processor -- start 2024-05-06T06:55:34.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbccb148640 1 -- start start 2024-05-06T06:55:34.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbccb148640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc40b24d0 con 0x7fbcc40b20f0 2024-05-06T06:55:34.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbccb148640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc40b2d00 con 0x7fbcc4141860 2024-05-06T06:55:34.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbccb148640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc4144de0 con 0x7fbcc4145a10 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc8ee4640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fbcc40b20f0 0x7fbcc4073380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49700/0 (socket says 172.21.15.70:49700) 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc8ee4640 1 -- 172.21.15.70:0/1553349152 learned_addr learned my addr 172.21.15.70:0/1553349152 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc37fe640 1 -- 172.21.15.70:0/1553349152 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187510406 0 0) 0x7fbcb8001120 con 0x7fbcc40b20f0 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc37fe640 1 -- 172.21.15.70:0/1553349152 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb4003530 con 0x7fbcc40b20f0 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc37fe640 1 -- 172.21.15.70:0/1553349152 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293745057 0 0) 0x7fbcc4144de0 con 0x7fbcc4145a10 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc37fe640 1 -- 172.21.15.70:0/1553349152 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb8001120 con 0x7fbcc4145a10 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc37fe640 1 -- 172.21.15.70:0/1553349152 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 881017927 0 0) 0x7fbcb4003530 con 0x7fbcc40b20f0 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc37fe640 1 -- 172.21.15.70:0/1553349152 >> v1:172.21.15.70:6790/0 conn(0x7fbcc4145a10 legacy=0x7fbcc4140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc37fe640 1 -- 172.21.15.70:0/1553349152 >> v1:172.21.15.184:6789/0 conn(0x7fbcc4141860 legacy=0x7fbcc4145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc37fe640 1 -- 172.21.15.70:0/1553349152 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc4073be0 con 0x7fbcc40b20f0 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc37fe640 1 -- 172.21.15.70:0/1553349152 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbcb8001870 con 0x7fbcc40b20f0 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc37fe640 1 -- 172.21.15.70:0/1553349152 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcb8001a10 con 0x7fbcc40b20f0 2024-05-06T06:55:34.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbcc37fe640 1 -- 172.21.15.70:0/1553349152 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbcb80048b0 con 0x7fbcc40b20f0 2024-05-06T06:55:34.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbccb148640 1 -- 172.21.15.70:0/1553349152 >> v1:172.21.15.70:6789/0 conn(0x7fbcc40b20f0 legacy=0x7fbcc4073380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbccb148640 1 -- 172.21.15.70:0/1553349152 shutdown_connections 2024-05-06T06:55:34.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.399+0000 7fbccb148640 1 -- 172.21.15.70:0/1553349152 >> 172.21.15.70:0/1553349152 conn(0x7fbcc40b2f80 msgr2=0x7fbcc40b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:34.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbccb148640 1 -- 172.21.15.70:0/1553349152 shutdown_connections 2024-05-06T06:55:34.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbccb148640 1 -- 172.21.15.70:0/1553349152 wait complete. 2024-05-06T06:55:34.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbccb148640 1 Processor -- start 2024-05-06T06:55:34.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbccb148640 1 -- start start 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbccb148640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc412f110 con 0x7fbcc40b20f0 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbccb148640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc4135560 con 0x7fbcc4141860 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbccb148640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc41375d0 con 0x7fbcc4145a10 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc8ee4640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fbcc40b20f0 0x7fbcc4135db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49710/0 (socket says 172.21.15.70:49710) 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc8ee4640 1 -- 172.21.15.70:0/2028748662 learned_addr learned my addr 172.21.15.70:0/2028748662 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 458905607 0 0) 0x7fbcc412f110 con 0x7fbcc40b20f0 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbca8003530 con 0x7fbcc40b20f0 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1711976505 0 0) 0x7fbcc41375d0 con 0x7fbcc4145a10 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc412f110 con 0x7fbcc4145a10 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 980846069 0 0) 0x7fbca8003530 con 0x7fbcc40b20f0 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcc41375d0 con 0x7fbcc40b20f0 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbcb8000ee0 con 0x7fbcc40b20f0 2024-05-06T06:55:34.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3372842252 0 0) 0x7fbcc412f110 con 0x7fbcc4145a10 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbca8003530 con 0x7fbcc4145a10 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbcbc001ab0 con 0x7fbcc4145a10 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 189689582 0 0) 0x7fbcc4135560 con 0x7fbcc4141860 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc412f110 con 0x7fbcc4141860 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1055241522 0 0) 0x7fbcc41375d0 con 0x7fbcc40b20f0 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6790/0 conn(0x7fbcc4145a10 legacy=0x7fbcc412ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.184:6789/0 conn(0x7fbcc4141860 legacy=0x7fbcc412e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc41378b0 con 0x7fbcc40b20f0 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbccb148640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc4137b90 con 0x7fbcc40b20f0 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbccb148640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbcc412f530 con 0x7fbcc40b20f0 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcb8004b70 con 0x7fbcc40b20f0 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc8ee4640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6789/0 conn(0x7fbcc40b20f0 legacy=0x7fbcc4135db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc8ee4640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6789/0 conn(0x7fbcc40b20f0 legacy=0x7fbcc4135db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc8ee4640 1 --1- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6789/0 conn(0x7fbcc40b20f0 0x7fbcc4135db0 :-1 s=OPENED pgs=320 cs=1 l=1).handle_message read tag failed 2024-05-06T06:55:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc8ee4640 1 --1- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6789/0 conn(0x7fbcc40b20f0 0x7fbcc4135db0 :-1 s=OPENED pgs=320 cs=1 l=1).fault on lossy channel, failing 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbcb8004ec0 con 0x7fbcc40b20f0 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6789/0 conn(0x7fbcc40b20f0 legacy=0x7fbcc4135db0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbcc41375d0 con 0x7fbca80089c0 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbcc4135560 con 0x7fbcc4141860 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbca8012470 con 0x7fbcc4145a10 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185401169 0 0) 0x7fbcc41375d0 con 0x7fbca80089c0 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fbca80113f0 con 0x7fbca80089c0 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3548953794 0 0) 0x7fbca8012470 con 0x7fbcc4145a10 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fbcc41375d0 con 0x7fbcc4145a10 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858368430 0 0) 0x7fbcc4135560 con 0x7fbcc4141860 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.403+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.184:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fbca8012470 con 0x7fbcc4141860 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 1626770571 0 0) 0x7fbca80113f0 con 0x7fbca80089c0 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6790/0 conn(0x7fbcc4145a10 legacy=0x7fbca8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.184:6789/0 conn(0x7fbcc4141860 legacy=0x7fbca800e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7fbca8013890 con 0x7fbca80089c0 2024-05-06T06:55:34.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fbcb00015c0 con 0x7fbca80089c0 2024-05-06T06:55:34.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcb0001630 con 0x7fbca80089c0 2024-05-06T06:55:34.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbccb148640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fbcc413d980 con 0x7fbca80089c0 2024-05-06T06:55:34.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fbcb0001860 con 0x7fbca80089c0 2024-05-06T06:55:34.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 6 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7fbcb0088a70 con 0x7fbca80089c0 2024-05-06T06:55:34.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6812/1567593695 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbca8087440 con 0x7fbca80837d0 2024-05-06T06:55:34.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (unknown 758375209 0 0) 0x7fbcb0088f10 con 0x7fbca80089c0 2024-05-06T06:55:34.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc96e5640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6812/1567593695 conn(0x7fbca80837d0 legacy=0x7fbca8085c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-05-06T06:55:34.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc96e5640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6812/1567593695 conn(0x7fbca80837d0 legacy=0x7fbca8085c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T06:55:34.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc96e5640 1 --1- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6812/1567593695 conn(0x7fbca80837d0 0x7fbca8085c70 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2024-05-06T06:55:34.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc96e5640 1 --1- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6812/1567593695 conn(0x7fbca80837d0 0x7fbca8085c70 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2024-05-06T06:55:34.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6812/1567593695 conn(0x7fbca80837d0 legacy=0x7fbca8085c70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-06T06:55:34.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6812/1567593695 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbca808cc70 con 0x7fbca8089060 2024-05-06T06:55:34.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=34}) -- 0x7fbca80113f0 con 0x7fbca80089c0 2024-05-06T06:55:34.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.407+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== osd.1 v1:172.21.15.70:6812/1567593695 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fbca808cc70 con 0x7fbca8089060 2024-05-06T06:55:34.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.423+0000 7fbccb148640 1 -- 172.21.15.70:0/2028748662 --> v1:172.21.15.70:6812/1567593695 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbcc40640c0 con 0x7fbca8089060 2024-05-06T06:55:34.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.423+0000 7fbcc17fa640 1 -- 172.21.15.70:0/2028748662 <== osd.1 v1:172.21.15.70:6812/1567593695 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fbcc40640c0 con 0x7fbca8089060 2024-05-06T06:55:34.426 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-06T06:55:34.426 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-06T06:55:34.426 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-06T06:55:34.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.423+0000 7fbccb148640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6812/1567593695 conn(0x7fbca8089060 legacy=0x7fbca808b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.423+0000 7fbccb148640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6816/2757942729 conn(0x7fbca807b9d0 legacy=0x7fbca807de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.423+0000 7fbccb148640 1 -- 172.21.15.70:0/2028748662 >> v1:172.21.15.70:6789/0 conn(0x7fbca80089c0 legacy=0x7fbca800adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.423+0000 7fbcc96e5640 1 -- 172.21.15.70:0/2028748662 reap_dead start 2024-05-06T06:55:34.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.423+0000 7fbccb148640 1 -- 172.21.15.70:0/2028748662 shutdown_connections 2024-05-06T06:55:34.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.423+0000 7fbccb148640 1 -- 172.21.15.70:0/2028748662 >> 172.21.15.70:0/2028748662 conn(0x7fbcc40b2f80 msgr2=0x7fbcc40b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:34.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.423+0000 7fbccb148640 1 -- 172.21.15.70:0/2028748662 shutdown_connections 2024-05-06T06:55:34.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.423+0000 7fbccb148640 1 -- 172.21.15.70:0/2028748662 wait complete. 2024-05-06T06:55:34.441 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-06T06:55:34.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7d1e2f640 1 Processor -- start 2024-05-06T06:55:34.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7d1e2f640 1 -- start start 2024-05-06T06:55:34.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7d1e2f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc0b2cc0 con 0x7fd7cc141810 2024-05-06T06:55:34.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7d1e2f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc0ac3a0 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7d1e2f640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc0741f0 con 0x7fd7cc141230 2024-05-06T06:55:34.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7caffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fd7cc141810 0x7fd7cc140b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49726/0 (socket says 172.21.15.70:49726) 2024-05-06T06:55:34.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7caffd640 1 -- 172.21.15.70:0/3515744396 learned_addr learned my addr 172.21.15.70:0/3515744396 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7ca7fc640 1 -- 172.21.15.70:0/3515744396 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 732001915 0 0) 0x7fd7bc001120 con 0x7fd7cc141810 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7ca7fc640 1 -- 172.21.15.70:0/3515744396 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7b4003530 con 0x7fd7cc141810 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7ca7fc640 1 -- 172.21.15.70:0/3515744396 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1879672022 0 0) 0x7fd7cc0741f0 con 0x7fd7cc141230 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7ca7fc640 1 -- 172.21.15.70:0/3515744396 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7bc001120 con 0x7fd7cc141230 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7ca7fc640 1 -- 172.21.15.70:0/3515744396 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3008921632 0 0) 0x7fd7b4003530 con 0x7fd7cc141810 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7ca7fc640 1 -- 172.21.15.70:0/3515744396 >> v1:172.21.15.70:6790/0 conn(0x7fd7cc141230 legacy=0x7fd7cc14d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7ca7fc640 1 -- 172.21.15.70:0/3515744396 >> v1:172.21.15.184:6789/0 conn(0x7fd7cc0b28e0 legacy=0x7fd7cc145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7ca7fc640 1 -- 172.21.15.70:0/3515744396 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc0ab500 con 0x7fd7cc141810 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7ca7fc640 1 -- 172.21.15.70:0/3515744396 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd7bc001870 con 0x7fd7cc141810 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7ca7fc640 1 -- 172.21.15.70:0/3515744396 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7bc001a90 con 0x7fd7cc141810 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7ca7fc640 1 -- 172.21.15.70:0/3515744396 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd7bc0048b0 con 0x7fd7cc141810 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/3515744396 >> v1:172.21.15.70:6789/0 conn(0x7fd7cc141810 legacy=0x7fd7cc140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/3515744396 shutdown_connections 2024-05-06T06:55:34.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/3515744396 >> 172.21.15.70:0/3515744396 conn(0x7fd7cc0b5c20 msgr2=0x7fd7cc0b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:34.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/3515744396 shutdown_connections 2024-05-06T06:55:34.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.539+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/3515744396 wait complete. 2024-05-06T06:55:34.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7d1e2f640 1 Processor -- start 2024-05-06T06:55:34.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7d1e2f640 1 -- start start 2024-05-06T06:55:34.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7d1e2f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc1daa00 con 0x7fd7cc141230 2024-05-06T06:55:34.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7d1e2f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc1d9af0 con 0x7fd7cc141810 2024-05-06T06:55:34.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7d1e2f640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc1d9dd0 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7cb7fe640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fd7cc0b28e0 0x7fd7cc0b03b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47766/0 (socket says 172.21.15.70:47766) 2024-05-06T06:55:34.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7cb7fe640 1 -- 172.21.15.70:0/2255115345 learned_addr learned my addr 172.21.15.70:0/2255115345 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:34.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3480245946 0 0) 0x7fd7cc1d9dd0 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7b8003530 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374961192 0 0) 0x7fd7cc1daa00 con 0x7fd7cc141230 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7cc1d9dd0 con 0x7fd7cc141230 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3596154409 0 0) 0x7fd7b8003530 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd7cc1daa00 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd7c00019e0 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3707262836 0 0) 0x7fd7cc1d9dd0 con 0x7fd7cc141230 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd7b8003530 con 0x7fd7cc141230 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd7bc0047f0 con 0x7fd7cc141230 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2208547667 0 0) 0x7fd7cc1daa00 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 >> v1:172.21.15.184:6789/0 conn(0x7fd7cc141810 legacy=0x7fd7cc0adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 >> v1:172.21.15.70:6789/0 conn(0x7fd7cc141230 legacy=0x7fd7cc1da2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc0b1790 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/2255115345 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd7cc13a6e0 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/2255115345 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd7cc13ae60 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7c0001ce0 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fd7c0003a70 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.543+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/2255115345 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7ac005090 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.547+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fd7c0003c90 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.547+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7fd7c008aac0 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.551+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fd7c0057c50 con 0x7fd7cc0b28e0 2024-05-06T06:55:34.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.715+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/2255115345 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd7ac000ba0 con 0x7fd7b806ffc0 2024-05-06T06:55:34.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.715+0000 7fd7b3fff640 1 -- 172.21.15.70:0/2255115345 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7fd7ac000ba0 con 0x7fd7b806ffc0 2024-05-06T06:55:34.719 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 1 to deep-scrub 2024-05-06T06:55:34.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.719+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/2255115345 >> v1:172.21.15.70:6816/2757942729 conn(0x7fd7b806ffc0 legacy=0x7fd7b8072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.719+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/2255115345 >> v1:172.21.15.70:6790/0 conn(0x7fd7cc0b28e0 legacy=0x7fd7cc0b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.719+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/2255115345 shutdown_connections 2024-05-06T06:55:34.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.719+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/2255115345 >> 172.21.15.70:0/2255115345 conn(0x7fd7cc0b5c20 msgr2=0x7fd7cc0aab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:34.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.719+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/2255115345 shutdown_connections 2024-05-06T06:55:34.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.719+0000 7fd7d1e2f640 1 -- 172.21.15.70:0/2255115345 wait complete. 2024-05-06T06:55:34.737 INFO:tasks.ceph:Scrubbing osd.2 2024-05-06T06:55:34.738 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-06T06:55:34.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a0df5d640 1 Processor -- start 2024-05-06T06:55:34.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a0df5d640 1 -- start start 2024-05-06T06:55:34.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a0df5d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a08074670 con 0x7f5a08140800 2024-05-06T06:55:34.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a0df5d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a08143e20 con 0x7f5a081370a0 2024-05-06T06:55:34.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a0df5d640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a080aa460 con 0x7f5a08137480 2024-05-06T06:55:34.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a07fff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5a08140800 0x7f5a08144300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49740/0 (socket says 172.21.15.70:49740) 2024-05-06T06:55:34.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a07fff640 1 -- 172.21.15.70:0/246112985 learned_addr learned my addr 172.21.15.70:0/246112985 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:34.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a067fc640 1 -- 172.21.15.70:0/246112985 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781573690 0 0) 0x7f5a08074670 con 0x7f5a08140800 2024-05-06T06:55:34.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a067fc640 1 -- 172.21.15.70:0/246112985 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59f0005740 con 0x7f5a08140800 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a067fc640 1 -- 172.21.15.70:0/246112985 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540038142 0 0) 0x7f5a080aa460 con 0x7f5a08137480 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a067fc640 1 -- 172.21.15.70:0/246112985 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a08074670 con 0x7f5a08137480 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a067fc640 1 -- 172.21.15.70:0/246112985 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1446260864 0 0) 0x7f59f0005740 con 0x7f5a08140800 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a067fc640 1 -- 172.21.15.70:0/246112985 >> v1:172.21.15.70:6790/0 conn(0x7f5a08137480 legacy=0x7f5a08073f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a067fc640 1 -- 172.21.15.70:0/246112985 >> v1:172.21.15.184:6789/0 conn(0x7f5a081370a0 legacy=0x7f5a080707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a067fc640 1 -- 172.21.15.70:0/246112985 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a08144a10 con 0x7f5a08140800 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a067fc640 1 -- 172.21.15.70:0/246112985 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5a000016a0 con 0x7f5a08140800 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a067fc640 1 -- 172.21.15.70:0/246112985 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a00001840 con 0x7f5a08140800 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a067fc640 1 -- 172.21.15.70:0/246112985 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5a00001cd0 con 0x7f5a08140800 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a0df5d640 1 -- 172.21.15.70:0/246112985 >> v1:172.21.15.70:6789/0 conn(0x7f5a08140800 legacy=0x7f5a08144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a0df5d640 1 -- 172.21.15.70:0/246112985 shutdown_connections 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a0df5d640 1 -- 172.21.15.70:0/246112985 >> 172.21.15.70:0/246112985 conn(0x7f5a080b1e20 msgr2=0x7f5a080b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a0df5d640 1 -- 172.21.15.70:0/246112985 shutdown_connections 2024-05-06T06:55:34.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.855+0000 7f5a0df5d640 1 -- 172.21.15.70:0/246112985 wait complete. 2024-05-06T06:55:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f5a0df5d640 1 Processor -- start 2024-05-06T06:55:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f5a0df5d640 1 -- start start 2024-05-06T06:55:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f5a0df5d640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a0813d480 con 0x7f5a081370a0 2024-05-06T06:55:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f5a0df5d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a0813d760 con 0x7f5a08140800 2024-05-06T06:55:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f5a0df5d640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a08138220 con 0x7f5a08137480 2024-05-06T06:55:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f5a077fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5a081370a0 0x7f5a08134450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49752/0 (socket says 172.21.15.70:49752) 2024-05-06T06:55:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f5a077fe640 1 -- 172.21.15.70:0/1179569322 learned_addr learned my addr 172.21.15.70:0/1179569322 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048375060 0 0) 0x7f5a0813d480 con 0x7f5a081370a0 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59f4003530 con 0x7f5a081370a0 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209067373 0 0) 0x7f5a08138220 con 0x7f5a08137480 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a0813d480 con 0x7f5a08137480 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3943880797 0 0) 0x7f59f4003530 con 0x7f5a081370a0 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a08138220 con 0x7f5a081370a0 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f59f8001dc0 con 0x7f5a081370a0 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3116454606 0 0) 0x7f5a0813d480 con 0x7f5a08137480 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59f4003530 con 0x7f5a08137480 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f59fc0019d0 con 0x7f5a08137480 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2290767365 0 0) 0x7f5a08138220 con 0x7f5a081370a0 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 >> v1:172.21.15.70:6790/0 conn(0x7f5a08137480 legacy=0x7f5a081d4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 >> v1:172.21.15.184:6789/0 conn(0x7f5a08140800 legacy=0x7f5a081e00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0813dbf0 con 0x7f5a081370a0 2024-05-06T06:55:34.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f5a0df5d640 1 -- 172.21.15.70:0/1179569322 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0813b510 con 0x7f5a081370a0 2024-05-06T06:55:34.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f5a0df5d640 1 -- 172.21.15.70:0/1179569322 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5a08134d30 con 0x7f5a081370a0 2024-05-06T06:55:34.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59f8002040 con 0x7f5a081370a0 2024-05-06T06:55:34.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f59f8003df0 con 0x7f5a081370a0 2024-05-06T06:55:34.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f5a0df5d640 1 -- 172.21.15.70:0/1179569322 --> v1:172.21.15.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f59e8000f90 con 0x7f5a081370a0 2024-05-06T06:55:34.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f59f8003f90 con 0x7f5a081370a0 2024-05-06T06:55:34.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7f59f808ae60 con 0x7f5a081370a0 2024-05-06T06:55:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 --> v1:172.21.15.70:6800/1610479439 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59f407bf60 con 0x7f59f40782f0 2024-05-06T06:55:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.859+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (unknown 758375209 0 0) 0x7f59f808b270 con 0x7f5a081370a0 2024-05-06T06:55:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.863+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== osd.2 v1:172.21.15.70:6800/1610479439 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f59f407bf60 con 0x7f59f40782f0 2024-05-06T06:55:34.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.875+0000 7f5a0df5d640 1 -- 172.21.15.70:0/1179569322 --> v1:172.21.15.70:6800/1610479439 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f59e8002ce0 con 0x7f59f40782f0 2024-05-06T06:55:34.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.875+0000 7f59effff640 1 -- 172.21.15.70:0/1179569322 <== osd.2 v1:172.21.15.70:6800/1610479439 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f59e8002ce0 con 0x7f59f40782f0 2024-05-06T06:55:34.879 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-06T06:55:34.879 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-06T06:55:34.879 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-06T06:55:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.875+0000 7f5a0df5d640 1 -- 172.21.15.70:0/1179569322 >> v1:172.21.15.70:6800/1610479439 conn(0x7f59f40782f0 legacy=0x7f59f407a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.875+0000 7f5a0df5d640 1 -- 172.21.15.70:0/1179569322 >> v1:172.21.15.70:6816/2757942729 conn(0x7f59f40700b0 legacy=0x7f59f4072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.875+0000 7f5a0df5d640 1 -- 172.21.15.70:0/1179569322 >> v1:172.21.15.70:6789/0 conn(0x7f5a081370a0 legacy=0x7f5a08134450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.875+0000 7f5a07fff640 1 -- 172.21.15.70:0/1179569322 reap_dead start 2024-05-06T06:55:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.875+0000 7f5a0df5d640 1 -- 172.21.15.70:0/1179569322 shutdown_connections 2024-05-06T06:55:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.875+0000 7f5a0df5d640 1 -- 172.21.15.70:0/1179569322 >> 172.21.15.70:0/1179569322 conn(0x7f5a080b1e20 msgr2=0x7f5a08074140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.875+0000 7f5a0df5d640 1 -- 172.21.15.70:0/1179569322 shutdown_connections 2024-05-06T06:55:34.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:34.875+0000 7f5a0df5d640 1 -- 172.21.15.70:0/1179569322 wait complete. 2024-05-06T06:55:34.896 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-06T06:55:35.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec23f58640 1 Processor -- start 2024-05-06T06:55:35.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec23f58640 1 -- start start 2024-05-06T06:55:35.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec23f58640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c0ac300 con 0x7fec1c0aa460 2024-05-06T06:55:35.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec23f58640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c145880 con 0x7fec1c0b6580 2024-05-06T06:55:35.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec23f58640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c0b6960 con 0x7fec1c145430 2024-05-06T06:55:35.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec214f3640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fec1c0aa460 0x7fec1c144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49758/0 (socket says 172.21.15.70:49758) 2024-05-06T06:55:35.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec214f3640 1 -- 172.21.15.70:0/2710682790 learned_addr learned my addr 172.21.15.70:0/2710682790 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:35.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec224f5640 1 --1- 172.21.15.70:0/2710682790 >> v1:172.21.15.70:6790/0 conn(0x7fec1c145430 0x7fec1c14d0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47796/0 (socket says 172.21.15.70:47796) 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec20cf2640 1 -- 172.21.15.70:0/2710682790 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2497912374 0 0) 0x7fec1c0ac300 con 0x7fec1c0aa460 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec20cf2640 1 -- 172.21.15.70:0/2710682790 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec08003530 con 0x7fec1c0aa460 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec20cf2640 1 -- 172.21.15.70:0/2710682790 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433798726 0 0) 0x7fec140014a0 con 0x7fec1c145430 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec20cf2640 1 -- 172.21.15.70:0/2710682790 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec1c0ac300 con 0x7fec1c145430 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec20cf2640 1 -- 172.21.15.70:0/2710682790 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 426676299 0 0) 0x7fec08003530 con 0x7fec1c0aa460 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec20cf2640 1 -- 172.21.15.70:0/2710682790 >> v1:172.21.15.70:6790/0 conn(0x7fec1c145430 legacy=0x7fec1c14d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec20cf2640 1 -- 172.21.15.70:0/2710682790 >> v1:172.21.15.184:6789/0 conn(0x7fec1c0b6580 legacy=0x7fec1c13e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec20cf2640 1 -- 172.21.15.70:0/2710682790 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c0ac5a0 con 0x7fec1c0aa460 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec20cf2640 1 -- 172.21.15.70:0/2710682790 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fec180016a0 con 0x7fec1c0aa460 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec20cf2640 1 -- 172.21.15.70:0/2710682790 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fec180018c0 con 0x7fec1c0aa460 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec20cf2640 1 -- 172.21.15.70:0/2710682790 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fec18001c90 con 0x7fec1c0aa460 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec23f58640 1 -- 172.21.15.70:0/2710682790 >> v1:172.21.15.70:6789/0 conn(0x7fec1c0aa460 legacy=0x7fec1c144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec23f58640 1 -- 172.21.15.70:0/2710682790 shutdown_connections 2024-05-06T06:55:35.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec23f58640 1 -- 172.21.15.70:0/2710682790 >> 172.21.15.70:0/2710682790 conn(0x7fec1c06e2d0 msgr2=0x7fec1c0b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:35.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec23f58640 1 -- 172.21.15.70:0/2710682790 shutdown_connections 2024-05-06T06:55:35.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.003+0000 7fec23f58640 1 -- 172.21.15.70:0/2710682790 wait complete. 2024-05-06T06:55:35.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec23f58640 1 Processor -- start 2024-05-06T06:55:35.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec23f58640 1 -- start start 2024-05-06T06:55:35.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec23f58640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c0aedb0 con 0x7fec1c145430 2024-05-06T06:55:35.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec23f58640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c0ac9c0 con 0x7fec1c0b6580 2024-05-06T06:55:35.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec23f58640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c0acec0 con 0x7fec1c0aa460 2024-05-06T06:55:35.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec21cf4640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fec1c0aa460 0x7fec1c135d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47808/0 (socket says 172.21.15.70:47808) 2024-05-06T06:55:35.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec21cf4640 1 -- 172.21.15.70:0/573106151 learned_addr learned my addr 172.21.15.70:0/573106151 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164563274 0 0) 0x7fec1c0ac300 con 0x7fec1c145430 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec00003530 con 0x7fec1c145430 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113327677 0 0) 0x7fec1c0acec0 con 0x7fec1c0aa460 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec1c0ac300 con 0x7fec1c0aa460 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1657337695 0 0) 0x7fec00003530 con 0x7fec1c145430 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec1c0acec0 con 0x7fec1c145430 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fec14001b00 con 0x7fec1c145430 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 399207131 0 0) 0x7fec1c0ac300 con 0x7fec1c0aa460 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fec00003530 con 0x7fec1c0aa460 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fec0c001a00 con 0x7fec1c0aa460 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1907597935 0 0) 0x7fec1c0acec0 con 0x7fec1c145430 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 >> v1:172.21.15.70:6790/0 conn(0x7fec1c0aa460 legacy=0x7fec1c135d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 >> v1:172.21.15.184:6789/0 conn(0x7fec1c0b6580 legacy=0x7fec1c1dc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c0b1680 con 0x7fec1c145430 2024-05-06T06:55:35.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec23f58640 1 -- 172.21.15.70:0/573106151 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fec1c0b1930 con 0x7fec1c145430 2024-05-06T06:55:35.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec23f58640 1 -- 172.21.15.70:0/573106151 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fec1c136610 con 0x7fec1c145430 2024-05-06T06:55:35.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fec14002030 con 0x7fec1c145430 2024-05-06T06:55:35.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fec14004d10 con 0x7fec1c145430 2024-05-06T06:55:35.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec23f58640 1 -- 172.21.15.70:0/573106151 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec04005090 con 0x7fec1c145430 2024-05-06T06:55:35.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fec1401bab0 con 0x7fec1c145430 2024-05-06T06:55:35.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.007+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7fec1408ab40 con 0x7fec1c145430 2024-05-06T06:55:35.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.011+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fec1c0aedb0 con 0x7fec1c145430 2024-05-06T06:55:35.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.171+0000 7fec23f58640 1 -- 172.21.15.70:0/573106151 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fec04000ba0 con 0x7fec00070010 2024-05-06T06:55:35.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.171+0000 7fec127fc640 1 -- 172.21.15.70:0/573106151 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7fec04000ba0 con 0x7fec00070010 2024-05-06T06:55:35.174 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 2 to deep-scrub 2024-05-06T06:55:35.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.171+0000 7fec23f58640 1 -- 172.21.15.70:0/573106151 >> v1:172.21.15.70:6816/2757942729 conn(0x7fec00070010 legacy=0x7fec000724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.171+0000 7fec23f58640 1 -- 172.21.15.70:0/573106151 >> v1:172.21.15.70:6789/0 conn(0x7fec1c145430 legacy=0x7fec1c1e4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.171+0000 7fec23f58640 1 -- 172.21.15.70:0/573106151 shutdown_connections 2024-05-06T06:55:35.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.171+0000 7fec23f58640 1 -- 172.21.15.70:0/573106151 >> 172.21.15.70:0/573106151 conn(0x7fec1c06e2d0 msgr2=0x7fec1c0b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:35.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.171+0000 7fec23f58640 1 -- 172.21.15.70:0/573106151 shutdown_connections 2024-05-06T06:55:35.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.171+0000 7fec23f58640 1 -- 172.21.15.70:0/573106151 wait complete. 2024-05-06T06:55:35.191 INFO:tasks.ceph:Scrubbing osd.3 2024-05-06T06:55:35.192 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-06T06:55:35.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14d0975640 1 Processor -- start 2024-05-06T06:55:35.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14d0975640 1 -- start start 2024-05-06T06:55:35.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14d0975640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14cc0aaab0 con 0x7f14cc145af0 2024-05-06T06:55:35.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14d0975640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14cc1454c0 con 0x7f14cc0ab510 2024-05-06T06:55:35.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14d0975640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14cc142910 con 0x7f14cc1450e0 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14ca59c640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f14cc1450e0 0x7f14cc0707f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47818/0 (socket says 172.21.15.70:47818) 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14cad9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f14cc145af0 0x7f14cc14d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49768/0 (socket says 172.21.15.70:49768) 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14ca59c640 1 -- 172.21.15.70:0/1579871784 learned_addr learned my addr 172.21.15.70:0/1579871784 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14c959a640 1 -- 172.21.15.70:0/1579871784 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1646385504 0 0) 0x7f14cc0aaab0 con 0x7f14cc145af0 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14c959a640 1 -- 172.21.15.70:0/1579871784 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14b4003530 con 0x7f14cc145af0 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14c959a640 1 -- 172.21.15.70:0/1579871784 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760623910 0 0) 0x7f14cc142910 con 0x7f14cc1450e0 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14c959a640 1 -- 172.21.15.70:0/1579871784 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14cc0aaab0 con 0x7f14cc1450e0 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14c959a640 1 -- 172.21.15.70:0/1579871784 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1678941710 0 0) 0x7f14b4003530 con 0x7f14cc145af0 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14c959a640 1 -- 172.21.15.70:0/1579871784 >> v1:172.21.15.70:6790/0 conn(0x7f14cc1450e0 legacy=0x7f14cc0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14c959a640 1 -- 172.21.15.70:0/1579871784 >> v1:172.21.15.184:6789/0 conn(0x7f14cc0ab510 legacy=0x7f14cc140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14c959a640 1 -- 172.21.15.70:0/1579871784 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc0743a0 con 0x7f14cc145af0 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14c959a640 1 -- 172.21.15.70:0/1579871784 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f14c4001a20 con 0x7f14cc145af0 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14c959a640 1 -- 172.21.15.70:0/1579871784 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14c4001bc0 con 0x7f14cc145af0 2024-05-06T06:55:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14c959a640 1 -- 172.21.15.70:0/1579871784 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f14c4002050 con 0x7f14cc145af0 2024-05-06T06:55:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14d0975640 1 -- 172.21.15.70:0/1579871784 >> v1:172.21.15.70:6789/0 conn(0x7f14cc145af0 legacy=0x7f14cc14d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14d0975640 1 -- 172.21.15.70:0/1579871784 shutdown_connections 2024-05-06T06:55:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14d0975640 1 -- 172.21.15.70:0/1579871784 >> 172.21.15.70:0/1579871784 conn(0x7f14cc0b1e20 msgr2=0x7f14cc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14d0975640 1 -- 172.21.15.70:0/1579871784 shutdown_connections 2024-05-06T06:55:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.311+0000 7f14d0975640 1 -- 172.21.15.70:0/1579871784 wait complete. 2024-05-06T06:55:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14d0975640 1 Processor -- start 2024-05-06T06:55:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14d0975640 1 -- start start 2024-05-06T06:55:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14d0975640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14cc074170 con 0x7f14cc0ab510 2024-05-06T06:55:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14d0975640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14cc073d90 con 0x7f14cc145af0 2024-05-06T06:55:35.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14d0975640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14cc11cf00 con 0x7f14cc1450e0 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14ca59c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f14cc0ab510 0x7f14cc139750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49782/0 (socket says 172.21.15.70:49782) 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14c9d9b640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f14cc1450e0 0x7f14cc072470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47820/0 (socket says 172.21.15.70:47820) 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14ca59c640 1 -- 172.21.15.70:0/3144147615 learned_addr learned my addr 172.21.15.70:0/3144147615 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4015462796 0 0) 0x7f14cc074170 con 0x7f14cc0ab510 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14ac003530 con 0x7f14cc0ab510 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217734332 0 0) 0x7f14cc11cf00 con 0x7f14cc1450e0 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14cc074170 con 0x7f14cc1450e0 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 835393066 0 0) 0x7f14ac003530 con 0x7f14cc0ab510 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14cc11cf00 con 0x7f14cc0ab510 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f14c00013c0 con 0x7f14cc0ab510 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 599276097 0 0) 0x7f14cc073d90 con 0x7f14cc145af0 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14ac003530 con 0x7f14cc145af0 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 189936078 0 0) 0x7f14cc074170 con 0x7f14cc1450e0 2024-05-06T06:55:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14cc073d90 con 0x7f14cc1450e0 2024-05-06T06:55:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f14bc001900 con 0x7f14cc1450e0 2024-05-06T06:55:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2322484475 0 0) 0x7f14cc11cf00 con 0x7f14cc0ab510 2024-05-06T06:55:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 >> v1:172.21.15.70:6790/0 conn(0x7f14cc1450e0 legacy=0x7f14cc072470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 >> v1:172.21.15.184:6789/0 conn(0x7f14cc145af0 legacy=0x7f14cc072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14cc11d0d0 con 0x7f14cc0ab510 2024-05-06T06:55:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14d0975640 1 -- 172.21.15.70:0/3144147615 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f14cc11d4e0 con 0x7f14cc0ab510 2024-05-06T06:55:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14d0975640 1 -- 172.21.15.70:0/3144147615 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f14cc0b1110 con 0x7f14cc0ab510 2024-05-06T06:55:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14c00047f0 con 0x7f14cc0ab510 2024-05-06T06:55:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f14c0004b40 con 0x7f14cc0ab510 2024-05-06T06:55:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.315+0000 7f14d0975640 1 -- 172.21.15.70:0/3144147615 --> v1:172.21.15.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f14b0000f90 con 0x7f14cc0ab510 2024-05-06T06:55:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.319+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f14c001b8e0 con 0x7f14cc0ab510 2024-05-06T06:55:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.319+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7f14c008a940 con 0x7f14cc0ab510 2024-05-06T06:55:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.319+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 --> v1:172.21.15.70:6808/3320203314 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14ac07bf80 con 0x7f14ac078310 2024-05-06T06:55:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.319+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (unknown 758375209 0 0) 0x7f14c008adb0 con 0x7f14cc0ab510 2024-05-06T06:55:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.319+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== osd.3 v1:172.21.15.70:6808/3320203314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f14ac07bf80 con 0x7f14ac078310 2024-05-06T06:55:35.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.335+0000 7f14d0975640 1 -- 172.21.15.70:0/3144147615 --> v1:172.21.15.70:6808/3320203314 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f14b0002ce0 con 0x7f14ac078310 2024-05-06T06:55:35.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.335+0000 7f14baffd640 1 -- 172.21.15.70:0/3144147615 <== osd.3 v1:172.21.15.70:6808/3320203314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f14b0002ce0 con 0x7f14ac078310 2024-05-06T06:55:35.341 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-06T06:55:35.341 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-06T06:55:35.341 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-06T06:55:35.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.335+0000 7f14d0975640 1 -- 172.21.15.70:0/3144147615 >> v1:172.21.15.70:6808/3320203314 conn(0x7f14ac078310 legacy=0x7f14ac07a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.339+0000 7f14d0975640 1 -- 172.21.15.70:0/3144147615 >> v1:172.21.15.70:6816/2757942729 conn(0x7f14ac070130 legacy=0x7f14ac0725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.339+0000 7f14d0975640 1 -- 172.21.15.70:0/3144147615 >> v1:172.21.15.70:6789/0 conn(0x7f14cc0ab510 legacy=0x7f14cc139750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.339+0000 7f14cad9d640 1 -- 172.21.15.70:0/3144147615 reap_dead start 2024-05-06T06:55:35.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.339+0000 7f14d0975640 1 -- 172.21.15.70:0/3144147615 shutdown_connections 2024-05-06T06:55:35.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.339+0000 7f14d0975640 1 -- 172.21.15.70:0/3144147615 >> 172.21.15.70:0/3144147615 conn(0x7f14cc0b1e20 msgr2=0x7f14cc1414e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:35.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.339+0000 7f14d0975640 1 -- 172.21.15.70:0/3144147615 shutdown_connections 2024-05-06T06:55:35.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.339+0000 7f14d0975640 1 -- 172.21.15.70:0/3144147615 wait complete. 2024-05-06T06:55:35.359 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-06T06:55:35.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59c7380640 1 Processor -- start 2024-05-06T06:55:35.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59c7380640 1 -- start start 2024-05-06T06:55:35.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59c7380640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c00ac300 con 0x7f59c00b6580 2024-05-06T06:55:35.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59c7380640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c0145880 con 0x7f59c0145430 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59c7380640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c00b6960 con 0x7f59c00aa460 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59c491b640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f59c00aa460 0x7f59c0144d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47822/0 (socket says 172.21.15.70:47822) 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59c511c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f59c00b6580 0x7f59c013e9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49794/0 (socket says 172.21.15.70:49794) 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59c491b640 1 -- 172.21.15.70:0/754241125 learned_addr learned my addr 172.21.15.70:0/754241125 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59b7fff640 1 -- 172.21.15.70:0/754241125 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701362810 0 0) 0x7f59b0001120 con 0x7f59c00aa460 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59b7fff640 1 -- 172.21.15.70:0/754241125 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59ac003530 con 0x7f59c00aa460 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59b7fff640 1 -- 172.21.15.70:0/754241125 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3688990637 0 0) 0x7f59c00ac300 con 0x7f59c00b6580 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59b7fff640 1 -- 172.21.15.70:0/754241125 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59b0001120 con 0x7f59c00b6580 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59b7fff640 1 -- 172.21.15.70:0/754241125 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4047882889 0 0) 0x7f59b0001120 con 0x7f59c00b6580 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59b7fff640 1 -- 172.21.15.70:0/754241125 >> v1:172.21.15.70:6790/0 conn(0x7f59c00aa460 legacy=0x7f59c0144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59b7fff640 1 -- 172.21.15.70:0/754241125 >> v1:172.21.15.184:6789/0 conn(0x7f59c0145430 legacy=0x7f59c014d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59b7fff640 1 -- 172.21.15.70:0/754241125 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c00ac5a0 con 0x7f59c00b6580 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59b7fff640 1 -- 172.21.15.70:0/754241125 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f59bc001600 con 0x7f59c00b6580 2024-05-06T06:55:35.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59b7fff640 1 -- 172.21.15.70:0/754241125 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59bc001820 con 0x7f59c00b6580 2024-05-06T06:55:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.479+0000 7f59b7fff640 1 -- 172.21.15.70:0/754241125 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f59bc001c30 con 0x7f59c00b6580 2024-05-06T06:55:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 -- 172.21.15.70:0/754241125 >> v1:172.21.15.70:6789/0 conn(0x7f59c00b6580 legacy=0x7f59c013e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 -- 172.21.15.70:0/754241125 shutdown_connections 2024-05-06T06:55:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 -- 172.21.15.70:0/754241125 >> 172.21.15.70:0/754241125 conn(0x7f59c006e2d0 msgr2=0x7f59c00b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 -- 172.21.15.70:0/754241125 shutdown_connections 2024-05-06T06:55:35.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 -- 172.21.15.70:0/754241125 wait complete. 2024-05-06T06:55:35.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 Processor -- start 2024-05-06T06:55:35.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 -- start start 2024-05-06T06:55:35.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c01366f0 con 0x7f59c00aa460 2024-05-06T06:55:35.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c01369d0 con 0x7f59c0145430 2024-05-06T06:55:35.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c01442c0 con 0x7f59c00b6580 2024-05-06T06:55:35.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c511c640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f59c00aa460 0x7f59c012fb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49800/0 (socket says 172.21.15.70:49800) 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c491b640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f59c00b6580 0x7f59c0143bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47836/0 (socket says 172.21.15.70:47836) 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c511c640 1 -- 172.21.15.70:0/3773469552 learned_addr learned my addr 172.21.15.70:0/3773469552 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065429449 0 0) 0x7f59c01366f0 con 0x7f59c00aa460 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a4003530 con 0x7f59c00aa460 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1367281588 0 0) 0x7f59c01442c0 con 0x7f59c00b6580 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59c01366f0 con 0x7f59c00b6580 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3902613449 0 0) 0x7f59a4003530 con 0x7f59c00aa460 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59c01442c0 con 0x7f59c00aa460 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1215713881 0 0) 0x7f59c01366f0 con 0x7f59c00b6580 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59a4003530 con 0x7f59c00b6580 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f59bc001c70 con 0x7f59c00aa460 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f59b00017a0 con 0x7f59c00b6580 2024-05-06T06:55:35.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 157388457 0 0) 0x7f59c01442c0 con 0x7f59c00aa460 2024-05-06T06:55:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 >> v1:172.21.15.70:6790/0 conn(0x7f59c00b6580 legacy=0x7f59c0143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 >> v1:172.21.15.184:6789/0 conn(0x7f59c0145430 legacy=0x7f59c01e1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c0143120 con 0x7f59c00aa460 2024-05-06T06:55:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 -- 172.21.15.70:0/3773469552 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59c0131090 con 0x7f59c00aa460 2024-05-06T06:55:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 -- 172.21.15.70:0/3773469552 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f59c0134d30 con 0x7f59c00aa460 2024-05-06T06:55:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59bc0017c0 con 0x7f59c00aa460 2024-05-06T06:55:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f59bc004c40 con 0x7f59c00aa460 2024-05-06T06:55:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.483+0000 7f59c7380640 1 -- 172.21.15.70:0/3773469552 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a0005090 con 0x7f59c00aa460 2024-05-06T06:55:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.487+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f59bc004e60 con 0x7f59c00aa460 2024-05-06T06:55:35.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.487+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7f59bc08aa20 con 0x7f59c00aa460 2024-05-06T06:55:35.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.491+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f59bc057bf0 con 0x7f59c00aa460 2024-05-06T06:55:35.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.639+0000 7f59c7380640 1 -- 172.21.15.70:0/3773469552 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f59a0000ba0 con 0x7f59a4070010 2024-05-06T06:55:35.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.639+0000 7f59b5ffb640 1 -- 172.21.15.70:0/3773469552 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f59a0000ba0 con 0x7f59a4070010 2024-05-06T06:55:35.644 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 3 to deep-scrub 2024-05-06T06:55:35.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.643+0000 7f59c7380640 1 -- 172.21.15.70:0/3773469552 >> v1:172.21.15.70:6816/2757942729 conn(0x7f59a4070010 legacy=0x7f59a40724d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.643+0000 7f59c7380640 1 -- 172.21.15.70:0/3773469552 >> v1:172.21.15.70:6789/0 conn(0x7f59c00aa460 legacy=0x7f59c012fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.643+0000 7f59c7380640 1 -- 172.21.15.70:0/3773469552 shutdown_connections 2024-05-06T06:55:35.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.643+0000 7f59c7380640 1 -- 172.21.15.70:0/3773469552 >> 172.21.15.70:0/3773469552 conn(0x7f59c006e2d0 msgr2=0x7f59c00b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:35.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.643+0000 7f59c7380640 1 -- 172.21.15.70:0/3773469552 shutdown_connections 2024-05-06T06:55:35.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.643+0000 7f59c7380640 1 -- 172.21.15.70:0/3773469552 wait complete. 2024-05-06T06:55:35.662 INFO:tasks.ceph:Scrubbing osd.4 2024-05-06T06:55:35.663 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-06T06:55:35.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.775+0000 7ff2c3da2640 1 Processor -- start 2024-05-06T06:55:35.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.775+0000 7ff2c3da2640 1 -- start start 2024-05-06T06:55:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.775+0000 7ff2c3da2640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc0aaab0 con 0x7ff2bc145af0 2024-05-06T06:55:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.775+0000 7ff2c3da2640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc1454c0 con 0x7ff2bc0ab510 2024-05-06T06:55:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.775+0000 7ff2c3da2640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc142910 con 0x7ff2bc1450e0 2024-05-06T06:55:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.775+0000 7ff2c233f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ff2bc145af0 0x7ff2bc14d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49808/0 (socket says 172.21.15.70:49808) 2024-05-06T06:55:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.775+0000 7ff2c233f640 1 -- 172.21.15.70:0/2228215822 learned_addr learned my addr 172.21.15.70:0/2228215822 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c0b3c640 1 -- 172.21.15.70:0/2228215822 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900608182 0 0) 0x7ff2bc0aaab0 con 0x7ff2bc145af0 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c0b3c640 1 -- 172.21.15.70:0/2228215822 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a8003530 con 0x7ff2bc145af0 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c0b3c640 1 -- 172.21.15.70:0/2228215822 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264261613 0 0) 0x7ff2bc142910 con 0x7ff2bc1450e0 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c0b3c640 1 -- 172.21.15.70:0/2228215822 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2bc0aaab0 con 0x7ff2bc1450e0 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c0b3c640 1 -- 172.21.15.70:0/2228215822 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2723081682 0 0) 0x7ff2bc0aaab0 con 0x7ff2bc1450e0 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c0b3c640 1 -- 172.21.15.70:0/2228215822 >> v1:172.21.15.184:6789/0 conn(0x7ff2bc0ab510 legacy=0x7ff2bc140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c0b3c640 1 -- 172.21.15.70:0/2228215822 >> v1:172.21.15.70:6789/0 conn(0x7ff2bc145af0 legacy=0x7ff2bc14d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c0b3c640 1 -- 172.21.15.70:0/2228215822 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc0743a0 con 0x7ff2bc1450e0 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c0b3c640 1 -- 172.21.15.70:0/2228215822 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff2b8001680 con 0x7ff2bc1450e0 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c0b3c640 1 -- 172.21.15.70:0/2228215822 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2b8001820 con 0x7ff2bc1450e0 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c0b3c640 1 -- 172.21.15.70:0/2228215822 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff2b8001c30 con 0x7ff2bc1450e0 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c3da2640 1 -- 172.21.15.70:0/2228215822 >> v1:172.21.15.70:6790/0 conn(0x7ff2bc1450e0 legacy=0x7ff2bc0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c3da2640 1 -- 172.21.15.70:0/2228215822 shutdown_connections 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c3da2640 1 -- 172.21.15.70:0/2228215822 >> 172.21.15.70:0/2228215822 conn(0x7ff2bc0b1e20 msgr2=0x7ff2bc0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c3da2640 1 -- 172.21.15.70:0/2228215822 shutdown_connections 2024-05-06T06:55:35.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c3da2640 1 -- 172.21.15.70:0/2228215822 wait complete. 2024-05-06T06:55:35.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c3da2640 1 Processor -- start 2024-05-06T06:55:35.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c3da2640 1 -- start start 2024-05-06T06:55:35.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c3da2640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc0b14e0 con 0x7ff2bc145af0 2024-05-06T06:55:35.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c3da2640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc1d79c0 con 0x7ff2bc1450e0 2024-05-06T06:55:35.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c3da2640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc0b1970 con 0x7ff2bc0ab510 2024-05-06T06:55:35.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c233f640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7ff2bc145af0 0x7ff2bc1e14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49816/0 (socket says 172.21.15.70:49816) 2024-05-06T06:55:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c1b3e640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7ff2bc0ab510 0x7ff2bc0af010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47844/0 (socket says 172.21.15.70:47844) 2024-05-06T06:55:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c233f640 1 -- 172.21.15.70:0/1698063130 learned_addr learned my addr 172.21.15.70:0/1698063130 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297973448 0 0) 0x7ff2bc0b14e0 con 0x7ff2bc145af0 2024-05-06T06:55:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2a0003530 con 0x7ff2bc145af0 2024-05-06T06:55:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421708335 0 0) 0x7ff2bc0b1970 con 0x7ff2bc0ab510 2024-05-06T06:55:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2bc0b14e0 con 0x7ff2bc0ab510 2024-05-06T06:55:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4255091162 0 0) 0x7ff2a0003530 con 0x7ff2bc145af0 2024-05-06T06:55:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2bc0b1970 con 0x7ff2bc145af0 2024-05-06T06:55:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3491461296 0 0) 0x7ff2bc0b14e0 con 0x7ff2bc0ab510 2024-05-06T06:55:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff2a0003530 con 0x7ff2bc0ab510 2024-05-06T06:55:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff2b4001ba0 con 0x7ff2bc145af0 2024-05-06T06:55:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff2b8001cb0 con 0x7ff2bc0ab510 2024-05-06T06:55:35.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855223254 0 0) 0x7ff2bc1d79c0 con 0x7ff2bc1450e0 2024-05-06T06:55:35.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2bc0b14e0 con 0x7ff2bc1450e0 2024-05-06T06:55:35.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3284945726 0 0) 0x7ff2bc0b1970 con 0x7ff2bc145af0 2024-05-06T06:55:35.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 >> v1:172.21.15.70:6790/0 conn(0x7ff2bc0ab510 legacy=0x7ff2bc0af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 >> v1:172.21.15.184:6789/0 conn(0x7ff2bc1450e0 legacy=0x7ff2bc1d6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc0acaa0 con 0x7ff2bc145af0 2024-05-06T06:55:35.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c3da2640 1 -- 172.21.15.70:0/1698063130 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc0af720 con 0x7ff2bc145af0 2024-05-06T06:55:35.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.779+0000 7ff2c3da2640 1 -- 172.21.15.70:0/1698063130 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff2bc1d75c0 con 0x7ff2bc145af0 2024-05-06T06:55:35.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.783+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2b4004b70 con 0x7ff2bc145af0 2024-05-06T06:55:35.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.783+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7ff2b4004d20 con 0x7ff2bc145af0 2024-05-06T06:55:35.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.783+0000 7ff2c3da2640 1 -- 172.21.15.70:0/1698063130 --> v1:172.21.15.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff2a4000f90 con 0x7ff2bc145af0 2024-05-06T06:55:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.783+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7ff2b401bac0 con 0x7ff2bc145af0 2024-05-06T06:55:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.783+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7ff2b408abd0 con 0x7ff2bc145af0 2024-05-06T06:55:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.783+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 --> v1:172.21.15.184:6808/1828934695 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2a007be60 con 0x7ff2a00781f0 2024-05-06T06:55:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.783+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (unknown 758375209 0 0) 0x7ff2b408af30 con 0x7ff2bc145af0 2024-05-06T06:55:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.787+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== osd.4 v1:172.21.15.184:6808/1828934695 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7ff2a007be60 con 0x7ff2a00781f0 2024-05-06T06:55:35.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.799+0000 7ff2c3da2640 1 -- 172.21.15.70:0/1698063130 --> v1:172.21.15.184:6808/1828934695 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff2a4002ce0 con 0x7ff2a00781f0 2024-05-06T06:55:35.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.799+0000 7ff2b27fc640 1 -- 172.21.15.70:0/1698063130 <== osd.4 v1:172.21.15.184:6808/1828934695 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7ff2a4002ce0 con 0x7ff2a00781f0 2024-05-06T06:55:35.803 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-06T06:55:35.803 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-06T06:55:35.803 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-06T06:55:35.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.799+0000 7ff2c3da2640 1 -- 172.21.15.70:0/1698063130 >> v1:172.21.15.184:6808/1828934695 conn(0x7ff2a00781f0 legacy=0x7ff2a007a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.799+0000 7ff2c3da2640 1 -- 172.21.15.70:0/1698063130 >> v1:172.21.15.70:6816/2757942729 conn(0x7ff2a00700a0 legacy=0x7ff2a0072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.799+0000 7ff2c3da2640 1 -- 172.21.15.70:0/1698063130 >> v1:172.21.15.70:6789/0 conn(0x7ff2bc145af0 legacy=0x7ff2bc1e14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.799+0000 7ff2c233f640 1 -- 172.21.15.70:0/1698063130 reap_dead start 2024-05-06T06:55:35.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.799+0000 7ff2c3da2640 1 -- 172.21.15.70:0/1698063130 shutdown_connections 2024-05-06T06:55:35.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.799+0000 7ff2c3da2640 1 -- 172.21.15.70:0/1698063130 >> 172.21.15.70:0/1698063130 conn(0x7ff2bc0b1e20 msgr2=0x7ff2bc141d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:35.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.799+0000 7ff2c3da2640 1 -- 172.21.15.70:0/1698063130 shutdown_connections 2024-05-06T06:55:35.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.799+0000 7ff2c3da2640 1 -- 172.21.15.70:0/1698063130 wait complete. 2024-05-06T06:55:35.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-06T06:55:35.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.919+0000 7fb7e2731640 1 Processor -- start 2024-05-06T06:55:35.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.919+0000 7fb7e2731640 1 -- start start 2024-05-06T06:55:35.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc0b4a80 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc144980 con 0x7fb7dc147420 2024-05-06T06:55:35.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc070fd0 con 0x7fb7dc143a10 2024-05-06T06:55:35.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7dbfff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb7dc0b46a0 0x7fb7dc13a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49830/0 (socket says 172.21.15.70:49830) 2024-05-06T06:55:35.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7db7fe640 1 --1- 172.21.15.70:0/1539737060 >> v1:172.21.15.70:6790/0 conn(0x7fb7dc143a10 0x7fb7dc06f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:47848/0 (socket says 172.21.15.70:47848) 2024-05-06T06:55:35.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7dbfff640 1 -- 172.21.15.70:0/1539737060 learned_addr learned my addr 172.21.15.70:0/1539737060 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:35.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7daffd640 1 -- 172.21.15.70:0/1539737060 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1964991295 0 0) 0x7fb7cc001120 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7daffd640 1 -- 172.21.15.70:0/1539737060 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7c4003530 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7daffd640 1 -- 172.21.15.70:0/1539737060 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 46482931 0 0) 0x7fb7dc070fd0 con 0x7fb7dc143a10 2024-05-06T06:55:35.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7daffd640 1 -- 172.21.15.70:0/1539737060 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7cc001120 con 0x7fb7dc143a10 2024-05-06T06:55:35.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7daffd640 1 -- 172.21.15.70:0/1539737060 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4144828259 0 0) 0x7fb7cc001120 con 0x7fb7dc143a10 2024-05-06T06:55:35.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7daffd640 1 -- 172.21.15.70:0/1539737060 >> v1:172.21.15.184:6789/0 conn(0x7fb7dc147420 legacy=0x7fb7dc147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7daffd640 1 -- 172.21.15.70:0/1539737060 >> v1:172.21.15.70:6789/0 conn(0x7fb7dc0b46a0 legacy=0x7fb7dc13a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7daffd640 1 -- 172.21.15.70:0/1539737060 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc070030 con 0x7fb7dc143a10 2024-05-06T06:55:35.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7daffd640 1 -- 172.21.15.70:0/1539737060 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb7d0001680 con 0x7fb7dc143a10 2024-05-06T06:55:35.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7daffd640 1 -- 172.21.15.70:0/1539737060 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7d0001820 con 0x7fb7dc143a10 2024-05-06T06:55:35.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7daffd640 1 -- 172.21.15.70:0/1539737060 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb7d0001c30 con 0x7fb7dc143a10 2024-05-06T06:55:35.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 -- 172.21.15.70:0/1539737060 >> v1:172.21.15.70:6790/0 conn(0x7fb7dc143a10 legacy=0x7fb7dc06f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 -- 172.21.15.70:0/1539737060 shutdown_connections 2024-05-06T06:55:35.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 -- 172.21.15.70:0/1539737060 >> 172.21.15.70:0/1539737060 conn(0x7fb7dc06de20 msgr2=0x7fb7dc06e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:35.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 -- 172.21.15.70:0/1539737060 shutdown_connections 2024-05-06T06:55:35.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 -- 172.21.15.70:0/1539737060 wait complete. 2024-05-06T06:55:35.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 Processor -- start 2024-05-06T06:55:35.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 -- start start 2024-05-06T06:55:35.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc13f9e0 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc13fcc0 con 0x7fb7dc147420 2024-05-06T06:55:35.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7e2731640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7dc130940 con 0x7fb7dc143a10 2024-05-06T06:55:35.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7dbfff640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb7dc0b46a0 0x7fb7dc140150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:49836/0 (socket says 172.21.15.70:49836) 2024-05-06T06:55:35.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7dbfff640 1 -- 172.21.15.70:0/4258145208 learned_addr learned my addr 172.21.15.70:0/4258145208 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:35.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138168469 0 0) 0x7fb7dc13f9e0 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7c8003560 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3136041641 0 0) 0x7fb7dc130940 con 0x7fb7dc143a10 2024-05-06T06:55:35.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7dc13f9e0 con 0x7fb7dc143a10 2024-05-06T06:55:35.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3952716551 0 0) 0x7fb7c8003560 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7dc130940 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb7cc001820 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 481721192 0 0) 0x7fb7dc13f9e0 con 0x7fb7dc143a10 2024-05-06T06:55:35.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7c8003560 con 0x7fb7dc143a10 2024-05-06T06:55:35.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb7d0001b70 con 0x7fb7dc143a10 2024-05-06T06:55:35.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.923+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3107655659 0 0) 0x7fb7dc130940 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.927+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 >> v1:172.21.15.70:6790/0 conn(0x7fb7dc143a10 legacy=0x7fb7dc12f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.927+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 >> v1:172.21.15.184:6789/0 conn(0x7fb7dc147420 legacy=0x7fb7dc140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:35.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.927+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc13d9d0 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.927+0000 7fb7e2731640 1 -- 172.21.15.70:0/4258145208 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb7dc13dc80 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.927+0000 7fb7e2731640 1 -- 172.21.15.70:0/4258145208 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb7dc12fca0 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.927+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7cc0047f0 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.927+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb7cc004b40 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.927+0000 7fb7e2731640 1 -- 172.21.15.70:0/4258145208 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7bc005090 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.927+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fb7cc01b8e0 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.927+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7fb7cc08a840 con 0x7fb7dc0b46a0 2024-05-06T06:55:35.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:35.931+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fb7dc13dc80 con 0x7fb7dc0b46a0 2024-05-06T06:55:36.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.123+0000 7fb7e2731640 1 -- 172.21.15.70:0/4258145208 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fb7bc000ba0 con 0x7fb7c80700a0 2024-05-06T06:55:36.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.123+0000 7fb7d8ff9640 1 -- 172.21.15.70:0/4258145208 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7fb7bc000ba0 con 0x7fb7c80700a0 2024-05-06T06:55:36.128 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 4 to deep-scrub 2024-05-06T06:55:36.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.127+0000 7fb7e2731640 1 -- 172.21.15.70:0/4258145208 >> v1:172.21.15.70:6816/2757942729 conn(0x7fb7c80700a0 legacy=0x7fb7c8072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.127+0000 7fb7e2731640 1 -- 172.21.15.70:0/4258145208 >> v1:172.21.15.70:6789/0 conn(0x7fb7dc0b46a0 legacy=0x7fb7dc140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.127+0000 7fb7e2731640 1 -- 172.21.15.70:0/4258145208 shutdown_connections 2024-05-06T06:55:36.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.127+0000 7fb7e2731640 1 -- 172.21.15.70:0/4258145208 >> 172.21.15.70:0/4258145208 conn(0x7fb7dc06de20 msgr2=0x7fb7dc13a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:36.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.127+0000 7fb7e2731640 1 -- 172.21.15.70:0/4258145208 shutdown_connections 2024-05-06T06:55:36.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.127+0000 7fb7e2731640 1 -- 172.21.15.70:0/4258145208 wait complete. 2024-05-06T06:55:36.147 INFO:tasks.ceph:Scrubbing osd.5 2024-05-06T06:55:36.148 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-06T06:55:36.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47b5285640 1 Processor -- start 2024-05-06T06:55:36.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47b5285640 1 -- start start 2024-05-06T06:55:36.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47b5285640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b006daf0 con 0x7f47b0073af0 2024-05-06T06:55:36.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47b5285640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b0072be0 con 0x7f47b0143780 2024-05-06T06:55:36.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47b5285640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b0072ec0 con 0x7f47b0144200 2024-05-06T06:55:36.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47af7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f47b0073af0 0x7f47b014b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53252/0 (socket says 172.21.15.70:53252) 2024-05-06T06:55:36.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47af7fe640 1 -- 172.21.15.70:0/1348833857 learned_addr learned my addr 172.21.15.70:0/1348833857 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:36.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47ae7fc640 1 --1- 172.21.15.70:0/1348833857 >> v1:172.21.15.70:6790/0 conn(0x7f47b0144200 0x7f47b00733e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:58898/0 (socket says 172.21.15.70:58898) 2024-05-06T06:55:36.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47adffb640 1 -- 172.21.15.70:0/1348833857 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398829882 0 0) 0x7f47b006daf0 con 0x7f47b0073af0 2024-05-06T06:55:36.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47adffb640 1 -- 172.21.15.70:0/1348833857 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f479c003450 con 0x7f47b0073af0 2024-05-06T06:55:36.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47adffb640 1 -- 172.21.15.70:0/1348833857 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834901270 0 0) 0x7f47b0072ec0 con 0x7f47b0144200 2024-05-06T06:55:36.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47adffb640 1 -- 172.21.15.70:0/1348833857 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47b006daf0 con 0x7f47b0144200 2024-05-06T06:55:36.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47adffb640 1 -- 172.21.15.70:0/1348833857 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1221985571 0 0) 0x7f479c003450 con 0x7f47b0073af0 2024-05-06T06:55:36.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47adffb640 1 -- 172.21.15.70:0/1348833857 >> v1:172.21.15.70:6790/0 conn(0x7f47b0144200 legacy=0x7f47b00733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47adffb640 1 -- 172.21.15.70:0/1348833857 >> v1:172.21.15.184:6789/0 conn(0x7f47b0143780 legacy=0x7f47b013f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47adffb640 1 -- 172.21.15.70:0/1348833857 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b013fb60 con 0x7f47b0073af0 2024-05-06T06:55:36.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47adffb640 1 -- 172.21.15.70:0/1348833857 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f47a00016a0 con 0x7f47b0073af0 2024-05-06T06:55:36.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47adffb640 1 -- 172.21.15.70:0/1348833857 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47a0001840 con 0x7f47b0073af0 2024-05-06T06:55:36.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47adffb640 1 -- 172.21.15.70:0/1348833857 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f47a0001cd0 con 0x7f47b0073af0 2024-05-06T06:55:36.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47b5285640 1 -- 172.21.15.70:0/1348833857 >> v1:172.21.15.70:6789/0 conn(0x7f47b0073af0 legacy=0x7f47b014b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47b5285640 1 -- 172.21.15.70:0/1348833857 shutdown_connections 2024-05-06T06:55:36.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47b5285640 1 -- 172.21.15.70:0/1348833857 >> 172.21.15.70:0/1348833857 conn(0x7f47b00b1e20 msgr2=0x7f47b00b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:36.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47b5285640 1 -- 172.21.15.70:0/1348833857 shutdown_connections 2024-05-06T06:55:36.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.259+0000 7f47b5285640 1 -- 172.21.15.70:0/1348833857 wait complete. 2024-05-06T06:55:36.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47b5285640 1 Processor -- start 2024-05-06T06:55:36.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47b5285640 1 -- start start 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47b5285640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b01d8ec0 con 0x7f47b0144200 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47b5285640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b013b530 con 0x7f47b0143780 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47b5285640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b0139730 con 0x7f47b0073af0 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47aeffd640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f47b0073af0 0x7f47b01d80a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:58910/0 (socket says 172.21.15.70:58910) 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47af7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f47b0144200 0x7f47b01df500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53260/0 (socket says 172.21.15.70:53260) 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47aeffd640 1 -- 172.21.15.70:0/3805286365 learned_addr learned my addr 172.21.15.70:0/3805286365 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 118246561 0 0) 0x7f47b01d8ec0 con 0x7f47b0144200 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4790003530 con 0x7f47b0144200 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599367456 0 0) 0x7f47b0139730 con 0x7f47b0073af0 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47b01d8ec0 con 0x7f47b0073af0 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2243476802 0 0) 0x7f4790003530 con 0x7f47b0144200 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47b0139730 con 0x7f47b0144200 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f47a0001b90 con 0x7f47b0144200 2024-05-06T06:55:36.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1817633933 0 0) 0x7f47b01d8ec0 con 0x7f47b0073af0 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4790003530 con 0x7f47b0073af0 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f47a8001d80 con 0x7f47b0073af0 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2381953535 0 0) 0x7f47b013b530 con 0x7f47b0143780 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47b01d8ec0 con 0x7f47b0143780 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 372047004 0 0) 0x7f47b0139730 con 0x7f47b0144200 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 >> v1:172.21.15.70:6790/0 conn(0x7f47b0073af0 legacy=0x7f47b01d80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 >> v1:172.21.15.184:6789/0 conn(0x7f47b0143780 legacy=0x7f47b01d87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b013df80 con 0x7f47b0144200 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47b5285640 1 -- 172.21.15.70:0/3805286365 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47b013e270 con 0x7f47b0144200 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47b5285640 1 -- 172.21.15.70:0/3805286365 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f47b0142d70 con 0x7f47b0144200 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47a0000fa0 con 0x7f47b0144200 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f47a0004c00 con 0x7f47b0144200 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47b5285640 1 -- 172.21.15.70:0/3805286365 --> v1:172.21.15.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4794000f90 con 0x7f47b0144200 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.263+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f47a001b9a0 con 0x7f47b0144200 2024-05-06T06:55:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.267+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7f47a008a8a0 con 0x7f47b0144200 2024-05-06T06:55:36.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.267+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 --> v1:172.21.15.184:6800/1533654869 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f479007be40 con 0x7f47900781d0 2024-05-06T06:55:36.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.267+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (unknown 758375209 0 0) 0x7f47a008ac00 con 0x7f47b0144200 2024-05-06T06:55:36.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.267+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== osd.5 v1:172.21.15.184:6800/1533654869 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f479007be40 con 0x7f47900781d0 2024-05-06T06:55:36.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.283+0000 7f47b5285640 1 -- 172.21.15.70:0/3805286365 --> v1:172.21.15.184:6800/1533654869 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4794002ce0 con 0x7f47900781d0 2024-05-06T06:55:36.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.283+0000 7f47a77fe640 1 -- 172.21.15.70:0/3805286365 <== osd.5 v1:172.21.15.184:6800/1533654869 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f4794002ce0 con 0x7f47900781d0 2024-05-06T06:55:36.286 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-06T06:55:36.286 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-06T06:55:36.286 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-06T06:55:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.283+0000 7f47b5285640 1 -- 172.21.15.70:0/3805286365 >> v1:172.21.15.184:6800/1533654869 conn(0x7f47900781d0 legacy=0x7f479007a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.283+0000 7f47b5285640 1 -- 172.21.15.70:0/3805286365 >> v1:172.21.15.70:6816/2757942729 conn(0x7f4790070080 legacy=0x7f4790072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.283+0000 7f47b5285640 1 -- 172.21.15.70:0/3805286365 >> v1:172.21.15.70:6789/0 conn(0x7f47b0144200 legacy=0x7f47b01df500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.283+0000 7f47af7fe640 1 -- 172.21.15.70:0/3805286365 reap_dead start 2024-05-06T06:55:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.283+0000 7f47b5285640 1 -- 172.21.15.70:0/3805286365 shutdown_connections 2024-05-06T06:55:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.283+0000 7f47b5285640 1 -- 172.21.15.70:0/3805286365 >> 172.21.15.70:0/3805286365 conn(0x7f47b00b1e20 msgr2=0x7f47b0075e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.283+0000 7f47b5285640 1 -- 172.21.15.70:0/3805286365 shutdown_connections 2024-05-06T06:55:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.283+0000 7f47b5285640 1 -- 172.21.15.70:0/3805286365 wait complete. 2024-05-06T06:55:36.303 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-06T06:55:36.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5bf1979640 1 Processor -- start 2024-05-06T06:55:36.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5bf1979640 1 -- start start 2024-05-06T06:55:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5bf1979640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bec06e060 con 0x7f5bec072910 2024-05-06T06:55:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5bf1979640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bec0ac330 con 0x7f5bec06dc80 2024-05-06T06:55:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5bf1979640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bec0ac610 con 0x7f5bec137cc0 2024-05-06T06:55:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5beb7fe640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5bec072910 0x7f5bec072da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53266/0 (socket says 172.21.15.70:53266) 2024-05-06T06:55:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5beb7fe640 1 -- 172.21.15.70:0/1332363341 learned_addr learned my addr 172.21.15.70:0/1332363341 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5be9ffb640 1 -- 172.21.15.70:0/1332363341 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992025438 0 0) 0x7f5bdc0014a0 con 0x7f5bec072910 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5be9ffb640 1 -- 172.21.15.70:0/1332363341 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bd8003530 con 0x7f5bec072910 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5be9ffb640 1 -- 172.21.15.70:0/1332363341 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1474487765 0 0) 0x7f5bec0ac610 con 0x7f5bec137cc0 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5be9ffb640 1 -- 172.21.15.70:0/1332363341 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bdc0014a0 con 0x7f5bec137cc0 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5be9ffb640 1 -- 172.21.15.70:0/1332363341 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2810338804 0 0) 0x7f5bd8003530 con 0x7f5bec072910 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5be9ffb640 1 -- 172.21.15.70:0/1332363341 >> v1:172.21.15.70:6790/0 conn(0x7f5bec137cc0 legacy=0x7f5bec138140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5be9ffb640 1 -- 172.21.15.70:0/1332363341 >> v1:172.21.15.184:6789/0 conn(0x7f5bec06dc80 legacy=0x7f5bec141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5be9ffb640 1 -- 172.21.15.70:0/1332363341 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bec142540 con 0x7f5bec072910 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5be9ffb640 1 -- 172.21.15.70:0/1332363341 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5bdc001bf0 con 0x7f5bec072910 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5be9ffb640 1 -- 172.21.15.70:0/1332363341 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5bdc001e10 con 0x7f5bec072910 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.407+0000 7f5be9ffb640 1 -- 172.21.15.70:0/1332363341 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5bdc004c30 con 0x7f5bec072910 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 -- 172.21.15.70:0/1332363341 >> v1:172.21.15.70:6789/0 conn(0x7f5bec072910 legacy=0x7f5bec072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 -- 172.21.15.70:0/1332363341 shutdown_connections 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 -- 172.21.15.70:0/1332363341 >> 172.21.15.70:0/1332363341 conn(0x7f5bec0b67a0 msgr2=0x7f5bec0b6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:36.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 -- 172.21.15.70:0/1332363341 shutdown_connections 2024-05-06T06:55:36.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 -- 172.21.15.70:0/1332363341 wait complete. 2024-05-06T06:55:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 Processor -- start 2024-05-06T06:55:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 -- start start 2024-05-06T06:55:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bec138f70 con 0x7f5bec06dc80 2024-05-06T06:55:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bec139250 con 0x7f5bec072910 2024-05-06T06:55:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bec12add0 con 0x7f5bec137cc0 2024-05-06T06:55:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5beaffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f5bec06dc80 0x7f5bec1d9da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53280/0 (socket says 172.21.15.70:53280) 2024-05-06T06:55:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5beaffd640 1 -- 172.21.15.70:0/3868800461 learned_addr learned my addr 172.21.15.70:0/3868800461 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5beb7fe640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f5bec137cc0 0x7f5bec1e10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:58920/0 (socket says 172.21.15.70:58920) 2024-05-06T06:55:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3794699065 0 0) 0x7f5bec138f70 con 0x7f5bec06dc80 2024-05-06T06:55:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bcc003530 con 0x7f5bec06dc80 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1412544735 0 0) 0x7f5bec12add0 con 0x7f5bec137cc0 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bec138f70 con 0x7f5bec137cc0 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3063682063 0 0) 0x7f5bcc003530 con 0x7f5bec06dc80 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5bec12add0 con 0x7f5bec06dc80 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5be4001a40 con 0x7f5bec06dc80 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1211183346 0 0) 0x7f5bec138f70 con 0x7f5bec137cc0 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5bcc003530 con 0x7f5bec137cc0 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5bdc004b70 con 0x7f5bec137cc0 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1590713426 0 0) 0x7f5bec12add0 con 0x7f5bec06dc80 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 >> v1:172.21.15.70:6790/0 conn(0x7f5bec137cc0 legacy=0x7f5bec1e10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 >> v1:172.21.15.184:6789/0 conn(0x7f5bec072910 legacy=0x7f5bec1da4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bec14de20 con 0x7f5bec06dc80 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 -- 172.21.15.70:0/3868800461 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5bec12a940 con 0x7f5bec06dc80 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 -- 172.21.15.70:0/3868800461 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5bec136cd0 con 0x7f5bec06dc80 2024-05-06T06:55:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5be4001d40 con 0x7f5bec06dc80 2024-05-06T06:55:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f5be4003a70 con 0x7f5bec06dc80 2024-05-06T06:55:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5bf1979640 1 -- 172.21.15.70:0/3868800461 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bd0005090 con 0x7f5bec06dc80 2024-05-06T06:55:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.411+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f5be4003c90 con 0x7f5bec06dc80 2024-05-06T06:55:36.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.415+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7f5be408aac0 con 0x7f5bec06dc80 2024-05-06T06:55:36.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.419+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f5be4057c50 con 0x7f5bec06dc80 2024-05-06T06:55:36.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.579+0000 7f5bf1979640 1 -- 172.21.15.70:0/3868800461 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f5bd0000ba0 con 0x7f5bcc070040 2024-05-06T06:55:36.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.579+0000 7f5be3fff640 1 -- 172.21.15.70:0/3868800461 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7f5bd0000ba0 con 0x7f5bcc070040 2024-05-06T06:55:36.583 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 5 to deep-scrub 2024-05-06T06:55:36.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.579+0000 7f5bf1979640 1 -- 172.21.15.70:0/3868800461 >> v1:172.21.15.70:6816/2757942729 conn(0x7f5bcc070040 legacy=0x7f5bcc072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.579+0000 7f5bf1979640 1 -- 172.21.15.70:0/3868800461 >> v1:172.21.15.70:6789/0 conn(0x7f5bec06dc80 legacy=0x7f5bec1d9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.583+0000 7f5bf1979640 1 -- 172.21.15.70:0/3868800461 shutdown_connections 2024-05-06T06:55:36.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.583+0000 7f5bf1979640 1 -- 172.21.15.70:0/3868800461 >> 172.21.15.70:0/3868800461 conn(0x7f5bec0b67a0 msgr2=0x7f5bec0b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:36.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.583+0000 7f5bf1979640 1 -- 172.21.15.70:0/3868800461 shutdown_connections 2024-05-06T06:55:36.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.583+0000 7f5bf1979640 1 -- 172.21.15.70:0/3868800461 wait complete. 2024-05-06T06:55:36.602 INFO:tasks.ceph:Scrubbing osd.6 2024-05-06T06:55:36.603 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-06T06:55:36.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.735+0000 7f6d97ee4640 1 Processor -- start 2024-05-06T06:55:36.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.735+0000 7f6d97ee4640 1 -- start start 2024-05-06T06:55:36.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d97ee4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d900b24d0 con 0x7f6d9013fca0 2024-05-06T06:55:36.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d97ee4640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d90073c00 con 0x7f6d900745e0 2024-05-06T06:55:36.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d97ee4640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d900b2b60 con 0x7f6d900b20f0 2024-05-06T06:55:36.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d96481640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f6d9013fca0 0x7f6d9014c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53286/0 (socket says 172.21.15.70:53286) 2024-05-06T06:55:36.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d96481640 1 -- 172.21.15.70:0/793703456 learned_addr learned my addr 172.21.15.70:0/793703456 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:36.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d95c80640 1 --1- 172.21.15.70:0/793703456 >> v1:172.21.15.70:6790/0 conn(0x7f6d900b20f0 0x7f6d90143cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:58924/0 (socket says 172.21.15.70:58924) 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132592299 0 0) 0x7f6d900b2b60 con 0x7f6d900b20f0 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d7c003530 con 0x7f6d900b20f0 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578042353 0 0) 0x7f6d880014a0 con 0x7f6d9013fca0 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d900b2b60 con 0x7f6d9013fca0 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2444981948 0 0) 0x7f6d7c003530 con 0x7f6d900b20f0 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 >> v1:172.21.15.184:6789/0 conn(0x7f6d900745e0 legacy=0x7f6d900720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 >> v1:172.21.15.70:6789/0 conn(0x7f6d9013fca0 legacy=0x7f6d9014c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d90072a40 con 0x7f6d900b20f0 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6d8c0016a0 con 0x7f6d900b20f0 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d95c80640 1 -- 172.21.15.70:0/793703456 >> v1:172.21.15.70:6790/0 conn(0x7f6d900b20f0 legacy=0x7f6d90143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d95c80640 1 -- 172.21.15.70:0/793703456 >> v1:172.21.15.70:6790/0 conn(0x7f6d900b20f0 legacy=0x7f6d90143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d95c80640 1 --1- 172.21.15.70:0/793703456 >> v1:172.21.15.70:6790/0 conn(0x7f6d900b20f0 0x7f6d90143cc0 :-1 s=OPENED pgs=316 cs=1 l=1).handle_message read tag failed 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d95c80640 1 --1- 172.21.15.70:0/793703456 >> v1:172.21.15.70:6790/0 conn(0x7f6d900b20f0 0x7f6d90143cc0 :-1 s=OPENED pgs=316 cs=1 l=1).fault on lossy channel, failing 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 >> v1:172.21.15.70:6790/0 conn(0x7f6d900b20f0 legacy=0x7f6d90143cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-06T06:55:36.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6d7c003530 con 0x7f6d9013fca0 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6d90073c00 con 0x7f6d900745e0 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6d880014a0 con 0x7f6d7c00b0e0 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289290501 0 0) 0x7f6d7c003530 con 0x7f6d9013fca0 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 --> v1:172.21.15.70:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f6d7c010e40 con 0x7f6d9013fca0 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1464074030 0 0) 0x7f6d880014a0 con 0x7f6d7c00b0e0 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 --> v1:172.21.15.70:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f6d7c003530 con 0x7f6d7c00b0e0 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1775315336 0 0) 0x7f6d90073c00 con 0x7f6d900745e0 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 --> v1:172.21.15.184:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f6d880014a0 con 0x7f6d900745e0 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 1796988323 0 0) 0x7f6d7c010e40 con 0x7f6d9013fca0 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 >> v1:172.21.15.70:6790/0 conn(0x7f6d7c00b0e0 legacy=0x7f6d7c00d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 >> v1:172.21.15.184:6789/0 conn(0x7f6d900745e0 legacy=0x7f6d7c0099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=2+}) -- 0x7f6d7c011fd0 con 0x7f6d9013fca0 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6d8c0047f0 con 0x7f6d9013fca0 2024-05-06T06:55:36.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d94c7e640 1 -- 172.21.15.70:0/793703456 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6d8c004990 con 0x7f6d9013fca0 2024-05-06T06:55:36.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d97ee4640 1 -- 172.21.15.70:0/793703456 >> v1:172.21.15.70:6789/0 conn(0x7f6d9013fca0 legacy=0x7f6d7c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d97ee4640 1 -- 172.21.15.70:0/793703456 shutdown_connections 2024-05-06T06:55:36.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d97ee4640 1 -- 172.21.15.70:0/793703456 >> 172.21.15.70:0/793703456 conn(0x7f6d900b2f80 msgr2=0x7f6d900b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:36.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d97ee4640 1 -- 172.21.15.70:0/793703456 shutdown_connections 2024-05-06T06:55:36.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.739+0000 7f6d97ee4640 1 -- 172.21.15.70:0/793703456 wait complete. 2024-05-06T06:55:36.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d97ee4640 1 Processor -- start 2024-05-06T06:55:36.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d97ee4640 1 -- start start 2024-05-06T06:55:36.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d97ee4640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d90139ec0 con 0x7f6d900745e0 2024-05-06T06:55:36.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d97ee4640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d901d40a0 con 0x7f6d7c00b0e0 2024-05-06T06:55:36.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d97ee4640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d901d5040 con 0x7f6d9013fca0 2024-05-06T06:55:36.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d96481640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f6d9013fca0 0x7f6d901deb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:58940/0 (socket says 172.21.15.70:58940) 2024-05-06T06:55:36.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d96481640 1 -- 172.21.15.70:0/3812475382 learned_addr learned my addr 172.21.15.70:0/3812475382 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:36.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3500827970 0 0) 0x7f6d90139ec0 con 0x7f6d900745e0 2024-05-06T06:55:36.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d74003530 con 0x7f6d900745e0 2024-05-06T06:55:36.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1980498196 0 0) 0x7f6d901d5040 con 0x7f6d9013fca0 2024-05-06T06:55:36.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d90139ec0 con 0x7f6d9013fca0 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2065381866 0 0) 0x7f6d901d40a0 con 0x7f6d7c00b0e0 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d901d5040 con 0x7f6d7c00b0e0 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2805013089 0 0) 0x7f6d90139ec0 con 0x7f6d9013fca0 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6d901d40a0 con 0x7f6d9013fca0 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6d88001e10 con 0x7f6d9013fca0 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 869883310 0 0) 0x7f6d74003530 con 0x7f6d900745e0 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6d90139ec0 con 0x7f6d900745e0 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6d800018c0 con 0x7f6d900745e0 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4071119925 0 0) 0x7f6d901d40a0 con 0x7f6d9013fca0 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 >> v1:172.21.15.184:6789/0 conn(0x7f6d7c00b0e0 legacy=0x7f6d901d4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 >> v1:172.21.15.70:6789/0 conn(0x7f6d900745e0 legacy=0x7f6d90137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d90138340 con 0x7f6d9013fca0 2024-05-06T06:55:36.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d97ee4640 1 -- 172.21.15.70:0/3812475382 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6d90138630 con 0x7f6d9013fca0 2024-05-06T06:55:36.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d97ee4640 1 -- 172.21.15.70:0/3812475382 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6d901422e0 con 0x7f6d9013fca0 2024-05-06T06:55:36.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6d88002070 con 0x7f6d9013fca0 2024-05-06T06:55:36.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6d88004fc0 con 0x7f6d9013fca0 2024-05-06T06:55:36.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.743+0000 7f6d97ee4640 1 -- 172.21.15.70:0/3812475382 --> v1:172.21.15.70:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6d78000f90 con 0x7f6d9013fca0 2024-05-06T06:55:36.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.747+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f6d8801bd60 con 0x7f6d9013fca0 2024-05-06T06:55:36.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.747+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7f6d8808ad30 con 0x7f6d9013fca0 2024-05-06T06:55:36.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.747+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 --> v1:172.21.15.184:6804/3136453628 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d7407bdf0 con 0x7f6d74078180 2024-05-06T06:55:36.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.747+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (unknown 758375209 0 0) 0x7f6d8808b1a0 con 0x7f6d9013fca0 2024-05-06T06:55:36.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.751+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== osd.6 v1:172.21.15.184:6804/3136453628 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f6d7407bdf0 con 0x7f6d74078180 2024-05-06T06:55:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.767+0000 7f6d97ee4640 1 -- 172.21.15.70:0/3812475382 --> v1:172.21.15.184:6804/3136453628 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6d78002ce0 con 0x7f6d74078180 2024-05-06T06:55:36.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.767+0000 7f6d867fc640 1 -- 172.21.15.70:0/3812475382 <== osd.6 v1:172.21.15.184:6804/3136453628 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f6d78002ce0 con 0x7f6d74078180 2024-05-06T06:55:36.771 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-06T06:55:36.771 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-06T06:55:36.771 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-06T06:55:36.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.767+0000 7f6d97ee4640 1 -- 172.21.15.70:0/3812475382 >> v1:172.21.15.184:6804/3136453628 conn(0x7f6d74078180 legacy=0x7f6d7407a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.767+0000 7f6d97ee4640 1 -- 172.21.15.70:0/3812475382 >> v1:172.21.15.70:6816/2757942729 conn(0x7f6d74070030 legacy=0x7f6d740724f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.767+0000 7f6d97ee4640 1 -- 172.21.15.70:0/3812475382 >> v1:172.21.15.70:6790/0 conn(0x7f6d9013fca0 legacy=0x7f6d901deb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.767+0000 7f6d96481640 1 -- 172.21.15.70:0/3812475382 reap_dead start 2024-05-06T06:55:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.767+0000 7f6d97ee4640 1 -- 172.21.15.70:0/3812475382 shutdown_connections 2024-05-06T06:55:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.767+0000 7f6d97ee4640 1 -- 172.21.15.70:0/3812475382 >> 172.21.15.70:0/3812475382 conn(0x7f6d900b2f80 msgr2=0x7f6d9013c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.767+0000 7f6d97ee4640 1 -- 172.21.15.70:0/3812475382 shutdown_connections 2024-05-06T06:55:36.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.767+0000 7f6d97ee4640 1 -- 172.21.15.70:0/3812475382 wait complete. 2024-05-06T06:55:36.790 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-06T06:55:36.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2e859640 1 Processor -- start 2024-05-06T06:55:36.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2e859640 1 -- start start 2024-05-06T06:55:36.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2e859640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb28145410 con 0x7fdb28071e50 2024-05-06T06:55:36.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2e859640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb28145d10 con 0x7fdb281458d0 2024-05-06T06:55:36.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2e859640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb28073530 con 0x7fdb28145030 2024-05-06T06:55:36.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb27fff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fdb28145030 0x7fdb28140de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:58950/0 (socket says 172.21.15.70:58950) 2024-05-06T06:55:36.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb27fff640 1 -- 172.21.15.70:0/4223562254 learned_addr learned my addr 172.21.15.70:0/4223562254 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:36.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb277fe640 1 -- 172.21.15.70:0/4223562254 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419415192 0 0) 0x7fdb28073530 con 0x7fdb28145030 2024-05-06T06:55:36.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb277fe640 1 -- 172.21.15.70:0/4223562254 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb14003530 con 0x7fdb28145030 2024-05-06T06:55:36.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb277fe640 1 -- 172.21.15.70:0/4223562254 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3313425997 0 0) 0x7fdb10001120 con 0x7fdb28071e50 2024-05-06T06:55:36.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb277fe640 1 -- 172.21.15.70:0/4223562254 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb28073530 con 0x7fdb28071e50 2024-05-06T06:55:36.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2cdf6640 1 -- 172.21.15.70:0/4223562254 >> v1:172.21.15.184:6789/0 conn(0x7fdb281458d0 legacy=0x7fdb2814d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-06T06:55:36.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2cdf6640 1 -- 172.21.15.70:0/4223562254 >> v1:172.21.15.184:6789/0 conn(0x7fdb281458d0 legacy=0x7fdb2814d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-06T06:55:36.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2cdf6640 1 --1- 172.21.15.70:0/4223562254 >> v1:172.21.15.184:6789/0 conn(0x7fdb281458d0 0x7fdb2814d170 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2024-05-06T06:55:36.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb277fe640 1 -- 172.21.15.70:0/4223562254 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2237444840 0 0) 0x7fdb28073530 con 0x7fdb28071e50 2024-05-06T06:55:36.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb277fe640 1 -- 172.21.15.70:0/4223562254 >> v1:172.21.15.70:6790/0 conn(0x7fdb28145030 legacy=0x7fdb28140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb277fe640 1 -- 172.21.15.70:0/4223562254 >> v1:172.21.15.184:6789/0 conn(0x7fdb281458d0 legacy=0x7fdb2814d170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-06T06:55:36.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb277fe640 1 -- 172.21.15.70:0/4223562254 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb280743e0 con 0x7fdb28071e50 2024-05-06T06:55:36.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb277fe640 1 -- 172.21.15.70:0/4223562254 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdb10001850 con 0x7fdb28071e50 2024-05-06T06:55:36.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb277fe640 1 -- 172.21.15.70:0/4223562254 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb10001a70 con 0x7fdb28071e50 2024-05-06T06:55:36.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb277fe640 1 -- 172.21.15.70:0/4223562254 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdb10003620 con 0x7fdb28071e50 2024-05-06T06:55:36.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2e859640 1 -- 172.21.15.70:0/4223562254 >> v1:172.21.15.70:6789/0 conn(0x7fdb28071e50 legacy=0x7fdb280b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2e859640 1 -- 172.21.15.70:0/4223562254 shutdown_connections 2024-05-06T06:55:36.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2e859640 1 -- 172.21.15.70:0/4223562254 >> 172.21.15.70:0/4223562254 conn(0x7fdb280b7820 msgr2=0x7fdb280b7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:36.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2e859640 1 -- 172.21.15.70:0/4223562254 shutdown_connections 2024-05-06T06:55:36.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.919+0000 7fdb2e859640 1 -- 172.21.15.70:0/4223562254 wait complete. 2024-05-06T06:55:36.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb2e859640 1 Processor -- start 2024-05-06T06:55:36.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb2e859640 1 -- start start 2024-05-06T06:55:36.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb2e859640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb280ac000 con 0x7fdb281458d0 2024-05-06T06:55:36.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb2e859640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb281d7e50 con 0x7fdb28145030 2024-05-06T06:55:36.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb2e859640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb280b16a0 con 0x7fdb28071e50 2024-05-06T06:55:36.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb27fff640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fdb28071e50 0x7fdb280b0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:58966/0 (socket says 172.21.15.70:58966) 2024-05-06T06:55:36.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb27fff640 1 -- 172.21.15.70:0/929414221 learned_addr learned my addr 172.21.15.70:0/929414221 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:36.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb2cdf6640 1 --1- 172.21.15.70:0/929414221 >> v1:172.21.15.70:6789/0 conn(0x7fdb281458d0 0x7fdb281da8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53316/0 (socket says 172.21.15.70:53316) 2024-05-06T06:55:36.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892712131 0 0) 0x7fdb280ac000 con 0x7fdb281458d0 2024-05-06T06:55:36.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb08003530 con 0x7fdb281458d0 2024-05-06T06:55:36.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555221500 0 0) 0x7fdb280b16a0 con 0x7fdb28071e50 2024-05-06T06:55:36.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb280ac000 con 0x7fdb28071e50 2024-05-06T06:55:36.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1292878291 0 0) 0x7fdb08003530 con 0x7fdb281458d0 2024-05-06T06:55:36.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb280b16a0 con 0x7fdb281458d0 2024-05-06T06:55:36.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdb20004290 con 0x7fdb281458d0 2024-05-06T06:55:36.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379050012 0 0) 0x7fdb281d7e50 con 0x7fdb28145030 2024-05-06T06:55:36.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb08003530 con 0x7fdb28145030 2024-05-06T06:55:36.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 426316124 0 0) 0x7fdb280ac000 con 0x7fdb28071e50 2024-05-06T06:55:36.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb281d7e50 con 0x7fdb28071e50 2024-05-06T06:55:36.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdb18001960 con 0x7fdb28071e50 2024-05-06T06:55:36.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2134188118 0 0) 0x7fdb280b16a0 con 0x7fdb281458d0 2024-05-06T06:55:36.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 >> v1:172.21.15.70:6790/0 conn(0x7fdb28071e50 legacy=0x7fdb280b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 >> v1:172.21.15.184:6789/0 conn(0x7fdb28145030 legacy=0x7fdb281da1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:36.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb280ab9f0 con 0x7fdb281458d0 2024-05-06T06:55:36.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb2e859640 1 -- 172.21.15.70:0/929414221 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdb28139a60 con 0x7fdb281458d0 2024-05-06T06:55:36.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb2e859640 1 -- 172.21.15.70:0/929414221 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdb280ab670 con 0x7fdb281458d0 2024-05-06T06:55:36.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb20001260 con 0x7fdb281458d0 2024-05-06T06:55:36.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.923+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdb200016f0 con 0x7fdb281458d0 2024-05-06T06:55:36.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.927+0000 7fdb2e859640 1 -- 172.21.15.70:0/929414221 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0c005090 con 0x7fdb281458d0 2024-05-06T06:55:36.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.927+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fdb20001910 con 0x7fdb281458d0 2024-05-06T06:55:36.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.927+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7fdb2008a9c0 con 0x7fdb281458d0 2024-05-06T06:55:36.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:36.931+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fdb20057c90 con 0x7fdb281458d0 2024-05-06T06:55:37.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.119+0000 7fdb2e859640 1 -- 172.21.15.70:0/929414221 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fdb0c000ba0 con 0x7fdb080700b0 2024-05-06T06:55:37.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.119+0000 7fdb257fa640 1 -- 172.21.15.70:0/929414221 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (unknown 778718403 0 0) 0x7fdb0c000ba0 con 0x7fdb080700b0 2024-05-06T06:55:37.122 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 6 to deep-scrub 2024-05-06T06:55:37.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.119+0000 7fdb2e859640 1 -- 172.21.15.70:0/929414221 >> v1:172.21.15.70:6816/2757942729 conn(0x7fdb080700b0 legacy=0x7fdb08072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.119+0000 7fdb2e859640 1 -- 172.21.15.70:0/929414221 >> v1:172.21.15.70:6789/0 conn(0x7fdb281458d0 legacy=0x7fdb281da8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.119+0000 7fdb2e859640 1 -- 172.21.15.70:0/929414221 shutdown_connections 2024-05-06T06:55:37.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.119+0000 7fdb2e859640 1 -- 172.21.15.70:0/929414221 >> 172.21.15.70:0/929414221 conn(0x7fdb280b7820 msgr2=0x7fdb28075e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:37.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.119+0000 7fdb2e859640 1 -- 172.21.15.70:0/929414221 shutdown_connections 2024-05-06T06:55:37.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.119+0000 7fdb2e859640 1 -- 172.21.15.70:0/929414221 wait complete. 2024-05-06T06:55:37.140 INFO:tasks.ceph:Scrubbing osd.7 2024-05-06T06:55:37.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-06T06:55:37.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb5651c8640 1 Processor -- start 2024-05-06T06:55:37.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb5651c8640 1 -- start start 2024-05-06T06:55:37.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb5651c8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5600b24d0 con 0x7fb5600b20f0 2024-05-06T06:55:37.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb5651c8640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb560073c00 con 0x7fb56013fca0 2024-05-06T06:55:37.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb5651c8640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5600b2b60 con 0x7fb5600745e0 2024-05-06T06:55:37.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55ed9d640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fb5600b20f0 0x7fb560143cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53330/0 (socket says 172.21.15.70:53330) 2024-05-06T06:55:37.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb557fff640 1 --1- 172.21.15.70:0/4207799738 >> v1:172.21.15.70:6790/0 conn(0x7fb5600745e0 0x7fb5600720c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:58982/0 (socket says 172.21.15.70:58982) 2024-05-06T06:55:37.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55ed9d640 1 -- 172.21.15.70:0/4207799738 learned_addr learned my addr 172.21.15.70:0/4207799738 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:37.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55e59c640 1 -- 172.21.15.70:0/4207799738 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4062500648 0 0) 0x7fb5600b2b60 con 0x7fb5600745e0 2024-05-06T06:55:37.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55e59c640 1 -- 172.21.15.70:0/4207799738 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb54c003530 con 0x7fb5600745e0 2024-05-06T06:55:37.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55e59c640 1 -- 172.21.15.70:0/4207799738 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244345141 0 0) 0x7fb550001120 con 0x7fb5600b20f0 2024-05-06T06:55:37.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55e59c640 1 -- 172.21.15.70:0/4207799738 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5600b2b60 con 0x7fb5600b20f0 2024-05-06T06:55:37.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55e59c640 1 -- 172.21.15.70:0/4207799738 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1585228163 0 0) 0x7fb5600b2b60 con 0x7fb5600b20f0 2024-05-06T06:55:37.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55e59c640 1 -- 172.21.15.70:0/4207799738 >> v1:172.21.15.70:6790/0 conn(0x7fb5600745e0 legacy=0x7fb5600720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55e59c640 1 -- 172.21.15.70:0/4207799738 >> v1:172.21.15.184:6789/0 conn(0x7fb56013fca0 legacy=0x7fb56014c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55e59c640 1 -- 172.21.15.70:0/4207799738 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb560072a40 con 0x7fb5600b20f0 2024-05-06T06:55:37.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55e59c640 1 -- 172.21.15.70:0/4207799738 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb550001850 con 0x7fb5600b20f0 2024-05-06T06:55:37.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55e59c640 1 -- 172.21.15.70:0/4207799738 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb550001a70 con 0x7fb5600b20f0 2024-05-06T06:55:37.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb55e59c640 1 -- 172.21.15.70:0/4207799738 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb550004a50 con 0x7fb5600b20f0 2024-05-06T06:55:37.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.259+0000 7fb5651c8640 1 -- 172.21.15.70:0/4207799738 >> v1:172.21.15.70:6789/0 conn(0x7fb5600b20f0 legacy=0x7fb560143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5651c8640 1 -- 172.21.15.70:0/4207799738 shutdown_connections 2024-05-06T06:55:37.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5651c8640 1 -- 172.21.15.70:0/4207799738 >> 172.21.15.70:0/4207799738 conn(0x7fb5600b2f80 msgr2=0x7fb5600b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:37.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5651c8640 1 -- 172.21.15.70:0/4207799738 shutdown_connections 2024-05-06T06:55:37.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5651c8640 1 -- 172.21.15.70:0/4207799738 wait complete. 2024-05-06T06:55:37.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5651c8640 1 Processor -- start 2024-05-06T06:55:37.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5651c8640 1 -- start start 2024-05-06T06:55:37.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5651c8640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5601381a0 con 0x7fb560139ca0 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5651c8640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56013a770 con 0x7fb56013fca0 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5651c8640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56013a250 con 0x7fb5600745e0 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb55ed9d640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fb5600745e0 0x7fb5601d7cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:58998/0 (socket says 172.21.15.70:58998) 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb55ed9d640 1 -- 172.21.15.70:0/3691146063 learned_addr learned my addr 172.21.15.70:0/3691146063 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2095017128 0 0) 0x7fb5601381a0 con 0x7fb560139ca0 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb540003530 con 0x7fb560139ca0 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386920514 0 0) 0x7fb56013a250 con 0x7fb5600745e0 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5601381a0 con 0x7fb5600745e0 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4034038497 0 0) 0x7fb540003530 con 0x7fb560139ca0 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb56013a250 con 0x7fb560139ca0 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb558001b30 con 0x7fb560139ca0 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3747861359 0 0) 0x7fb5601381a0 con 0x7fb5600745e0 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb540003530 con 0x7fb5600745e0 2024-05-06T06:55:37.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb550001810 con 0x7fb5600745e0 2024-05-06T06:55:37.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 176382028 0 0) 0x7fb56013a770 con 0x7fb56013fca0 2024-05-06T06:55:37.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5601381a0 con 0x7fb56013fca0 2024-05-06T06:55:37.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2150529428 0 0) 0x7fb56013a250 con 0x7fb560139ca0 2024-05-06T06:55:37.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 >> v1:172.21.15.70:6790/0 conn(0x7fb5600745e0 legacy=0x7fb5601d7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 >> v1:172.21.15.184:6789/0 conn(0x7fb56013fca0 legacy=0x7fb560137380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5601d57e0 con 0x7fb560139ca0 2024-05-06T06:55:37.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5651c8640 1 -- 172.21.15.70:0/3691146063 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb560143bd0 con 0x7fb560139ca0 2024-05-06T06:55:37.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5651c8640 1 -- 172.21.15.70:0/3691146063 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb5601432e0 con 0x7fb560139ca0 2024-05-06T06:55:37.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb558002080 con 0x7fb560139ca0 2024-05-06T06:55:37.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fb558003b20 con 0x7fb560139ca0 2024-05-06T06:55:37.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.263+0000 7fb5651c8640 1 -- 172.21.15.70:0/3691146063 --> v1:172.21.15.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fb544000f90 con 0x7fb560139ca0 2024-05-06T06:55:37.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.267+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fb55801a940 con 0x7fb560139ca0 2024-05-06T06:55:37.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.267+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7fb5580899c0 con 0x7fb560139ca0 2024-05-06T06:55:37.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.267+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 --> v1:172.21.15.184:6812/1421504082 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb54007bec0 con 0x7fb540078250 2024-05-06T06:55:37.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.267+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (unknown 758375209 0 0) 0x7fb558089dd0 con 0x7fb560139ca0 2024-05-06T06:55:37.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.267+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== osd.7 v1:172.21.15.184:6812/1421504082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fb54007bec0 con 0x7fb540078250 2024-05-06T06:55:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.283+0000 7fb5651c8640 1 -- 172.21.15.70:0/3691146063 --> v1:172.21.15.184:6812/1421504082 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb544002ce0 con 0x7fb540078250 2024-05-06T06:55:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.283+0000 7fb5577fe640 1 -- 172.21.15.70:0/3691146063 <== osd.7 v1:172.21.15.184:6812/1421504082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fb544002ce0 con 0x7fb540078250 2024-05-06T06:55:37.288 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-06T06:55:37.288 INFO:teuthology.orchestra.run.smithi070.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-06T06:55:37.289 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-06T06:55:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.283+0000 7fb5651c8640 1 -- 172.21.15.70:0/3691146063 >> v1:172.21.15.184:6812/1421504082 conn(0x7fb540078250 legacy=0x7fb54007a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.283+0000 7fb5651c8640 1 -- 172.21.15.70:0/3691146063 >> v1:172.21.15.70:6816/2757942729 conn(0x7fb540070100 legacy=0x7fb5400725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.283+0000 7fb5651c8640 1 -- 172.21.15.70:0/3691146063 >> v1:172.21.15.70:6789/0 conn(0x7fb560139ca0 legacy=0x7fb560137a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.283+0000 7fb55f59e640 1 -- 172.21.15.70:0/3691146063 reap_dead start 2024-05-06T06:55:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.283+0000 7fb5651c8640 1 -- 172.21.15.70:0/3691146063 shutdown_connections 2024-05-06T06:55:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.283+0000 7fb5651c8640 1 -- 172.21.15.70:0/3691146063 >> 172.21.15.70:0/3691146063 conn(0x7fb5600b2f80 msgr2=0x7fb560075e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.287+0000 7fb5651c8640 1 -- 172.21.15.70:0/3691146063 shutdown_connections 2024-05-06T06:55:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.287+0000 7fb5651c8640 1 -- 172.21.15.70:0/3691146063 wait complete. 2024-05-06T06:55:37.304 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-06T06:55:37.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f15873c5640 1 Processor -- start 2024-05-06T06:55:37.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f15873c5640 1 -- start start 2024-05-06T06:55:37.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f15873c5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15800b2cc0 con 0x7f15800b28e0 2024-05-06T06:55:37.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f15873c5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15800736f0 con 0x7f1580140300 2024-05-06T06:55:37.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f15873c5640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15800aaf80 con 0x7f15800731a0 2024-05-06T06:55:37.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f1585161640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f15800b28e0 0x7f158013fbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53346/0 (socket says 172.21.15.70:53346) 2024-05-06T06:55:37.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f1585161640 1 -- 172.21.15.70:0/981043004 learned_addr learned my addr 172.21.15.70:0/981043004 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:37.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f1577fff640 1 -- 172.21.15.70:0/981043004 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 6641523 0 0) 0x7f1570001120 con 0x7f15800b28e0 2024-05-06T06:55:37.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f1577fff640 1 -- 172.21.15.70:0/981043004 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f156c003530 con 0x7f15800b28e0 2024-05-06T06:55:37.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f1577fff640 1 -- 172.21.15.70:0/981043004 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 747893560 0 0) 0x7f15800aaf80 con 0x7f15800731a0 2024-05-06T06:55:37.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f1577fff640 1 -- 172.21.15.70:0/981043004 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1570001120 con 0x7f15800731a0 2024-05-06T06:55:37.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f1577fff640 1 -- 172.21.15.70:0/981043004 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1539630280 0 0) 0x7f1570001120 con 0x7f15800731a0 2024-05-06T06:55:37.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f1577fff640 1 -- 172.21.15.70:0/981043004 >> v1:172.21.15.184:6789/0 conn(0x7f1580140300 legacy=0x7f1580140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f1577fff640 1 -- 172.21.15.70:0/981043004 >> v1:172.21.15.70:6789/0 conn(0x7f15800b28e0 legacy=0x7f158013fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.411+0000 7f1577fff640 1 -- 172.21.15.70:0/981043004 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15800ab260 con 0x7f15800731a0 2024-05-06T06:55:37.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1577fff640 1 -- 172.21.15.70:0/981043004 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f1578001a00 con 0x7f15800731a0 2024-05-06T06:55:37.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1577fff640 1 -- 172.21.15.70:0/981043004 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1578001c20 con 0x7f15800731a0 2024-05-06T06:55:37.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1577fff640 1 -- 172.21.15.70:0/981043004 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f1578002030 con 0x7f15800731a0 2024-05-06T06:55:37.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f15873c5640 1 -- 172.21.15.70:0/981043004 >> v1:172.21.15.70:6790/0 conn(0x7f15800731a0 legacy=0x7f158014c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f15873c5640 1 -- 172.21.15.70:0/981043004 shutdown_connections 2024-05-06T06:55:37.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f15873c5640 1 -- 172.21.15.70:0/981043004 >> 172.21.15.70:0/981043004 conn(0x7f15800b5c20 msgr2=0x7f15800b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:37.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f15873c5640 1 -- 172.21.15.70:0/981043004 shutdown_connections 2024-05-06T06:55:37.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f15873c5640 1 -- 172.21.15.70:0/981043004 wait complete. 2024-05-06T06:55:37.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f15873c5640 1 Processor -- start 2024-05-06T06:55:37.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f15873c5640 1 -- start start 2024-05-06T06:55:37.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f15873c5640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1580132030 con 0x7f15800731a0 2024-05-06T06:55:37.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f15873c5640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15801356c0 con 0x7f15800b28e0 2024-05-06T06:55:37.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f15873c5640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1580070040 con 0x7f1580140300 2024-05-06T06:55:37.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1585161640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f15800731a0 0x7f1580138f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53356/0 (socket says 172.21.15.70:53356) 2024-05-06T06:55:37.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1585161640 1 -- 172.21.15.70:0/2150718985 learned_addr learned my addr 172.21.15.70:0/2150718985 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:37.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909470938 0 0) 0x7f1570001bc0 con 0x7f15800731a0 2024-05-06T06:55:37.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1564003530 con 0x7f15800731a0 2024-05-06T06:55:37.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959385644 0 0) 0x7f1580070040 con 0x7f1580140300 2024-05-06T06:55:37.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1570001bc0 con 0x7f1580140300 2024-05-06T06:55:37.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3044694600 0 0) 0x7f1570001bc0 con 0x7f1580140300 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1580070040 con 0x7f1580140300 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f1578001f70 con 0x7f1580140300 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1994036010 0 0) 0x7f1564003530 con 0x7f15800731a0 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1570001bc0 con 0x7f15800731a0 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f1570001670 con 0x7f15800731a0 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3573091780 0 0) 0x7f1580070040 con 0x7f1580140300 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 >> v1:172.21.15.184:6789/0 conn(0x7f15800b28e0 legacy=0x7f1580134fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 >> v1:172.21.15.70:6789/0 conn(0x7f15800731a0 legacy=0x7f1580138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1580070320 con 0x7f1580140300 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f15873c5640 1 -- 172.21.15.70:0/2150718985 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1580132ee0 con 0x7f1580140300 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f15873c5640 1 -- 172.21.15.70:0/2150718985 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1580132400 con 0x7f1580140300 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1578001b80 con 0x7f1580140300 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.415+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f1578003dd0 con 0x7f1580140300 2024-05-06T06:55:37.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.419+0000 7f15873c5640 1 -- 172.21.15.70:0/2150718985 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1560005090 con 0x7f1580140300 2024-05-06T06:55:37.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.419+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f1578003f70 con 0x7f1580140300 2024-05-06T06:55:37.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.419+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7f1578089af0 con 0x7f1580140300 2024-05-06T06:55:37.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.423+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f1578056c80 con 0x7f1580140300 2024-05-06T06:55:37.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.639+0000 7f15873c5640 1 -- 172.21.15.70:0/2150718985 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f1560000ba0 con 0x7f156406ff70 2024-05-06T06:55:37.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.639+0000 7f1575ffb640 1 -- 172.21.15.70:0/2150718985 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (unknown 1239724482 0 0) 0x7f1560000ba0 con 0x7f156406ff70 2024-05-06T06:55:37.645 INFO:teuthology.orchestra.run.smithi070.stderr:instructed osd(s) 7 to deep-scrub 2024-05-06T06:55:37.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.643+0000 7f15873c5640 1 -- 172.21.15.70:0/2150718985 >> v1:172.21.15.70:6816/2757942729 conn(0x7f156406ff70 legacy=0x7f1564072430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.643+0000 7f15873c5640 1 -- 172.21.15.70:0/2150718985 >> v1:172.21.15.70:6790/0 conn(0x7f1580140300 legacy=0x7f15801e37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.643+0000 7f15873c5640 1 -- 172.21.15.70:0/2150718985 shutdown_connections 2024-05-06T06:55:37.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.643+0000 7f15873c5640 1 -- 172.21.15.70:0/2150718985 >> 172.21.15.70:0/2150718985 conn(0x7f15800b5c20 msgr2=0x7f158013f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:37.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.643+0000 7f15873c5640 1 -- 172.21.15.70:0/2150718985 shutdown_connections 2024-05-06T06:55:37.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.643+0000 7f15873c5640 1 -- 172.21.15.70:0/2150718985 wait complete. 2024-05-06T06:55:37.665 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-06T06:55:37.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.767+0000 7f673980f640 1 Processor -- start 2024-05-06T06:55:37.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.767+0000 7f673980f640 1 -- start start 2024-05-06T06:55:37.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.767+0000 7f673980f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673406e060 con 0x7f673406dc80 2024-05-06T06:55:37.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.767+0000 7f673980f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6734073370 con 0x7f673413d3a0 2024-05-06T06:55:37.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.767+0000 7f673980f640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6734143a00 con 0x7f6734070580 2024-05-06T06:55:37.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.767+0000 7f6732ffd640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f673406dc80 0x7f6734072180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53358/0 (socket says 172.21.15.70:53358) 2024-05-06T06:55:37.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.767+0000 7f6732ffd640 1 -- 172.21.15.70:0/1549240503 learned_addr learned my addr 172.21.15.70:0/1549240503 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:37.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.767+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059251009 0 0) 0x7f6724001120 con 0x7f673406dc80 2024-05-06T06:55:37.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.767+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f671c003530 con 0x7f673406dc80 2024-05-06T06:55:37.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.767+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198196132 0 0) 0x7f6734143a00 con 0x7f6734070580 2024-05-06T06:55:37.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6724001120 con 0x7f6734070580 2024-05-06T06:55:37.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f67327fc640 1 -- 172.21.15.70:0/1549240503 >> v1:172.21.15.70:6790/0 conn(0x7f6734070580 legacy=0x7f6734143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-05-06T06:55:37.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f67327fc640 1 -- 172.21.15.70:0/1549240503 >> v1:172.21.15.70:6790/0 conn(0x7f6734070580 legacy=0x7f6734143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-06T06:55:37.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f67327fc640 1 --1- 172.21.15.70:0/1549240503 >> v1:172.21.15.70:6790/0 conn(0x7f6734070580 0x7f6734143f20 :-1 s=OPENED pgs=325 cs=1 l=1).handle_message read tag failed 2024-05-06T06:55:37.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f67327fc640 1 --1- 172.21.15.70:0/1549240503 >> v1:172.21.15.70:6790/0 conn(0x7f6734070580 0x7f6734143f20 :-1 s=OPENED pgs=325 cs=1 l=1).fault on lossy channel, failing 2024-05-06T06:55:37.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665106437 0 0) 0x7f6734073370 con 0x7f673413d3a0 2024-05-06T06:55:37.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6734143a00 con 0x7f673413d3a0 2024-05-06T06:55:37.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 398628867 0 0) 0x7f671c003530 con 0x7f673406dc80 2024-05-06T06:55:37.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 >> v1:172.21.15.70:6790/0 conn(0x7f6734070580 legacy=0x7f6734143f20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-06T06:55:37.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 >> v1:172.21.15.184:6789/0 conn(0x7f673413d3a0 legacy=0x7f673414f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6734144a00 con 0x7f673406dc80 2024-05-06T06:55:37.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6724001870 con 0x7f673406dc80 2024-05-06T06:55:37.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 <== mon.0 v1:172.21.15.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6724001a10 con 0x7f673406dc80 2024-05-06T06:55:37.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f6731ffb640 1 -- 172.21.15.70:0/1549240503 <== mon.0 v1:172.21.15.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f67240048b0 con 0x7f673406dc80 2024-05-06T06:55:37.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f673980f640 1 -- 172.21.15.70:0/1549240503 >> v1:172.21.15.70:6789/0 conn(0x7f673406dc80 legacy=0x7f6734072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f673980f640 1 -- 172.21.15.70:0/1549240503 shutdown_connections 2024-05-06T06:55:37.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f673980f640 1 -- 172.21.15.70:0/1549240503 >> 172.21.15.70:0/1549240503 conn(0x7f67340b67a0 msgr2=0x7f67340b6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:37.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f673980f640 1 -- 172.21.15.70:0/1549240503 shutdown_connections 2024-05-06T06:55:37.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f673980f640 1 -- 172.21.15.70:0/1549240503 wait complete. 2024-05-06T06:55:37.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f673980f640 1 Processor -- start 2024-05-06T06:55:37.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f673980f640 1 -- start start 2024-05-06T06:55:37.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f673980f640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67340b3cb0 con 0x7f673413d3a0 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f673980f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673411f810 con 0x7f6734070580 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f673980f640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f673411fae0 con 0x7f673406dc80 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f6732ffd640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7f673406dc80 0x7f673411f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:59034/0 (socket says 172.21.15.70:59034) 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f6732ffd640 1 -- 172.21.15.70:0/1966450137 learned_addr learned my addr 172.21.15.70:0/1966450137 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f67337fe640 1 --1- 172.21.15.70:0/1966450137 >> v1:172.21.15.70:6789/0 conn(0x7f673413d3a0 0x7f673413b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:53370/0 (socket says 172.21.15.70:53370) 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3856319027 0 0) 0x7f67340b3cb0 con 0x7f673413d3a0 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6720003530 con 0x7f673413d3a0 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983882630 0 0) 0x7f673411fae0 con 0x7f673406dc80 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67340b3cb0 con 0x7f673406dc80 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3853717162 0 0) 0x7f6720003530 con 0x7f673413d3a0 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f673411fae0 con 0x7f673413d3a0 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1219400368 0 0) 0x7f67340b3cb0 con 0x7f673406dc80 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6720003530 con 0x7f673406dc80 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f672c001be0 con 0x7f673413d3a0 2024-05-06T06:55:37.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.771+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f6724001bc0 con 0x7f673406dc80 2024-05-06T06:55:37.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.775+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3734646729 0 0) 0x7f673411fae0 con 0x7f673413d3a0 2024-05-06T06:55:37.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.775+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 >> v1:172.21.15.70:6790/0 conn(0x7f673406dc80 legacy=0x7f673411f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.775+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 >> v1:172.21.15.184:6789/0 conn(0x7f6734070580 legacy=0x7f67341d9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.775+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673411fcb0 con 0x7f673413d3a0 2024-05-06T06:55:37.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.775+0000 7f673980f640 1 -- 172.21.15.70:0/1966450137 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f67341d9a70 con 0x7f673413d3a0 2024-05-06T06:55:37.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.775+0000 7f673980f640 1 -- 172.21.15.70:0/1966450137 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f673413bbd0 con 0x7f673413d3a0 2024-05-06T06:55:37.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.775+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f672c003980 con 0x7f673413d3a0 2024-05-06T06:55:37.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.775+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f672c003d90 con 0x7f673413d3a0 2024-05-06T06:55:37.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.775+0000 7f673980f640 1 -- 172.21.15.70:0/1966450137 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6714005090 con 0x7f673413d3a0 2024-05-06T06:55:37.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.775+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f672c003f30 con 0x7f673413d3a0 2024-05-06T06:55:37.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.775+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7f672c08ab40 con 0x7f673413d3a0 2024-05-06T06:55:37.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.779+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f672c057cd0 con 0x7f673413d3a0 2024-05-06T06:55:37.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.951+0000 7f673980f640 1 -- 172.21.15.70:0/1966450137 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6714000ba0 con 0x7f67200701f0 2024-05-06T06:55:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.955+0000 7f671bfff640 1 -- 172.21.15.70:0/1966450137 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117682 (unknown 2965378022 0 3462913681) 0x7f6714000ba0 con 0x7f67200701f0 2024-05-06T06:55:37.962 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:55:37.962 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-06T06:55:37.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.959+0000 7f673980f640 1 -- 172.21.15.70:0/1966450137 >> v1:172.21.15.70:6816/2757942729 conn(0x7f67200701f0 legacy=0x7f67200726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.959+0000 7f673980f640 1 -- 172.21.15.70:0/1966450137 >> v1:172.21.15.70:6789/0 conn(0x7f673413d3a0 legacy=0x7f673413b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:37.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.959+0000 7f673980f640 1 -- 172.21.15.70:0/1966450137 shutdown_connections 2024-05-06T06:55:37.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.959+0000 7f673980f640 1 -- 172.21.15.70:0/1966450137 >> 172.21.15.70:0/1966450137 conn(0x7f67340b67a0 msgr2=0x7f6734075e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:37.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.959+0000 7f673980f640 1 -- 172.21.15.70:0/1966450137 shutdown_connections 2024-05-06T06:55:37.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:37.959+0000 7f673980f640 1 -- 172.21.15.70:0/1966450137 wait complete. 2024-05-06T06:55:37.986 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-05-06T06:55:36.661325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3568743192,"num_objects":879,"num_object_clones":0,"num_object_copies":1758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":879,"num_whiteouts":0,"num_read":2626,"num_read_kb":2631,"num_write":157390,"num_write_kb":5628449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":803710944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158574,"ondisk_log_size":158574,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8584304,"kb_used_data":6682064,"kb_used_omap":12,"kb_used_meta":1902131,"kb_avail":746390416,"statfs":{"total":773094113280,"available":764303785984,"internally_reserved":0,"allocated":6842433536,"data_stored":6836444360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1947782706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8720,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":66,"num_read_kb":71,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002602"},"pg_stats":[{"pgid":"3.1f","version":"31'2969","reported_seq":3008,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.876900+0000","last_change":"2024-05-06T06:51:26.754879+0000","last_active":"2024-05-06T06:55:30.876900+0000","last_peered":"2024-05-06T06:55:30.876900+0000","last_clean":"2024-05-06T06:55:30.876900+0000","last_became_active":"2024-05-06T06:51:26.752788+0000","last_became_peered":"2024-05-06T06:51:26.752788+0000","last_unstale":"2024-05-06T06:55:30.876900+0000","last_undegraded":"2024-05-06T06:55:30.876900+0000","last_fullsized":"2024-05-06T06:55:30.876900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":2969,"log_dups_size":0,"ondisk_log_size":2969,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:35:28.118229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":2975,"num_write_kb":148098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'6530","reported_seq":6600,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.940939+0000","last_change":"2024-05-06T06:51:26.753516+0000","last_active":"2024-05-06T06:55:30.940939+0000","last_peered":"2024-05-06T06:55:30.940939+0000","last_clean":"2024-05-06T06:55:30.940939+0000","last_became_active":"2024-05-06T06:51:26.752122+0000","last_became_peered":"2024-05-06T06:51:26.752122+0000","last_unstale":"2024-05-06T06:55:30.940939+0000","last_undegraded":"2024-05-06T06:55:30.940939+0000","last_fullsized":"2024-05-06T06:55:30.940939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":6530,"log_dups_size":0,"ondisk_log_size":6530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:03:49.598052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113386000,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":120,"num_read_kb":227,"num_write":6557,"num_write_kb":229051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"33'4539","reported_seq":4576,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.956068+0000","last_change":"2024-05-06T06:51:26.741411+0000","last_active":"2024-05-06T06:55:30.956068+0000","last_peered":"2024-05-06T06:55:30.956068+0000","last_clean":"2024-05-06T06:55:30.956068+0000","last_became_active":"2024-05-06T06:51:26.740563+0000","last_became_peered":"2024-05-06T06:51:26.740563+0000","last_unstale":"2024-05-06T06:55:30.956068+0000","last_undegraded":"2024-05-06T06:55:30.956068+0000","last_fullsized":"2024-05-06T06:55:30.956068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:16:06.472308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99223376,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4514,"num_write_kb":149245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2965","reported_seq":3045,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.950914+0000","last_change":"2024-05-06T06:52:18.729663+0000","last_active":"2024-05-06T06:55:30.950914+0000","last_peered":"2024-05-06T06:55:30.950914+0000","last_clean":"2024-05-06T06:55:30.950914+0000","last_became_active":"2024-05-06T06:52:18.728975+0000","last_became_peered":"2024-05-06T06:52:18.728975+0000","last_unstale":"2024-05-06T06:55:30.950914+0000","last_undegraded":"2024-05-06T06:55:30.950914+0000","last_fullsized":"2024-05-06T06:55:30.950914+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":2965,"log_dups_size":0,"ondisk_log_size":2965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:33:32.914971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2956,"num_write_kb":148097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71285744,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"33'3513","reported_seq":3551,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.954506+0000","last_change":"2024-05-06T06:51:26.742049+0000","last_active":"2024-05-06T06:55:30.954506+0000","last_peered":"2024-05-06T06:55:30.954506+0000","last_clean":"2024-05-06T06:55:30.954506+0000","last_became_active":"2024-05-06T06:51:26.739617+0000","last_became_peered":"2024-05-06T06:51:26.739617+0000","last_unstale":"2024-05-06T06:55:30.954506+0000","last_undegraded":"2024-05-06T06:55:30.954506+0000","last_fullsized":"2024-05-06T06:55:30.954506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3513,"log_dups_size":0,"ondisk_log_size":3513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:08:25.394244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109117960,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":3468,"num_write_kb":138775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"33'5826","reported_seq":5910,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.885887+0000","last_change":"2024-05-06T06:52:20.775208+0000","last_active":"2024-05-06T06:55:30.885887+0000","last_peered":"2024-05-06T06:55:30.885887+0000","last_clean":"2024-05-06T06:55:30.885887+0000","last_became_active":"2024-05-06T06:52:20.774523+0000","last_became_peered":"2024-05-06T06:52:20.774523+0000","last_unstale":"2024-05-06T06:55:30.885887+0000","last_undegraded":"2024-05-06T06:55:30.885887+0000","last_fullsized":"2024-05-06T06:55:30.885887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5826,"log_dups_size":0,"ondisk_log_size":5826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:10:28.659512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":74,"num_read_kb":59,"num_write":5831,"num_write_kb":173444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":76111888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"33'4108","reported_seq":4148,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.949926+0000","last_change":"2024-05-06T06:51:26.749392+0000","last_active":"2024-05-06T06:55:30.949926+0000","last_peered":"2024-05-06T06:55:30.949926+0000","last_clean":"2024-05-06T06:55:30.949926+0000","last_became_active":"2024-05-06T06:51:26.748230+0000","last_became_peered":"2024-05-06T06:51:26.748230+0000","last_unstale":"2024-05-06T06:55:30.949926+0000","last_undegraded":"2024-05-06T06:55:30.949926+0000","last_fullsized":"2024-05-06T06:55:30.949926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4108,"log_dups_size":0,"ondisk_log_size":4108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:25:50.342372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104989200,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":4066,"num_write_kb":140299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"32'7187","reported_seq":7224,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.938309+0000","last_change":"2024-05-06T06:51:26.751423+0000","last_active":"2024-05-06T06:55:30.938309+0000","last_peered":"2024-05-06T06:55:30.938309+0000","last_clean":"2024-05-06T06:55:30.938309+0000","last_became_active":"2024-05-06T06:51:26.750654+0000","last_became_peered":"2024-05-06T06:51:26.750654+0000","last_unstale":"2024-05-06T06:55:30.938309+0000","last_undegraded":"2024-05-06T06:55:30.938309+0000","last_fullsized":"2024-05-06T06:55:30.938309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":7187,"log_dups_size":0,"ondisk_log_size":7187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:19:30.523166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7185,"num_write_kb":217990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'7408","reported_seq":7457,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.877492+0000","last_change":"2024-05-06T06:51:26.753573+0000","last_active":"2024-05-06T06:55:30.877492+0000","last_peered":"2024-05-06T06:55:30.877492+0000","last_clean":"2024-05-06T06:55:30.877492+0000","last_became_active":"2024-05-06T06:51:26.748155+0000","last_became_peered":"2024-05-06T06:51:26.748155+0000","last_unstale":"2024-05-06T06:55:30.877492+0000","last_undegraded":"2024-05-06T06:55:30.877492+0000","last_fullsized":"2024-05-06T06:55:30.877492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":7408,"log_dups_size":0,"ondisk_log_size":7408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:05:08.144920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153731072,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":7429,"num_write_kb":226728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'3682","reported_seq":3711,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.943060+0000","last_change":"2024-05-06T06:52:18.738992+0000","last_active":"2024-05-06T06:55:30.943060+0000","last_peered":"2024-05-06T06:55:30.943060+0000","last_clean":"2024-05-06T06:55:30.943060+0000","last_became_active":"2024-05-06T06:52:18.736778+0000","last_became_peered":"2024-05-06T06:52:18.736778+0000","last_unstale":"2024-05-06T06:55:30.943060+0000","last_undegraded":"2024-05-06T06:55:30.943060+0000","last_fullsized":"2024-05-06T06:55:30.943060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3682,"log_dups_size":0,"ondisk_log_size":3682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:39:38.190258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":3674,"num_write_kb":159628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":73965900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"32'7465","reported_seq":7508,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.878712+0000","last_change":"2024-05-06T06:51:26.746880+0000","last_active":"2024-05-06T06:55:30.878712+0000","last_peered":"2024-05-06T06:55:30.878712+0000","last_clean":"2024-05-06T06:55:30.878712+0000","last_became_active":"2024-05-06T06:51:26.746151+0000","last_became_peered":"2024-05-06T06:51:26.746151+0000","last_unstale":"2024-05-06T06:55:30.878712+0000","last_undegraded":"2024-05-06T06:55:30.878712+0000","last_fullsized":"2024-05-06T06:55:30.878712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":7465,"log_dups_size":0,"ondisk_log_size":7465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:13:48.503450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":7477,"num_write_kb":218253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"33'6673","reported_seq":6732,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.960043+0000","last_change":"2024-05-06T06:51:26.746657+0000","last_active":"2024-05-06T06:55:30.960043+0000","last_peered":"2024-05-06T06:55:30.960043+0000","last_clean":"2024-05-06T06:55:30.960043+0000","last_became_active":"2024-05-06T06:51:26.742366+0000","last_became_peered":"2024-05-06T06:51:26.742366+0000","last_unstale":"2024-05-06T06:55:30.960043+0000","last_undegraded":"2024-05-06T06:55:30.960043+0000","last_fullsized":"2024-05-06T06:55:30.960043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":6673,"log_dups_size":0,"ondisk_log_size":6673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:21:22.835580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118949544,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":66,"num_read_kb":180,"num_write":6679,"num_write_kb":179976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.944373+0000","last_change":"2024-05-06T06:51:20.687085+0000","last_active":"2024-05-06T06:55:30.944373+0000","last_peered":"2024-05-06T06:55:30.944373+0000","last_clean":"2024-05-06T06:55:30.944373+0000","last_became_active":"2024-05-06T06:51:20.686210+0000","last_became_peered":"2024-05-06T06:51:20.686210+0000","last_unstale":"2024-05-06T06:55:30.944373+0000","last_undegraded":"2024-05-06T06:55:30.944373+0000","last_fullsized":"2024-05-06T06:55:30.944373+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:25:00.217824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"33'5441","reported_seq":5483,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.877296+0000","last_change":"2024-05-06T06:51:26.743483+0000","last_active":"2024-05-06T06:55:30.877296+0000","last_peered":"2024-05-06T06:55:30.877296+0000","last_clean":"2024-05-06T06:55:30.877296+0000","last_became_active":"2024-05-06T06:51:26.742236+0000","last_became_peered":"2024-05-06T06:51:26.742236+0000","last_unstale":"2024-05-06T06:55:30.877296+0000","last_undegraded":"2024-05-06T06:55:30.877296+0000","last_fullsized":"2024-05-06T06:55:30.877296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5441,"log_dups_size":0,"ondisk_log_size":5441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:50:36.854004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":5423,"num_write_kb":147572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.937861+0000","last_change":"2024-05-06T06:51:20.689651+0000","last_active":"2024-05-06T06:55:30.937861+0000","last_peered":"2024-05-06T06:55:30.937861+0000","last_clean":"2024-05-06T06:55:30.937861+0000","last_became_active":"2024-05-06T06:51:20.689362+0000","last_became_peered":"2024-05-06T06:51:20.689362+0000","last_unstale":"2024-05-06T06:55:30.937861+0000","last_undegraded":"2024-05-06T06:55:30.937861+0000","last_fullsized":"2024-05-06T06:55:30.937861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T16:42:56.711253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"33'3346","reported_seq":3400,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.962521+0000","last_change":"2024-05-06T06:51:26.760042+0000","last_active":"2024-05-06T06:55:30.962521+0000","last_peered":"2024-05-06T06:55:30.962521+0000","last_clean":"2024-05-06T06:55:30.962521+0000","last_became_active":"2024-05-06T06:51:26.759151+0000","last_became_peered":"2024-05-06T06:51:26.759151+0000","last_unstale":"2024-05-06T06:55:30.962521+0000","last_undegraded":"2024-05-06T06:55:30.962521+0000","last_fullsized":"2024-05-06T06:55:30.962521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3346,"log_dups_size":0,"ondisk_log_size":3346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:47:45.966056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":62,"num_read_kb":52,"num_write":3319,"num_write_kb":144515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.879729+0000","last_change":"2024-05-06T06:51:20.681448+0000","last_active":"2024-05-06T06:55:30.879729+0000","last_peered":"2024-05-06T06:55:30.879729+0000","last_clean":"2024-05-06T06:55:30.879729+0000","last_became_active":"2024-05-06T06:51:20.680436+0000","last_became_peered":"2024-05-06T06:51:20.680436+0000","last_unstale":"2024-05-06T06:55:30.879729+0000","last_undegraded":"2024-05-06T06:55:30.879729+0000","last_fullsized":"2024-05-06T06:55:30.879729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:23:10.287147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"32'6226","reported_seq":6263,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.935077+0000","last_change":"2024-05-06T06:51:26.752252+0000","last_active":"2024-05-06T06:55:30.935077+0000","last_peered":"2024-05-06T06:55:30.935077+0000","last_clean":"2024-05-06T06:55:30.935077+0000","last_became_active":"2024-05-06T06:51:26.749599+0000","last_became_peered":"2024-05-06T06:51:26.749599+0000","last_unstale":"2024-05-06T06:55:30.935077+0000","last_undegraded":"2024-05-06T06:55:30.935077+0000","last_fullsized":"2024-05-06T06:55:30.935077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":6226,"log_dups_size":0,"ondisk_log_size":6226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:46:39.000857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6220,"num_write_kb":148484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.935912+0000","last_change":"2024-05-06T06:51:20.686480+0000","last_active":"2024-05-06T06:55:30.935912+0000","last_peered":"2024-05-06T06:55:30.935912+0000","last_clean":"2024-05-06T06:55:30.935912+0000","last_became_active":"2024-05-06T06:51:20.686231+0000","last_became_peered":"2024-05-06T06:51:20.686231+0000","last_unstale":"2024-05-06T06:55:30.935912+0000","last_undegraded":"2024-05-06T06:55:30.935912+0000","last_fullsized":"2024-05-06T06:55:30.935912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:07:14.251359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'3600","reported_seq":3637,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.956119+0000","last_change":"2024-05-06T06:51:26.750208+0000","last_active":"2024-05-06T06:55:30.956119+0000","last_peered":"2024-05-06T06:55:30.956119+0000","last_clean":"2024-05-06T06:55:30.956119+0000","last_became_active":"2024-05-06T06:51:26.744763+0000","last_became_peered":"2024-05-06T06:51:26.744763+0000","last_unstale":"2024-05-06T06:55:30.956119+0000","last_undegraded":"2024-05-06T06:55:30.956119+0000","last_fullsized":"2024-05-06T06:55:30.956119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3600,"log_dups_size":0,"ondisk_log_size":3600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:46:18.695132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3599,"num_write_kb":189058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"31'2476","reported_seq":2542,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.885813+0000","last_change":"2024-05-06T06:52:22.736330+0000","last_active":"2024-05-06T06:55:30.885813+0000","last_peered":"2024-05-06T06:55:30.885813+0000","last_clean":"2024-05-06T06:55:30.885813+0000","last_became_active":"2024-05-06T06:52:22.735643+0000","last_became_peered":"2024-05-06T06:52:22.735643+0000","last_unstale":"2024-05-06T06:55:30.885813+0000","last_undegraded":"2024-05-06T06:55:30.885813+0000","last_fullsized":"2024-05-06T06:55:30.885813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":2476,"log_dups_size":0,"ondisk_log_size":2476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:27:09.052165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78252880,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":52,"num_read_kb":42,"num_write":2515,"num_write_kb":118108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":69827576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.950763+0000","last_change":"2024-05-06T06:51:20.689365+0000","last_active":"2024-05-06T06:55:30.950763+0000","last_peered":"2024-05-06T06:55:30.950763+0000","last_clean":"2024-05-06T06:55:30.950763+0000","last_became_active":"2024-05-06T06:51:20.688666+0000","last_became_peered":"2024-05-06T06:51:20.688666+0000","last_unstale":"2024-05-06T06:55:30.950763+0000","last_undegraded":"2024-05-06T06:55:30.950763+0000","last_fullsized":"2024-05-06T06:55:30.950763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:39:52.485414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"33'3849","reported_seq":4198,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.950899+0000","last_change":"2024-05-06T06:51:26.751274+0000","last_active":"2024-05-06T06:55:30.950899+0000","last_peered":"2024-05-06T06:55:30.950899+0000","last_clean":"2024-05-06T06:55:30.950899+0000","last_became_active":"2024-05-06T06:51:26.750274+0000","last_became_peered":"2024-05-06T06:51:26.750274+0000","last_unstale":"2024-05-06T06:55:30.950899+0000","last_undegraded":"2024-05-06T06:55:30.950899+0000","last_fullsized":"2024-05-06T06:55:30.950899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3849,"log_dups_size":0,"ondisk_log_size":3849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:09:24.523363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92405760,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1046,"num_read_kb":996,"num_write":4130,"num_write_kb":185537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.888283+0000","last_change":"2024-05-06T06:51:20.784004+0000","last_active":"2024-05-06T06:55:30.888283+0000","last_peered":"2024-05-06T06:55:30.888283+0000","last_clean":"2024-05-06T06:55:30.888283+0000","last_became_active":"2024-05-06T06:51:20.783638+0000","last_became_peered":"2024-05-06T06:51:20.783638+0000","last_unstale":"2024-05-06T06:55:30.888283+0000","last_undegraded":"2024-05-06T06:55:30.888283+0000","last_fullsized":"2024-05-06T06:55:30.888283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:37:19.323657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"33'3974","reported_seq":4014,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.876907+0000","last_change":"2024-05-06T06:52:23.743952+0000","last_active":"2024-05-06T06:55:30.876907+0000","last_peered":"2024-05-06T06:55:30.876907+0000","last_clean":"2024-05-06T06:55:30.876907+0000","last_became_active":"2024-05-06T06:52:23.740914+0000","last_became_peered":"2024-05-06T06:52:23.740914+0000","last_unstale":"2024-05-06T06:55:30.876907+0000","last_undegraded":"2024-05-06T06:55:30.876907+0000","last_fullsized":"2024-05-06T06:55:30.876907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3974,"log_dups_size":0,"ondisk_log_size":3974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:09:00.463938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93716480,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3945,"num_write_kb":170630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":106208624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.878128+0000","last_change":"2024-05-06T06:52:13.882588+0000","last_active":"2024-05-06T06:55:30.878128+0000","last_peered":"2024-05-06T06:55:30.878128+0000","last_clean":"2024-05-06T06:55:30.878128+0000","last_became_active":"2024-05-06T06:52:13.882153+0000","last_became_peered":"2024-05-06T06:52:13.882153+0000","last_unstale":"2024-05-06T06:55:30.878128+0000","last_undegraded":"2024-05-06T06:55:30.878128+0000","last_fullsized":"2024-05-06T06:55:30.878128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:27:44.287577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"32'3396","reported_seq":3453,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.938334+0000","last_change":"2024-05-06T06:51:26.760565+0000","last_active":"2024-05-06T06:55:30.938334+0000","last_peered":"2024-05-06T06:55:30.938334+0000","last_clean":"2024-05-06T06:55:30.938334+0000","last_became_active":"2024-05-06T06:51:26.759766+0000","last_became_peered":"2024-05-06T06:51:26.759766+0000","last_unstale":"2024-05-06T06:55:30.938334+0000","last_undegraded":"2024-05-06T06:55:30.938334+0000","last_fullsized":"2024-05-06T06:55:30.938334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3396,"log_dups_size":0,"ondisk_log_size":3396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:41:18.774836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92275200,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":83,"num_read_kb":68,"num_write":3435,"num_write_kb":120903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.950562+0000","last_change":"2024-05-06T06:51:20.691287+0000","last_active":"2024-05-06T06:55:30.950562+0000","last_peered":"2024-05-06T06:55:30.950562+0000","last_clean":"2024-05-06T06:55:30.950562+0000","last_became_active":"2024-05-06T06:51:20.690621+0000","last_became_peered":"2024-05-06T06:51:20.690621+0000","last_unstale":"2024-05-06T06:55:30.950562+0000","last_undegraded":"2024-05-06T06:55:30.950562+0000","last_fullsized":"2024-05-06T06:55:30.950562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:19.646723+0000","last_clean_scrub_stamp":"2024-05-06T06:51:19.646723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:05:07.506405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":136,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.878174+0000","last_change":"2024-05-06T06:51:19.660034+0000","last_active":"2024-05-06T06:55:30.878174+0000","last_peered":"2024-05-06T06:55:30.878174+0000","last_clean":"2024-05-06T06:55:30.878174+0000","last_became_active":"2024-05-06T06:51:19.659348+0000","last_became_peered":"2024-05-06T06:51:19.659348+0000","last_unstale":"2024-05-06T06:55:30.878174+0000","last_undegraded":"2024-05-06T06:55:30.878174+0000","last_fullsized":"2024-05-06T06:55:30.878174+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:18.638703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:18.638703+0000","last_clean_scrub_stamp":"2024-05-06T06:51:18.638703+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:35:56.572278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"33'4381","reported_seq":4418,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.952783+0000","last_change":"2024-05-06T06:51:26.746845+0000","last_active":"2024-05-06T06:55:30.952783+0000","last_peered":"2024-05-06T06:55:30.952783+0000","last_clean":"2024-05-06T06:55:30.952783+0000","last_became_active":"2024-05-06T06:51:26.745914+0000","last_became_peered":"2024-05-06T06:51:26.745914+0000","last_unstale":"2024-05-06T06:55:30.952783+0000","last_undegraded":"2024-05-06T06:55:30.952783+0000","last_fullsized":"2024-05-06T06:55:30.952783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4381,"log_dups_size":0,"ondisk_log_size":4381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:33:19.445869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4306,"num_write_kb":201861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"33'9671","reported_seq":9818,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:31.003779+0000","last_change":"2024-05-06T06:51:26.757115+0000","last_active":"2024-05-06T06:55:31.003779+0000","last_peered":"2024-05-06T06:55:31.003779+0000","last_clean":"2024-05-06T06:55:31.003779+0000","last_became_active":"2024-05-06T06:51:26.756313+0000","last_became_peered":"2024-05-06T06:51:26.756313+0000","last_unstale":"2024-05-06T06:55:31.003779+0000","last_undegraded":"2024-05-06T06:55:31.003779+0000","last_fullsized":"2024-05-06T06:55:31.003779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":9671,"log_dups_size":0,"ondisk_log_size":9671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:44:03.780875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116760576,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":373,"num_read_kb":339,"num_write":7846,"num_write_kb":190590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'4783","reported_seq":4820,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.943061+0000","last_change":"2024-05-06T06:51:26.734244+0000","last_active":"2024-05-06T06:55:30.943061+0000","last_peered":"2024-05-06T06:55:30.943061+0000","last_clean":"2024-05-06T06:55:30.943061+0000","last_became_active":"2024-05-06T06:51:26.733532+0000","last_became_peered":"2024-05-06T06:51:26.733532+0000","last_unstale":"2024-05-06T06:55:30.943061+0000","last_undegraded":"2024-05-06T06:55:30.943061+0000","last_fullsized":"2024-05-06T06:55:30.943061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4783,"log_dups_size":0,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:22:36.526433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4754,"num_write_kb":177154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"31'3418","reported_seq":3458,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.939786+0000","last_change":"2024-05-06T06:51:26.750922+0000","last_active":"2024-05-06T06:55:30.939786+0000","last_peered":"2024-05-06T06:55:30.939786+0000","last_clean":"2024-05-06T06:55:30.939786+0000","last_became_active":"2024-05-06T06:51:26.750141+0000","last_became_peered":"2024-05-06T06:51:26.750141+0000","last_unstale":"2024-05-06T06:55:30.939786+0000","last_undegraded":"2024-05-06T06:55:30.939786+0000","last_fullsized":"2024-05-06T06:55:30.939786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3418,"log_dups_size":0,"ondisk_log_size":3418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:17:36.917319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":3420,"num_write_kb":144515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"33'3811","reported_seq":3993,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.967910+0000","last_change":"2024-05-06T06:52:19.746032+0000","last_active":"2024-05-06T06:55:30.967910+0000","last_peered":"2024-05-06T06:55:30.967910+0000","last_clean":"2024-05-06T06:55:30.967910+0000","last_became_active":"2024-05-06T06:52:19.741673+0000","last_became_peered":"2024-05-06T06:52:19.741673+0000","last_unstale":"2024-05-06T06:55:30.967910+0000","last_undegraded":"2024-05-06T06:55:30.967910+0000","last_fullsized":"2024-05-06T06:55:30.967910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3811,"log_dups_size":0,"ondisk_log_size":3811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:28:54.584381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96076832,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":3780,"num_write_kb":136805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":58106356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"33'5195","reported_seq":5241,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.878853+0000","last_change":"2024-05-06T06:51:26.753097+0000","last_active":"2024-05-06T06:55:30.878853+0000","last_peered":"2024-05-06T06:55:30.878853+0000","last_clean":"2024-05-06T06:55:30.878853+0000","last_became_active":"2024-05-06T06:51:26.752302+0000","last_became_peered":"2024-05-06T06:51:26.752302+0000","last_unstale":"2024-05-06T06:55:30.878853+0000","last_undegraded":"2024-05-06T06:55:30.878853+0000","last_fullsized":"2024-05-06T06:55:30.878853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5195,"log_dups_size":0,"ondisk_log_size":5195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:24:16.771568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134414856,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":5188,"num_write_kb":206925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"33'5647","reported_seq":5843,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.976155+0000","last_change":"2024-05-06T06:52:21.773538+0000","last_active":"2024-05-06T06:55:30.976155+0000","last_peered":"2024-05-06T06:55:30.976155+0000","last_clean":"2024-05-06T06:55:30.976155+0000","last_became_active":"2024-05-06T06:52:21.771225+0000","last_became_peered":"2024-05-06T06:52:21.771225+0000","last_unstale":"2024-05-06T06:55:30.976155+0000","last_undegraded":"2024-05-06T06:55:30.976155+0000","last_fullsized":"2024-05-06T06:55:30.976155+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":5647,"log_dups_size":0,"ondisk_log_size":5647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:48:13.235907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132775936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":300,"num_read_kb":235,"num_write":5895,"num_write_kb":245104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":117780368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"33'4163","reported_seq":4205,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.950648+0000","last_change":"2024-05-06T06:51:26.750495+0000","last_active":"2024-05-06T06:55:30.950648+0000","last_peered":"2024-05-06T06:55:30.950648+0000","last_clean":"2024-05-06T06:55:30.950648+0000","last_became_active":"2024-05-06T06:51:26.748874+0000","last_became_peered":"2024-05-06T06:51:26.748874+0000","last_unstale":"2024-05-06T06:55:30.950648+0000","last_undegraded":"2024-05-06T06:55:30.950648+0000","last_fullsized":"2024-05-06T06:55:30.950648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T16:00:13.973581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90965840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":4127,"num_write_kb":138968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"33'3925","reported_seq":3962,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.961826+0000","last_change":"2024-05-06T06:51:26.726150+0000","last_active":"2024-05-06T06:55:30.961826+0000","last_peered":"2024-05-06T06:55:30.961826+0000","last_clean":"2024-05-06T06:55:30.961826+0000","last_became_active":"2024-05-06T06:51:26.725309+0000","last_became_peered":"2024-05-06T06:51:26.725309+0000","last_unstale":"2024-05-06T06:55:30.961826+0000","last_undegraded":"2024-05-06T06:55:30.961826+0000","last_fullsized":"2024-05-06T06:55:30.961826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":3925,"log_dups_size":0,"ondisk_log_size":3925,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:32:07.768752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124452864,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3876,"num_write_kb":158405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"31'4205","reported_seq":4272,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.943603+0000","last_change":"2024-05-06T06:52:22.764048+0000","last_active":"2024-05-06T06:55:30.943603+0000","last_peered":"2024-05-06T06:55:30.943603+0000","last_clean":"2024-05-06T06:55:30.943603+0000","last_became_active":"2024-05-06T06:52:22.744107+0000","last_became_peered":"2024-05-06T06:52:22.744107+0000","last_unstale":"2024-05-06T06:55:30.943603+0000","last_undegraded":"2024-05-06T06:55:30.943603+0000","last_fullsized":"2024-05-06T06:55:30.943603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4205,"log_dups_size":0,"ondisk_log_size":4205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:39:24.414582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134479872,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":45,"num_read_kb":96,"num_write":4222,"num_write_kb":185991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":117274564,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"33'4032","reported_seq":4071,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.956550+0000","last_change":"2024-05-06T06:52:18.765028+0000","last_active":"2024-05-06T06:55:30.956550+0000","last_peered":"2024-05-06T06:55:30.956550+0000","last_clean":"2024-05-06T06:55:30.956550+0000","last_became_active":"2024-05-06T06:52:18.751926+0000","last_became_peered":"2024-05-06T06:52:18.751926+0000","last_unstale":"2024-05-06T06:55:30.956550+0000","last_undegraded":"2024-05-06T06:55:30.956550+0000","last_fullsized":"2024-05-06T06:55:30.956550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":4032,"log_dups_size":0,"ondisk_log_size":4032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:02:54.706552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3984,"num_write_kb":181381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":113149924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"33'10498","reported_seq":10548,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:30.878434+0000","last_change":"2024-05-06T06:51:26.750110+0000","last_active":"2024-05-06T06:55:30.878434+0000","last_peered":"2024-05-06T06:55:30.878434+0000","last_clean":"2024-05-06T06:55:30.878434+0000","last_became_active":"2024-05-06T06:51:26.749358+0000","last_became_peered":"2024-05-06T06:51:26.749358+0000","last_unstale":"2024-05-06T06:55:30.878434+0000","last_undegraded":"2024-05-06T06:55:30.878434+0000","last_fullsized":"2024-05-06T06:55:30.878434+0000","mapping_epoch":19,"log_start":"21'400","ondisk_log_start":"21'400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:51:25.707189+0000","last_clean_scrub_stamp":"2024-05-06T06:51:25.707189+0000","objects_scrubbed":0,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:58:55.322246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188874752,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":54,"num_read_kb":41,"num_write":10494,"num_write_kb":304731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3568152824,"num_objects":877,"num_object_clones":0,"num_object_copies":1754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":877,"num_whiteouts":0,"num_read":2560,"num_read_kb":2576,"num_write":157289,"num_write_kb":5626821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":803710944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6838648832,"data_stored":6834389112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158502,"ondisk_log_size":158502,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1242404,"kb_used_data":926744,"kb_used_omap":1,"kb_used_meta":315646,"kb_avail":93129436,"statfs":{"total":96636764160,"available":95364542464,"internally_reserved":0,"allocated":948985856,"data_stored":948138510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":323221962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1380424,"kb_used_data":1006460,"kb_used_omap":1,"kb_used_meta":373950,"kb_avail":92991416,"statfs":{"total":96636764160,"available":95223209984,"internally_reserved":0,"allocated":1030615040,"data_stored":1029728434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":382925253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":836828,"kb_used_data":729360,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":93535012,"statfs":{"total":96636764160,"available":95779852288,"internally_reserved":0,"allocated":746864640,"data_stored":746093138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542198,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048208,"kb_used_data":796356,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93323632,"statfs":{"total":96636764160,"available":95563399168,"internally_reserved":0,"allocated":815468544,"data_stored":814794234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257882567},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542201,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1155432,"kb_used_data":903580,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93216408,"statfs":{"total":96636764160,"available":95453601792,"internally_reserved":0,"allocated":925265920,"data_stored":924512030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257882567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542197,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":830988,"kb_used_data":687424,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":93540852,"statfs":{"total":96636764160,"available":95785832448,"internally_reserved":0,"allocated":703922176,"data_stored":703329314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":926168,"kb_used_data":742348,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93445672,"statfs":{"total":96636764160,"available":95688368128,"internally_reserved":0,"allocated":760164352,"data_stored":759561582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1163852,"kb_used_data":889792,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93207988,"statfs":{"total":96636764160,"available":95444979712,"internally_reserved":0,"allocated":911147008,"data_stored":910287118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280623557},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":910274560,"data_stored":909633516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":759824384,"data_stored":759436908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":703582208,"data_stored":703204640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":924925952,"data_stored":924387356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1030275072,"data_stored":1029603760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":815128576,"data_stored":814669560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":746524672,"data_stored":745968464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":948113408,"data_stored":947484908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T06:55:37.991 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.991 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.991 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.991 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.991 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.991 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.991 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.991 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.992 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.992 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.992 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.992 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.992 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-06T06:51:19.646723+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=19, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.992 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.992 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-06T06:51:19.646723+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=19, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.992 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.992 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-06T06:51:19.646723+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=19, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.992 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.993 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-06T06:51:19.646723+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=19, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.993 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.993 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.993 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-06T06:51:19.646723+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=19, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.993 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.993 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-06T06:51:19.646723+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=19, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.993 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.993 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-06T06:51:19.646723+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=19, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.993 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.993 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-06T06:51:19.646723+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=19, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.994 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-06T06:51:18.638703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=18, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.994 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.994 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.994 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.994 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.994 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.994 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.994 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.994 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.995 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.995 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.995 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.995 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-06T06:51:25.707189+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=51, tm_sec=25, tm_wday=0, tm_yday=127, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=6, tm_hour=6, tm_min=55, tm_sec=32, tm_wday=0, tm_yday=127, tm_isdst=0) 2024-05-06T06:55:37.995 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-06T06:55:57.996 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-06T06:55:58.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.122+0000 7f415f702640 1 Processor -- start 2024-05-06T06:55:58.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.122+0000 7f415f702640 1 -- start start 2024-05-06T06:55:58.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41580b0b40 con 0x7f4158146f20 2024-05-06T06:55:58.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4158143790 con 0x7f4158147300 2024-05-06T06:55:58.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4158144a30 con 0x7f41580b1280 2024-05-06T06:55:58.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415d49e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f4158146f20 0x7f4158143080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50156/0 (socket says 172.21.15.70:50156) 2024-05-06T06:55:58.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415d49e640 1 -- 172.21.15.70:0/288301816 learned_addr learned my addr 172.21.15.70:0/288301816 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:58.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415dc9f640 1 --1- 172.21.15.70:0/288301816 >> v1:172.21.15.70:6790/0 conn(0x7f41580b1280 0x7f415814f280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:44944/0 (socket says 172.21.15.70:44944) 2024-05-06T06:55:58.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415cc9d640 1 -- 172.21.15.70:0/288301816 >> v1:172.21.15.184:6789/0 conn(0x7f4158147300 legacy=0x7f41580ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-06T06:55:58.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415cc9d640 1 -- 172.21.15.70:0/288301816 >> v1:172.21.15.184:6789/0 conn(0x7f4158147300 legacy=0x7f41580ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-06T06:55:58.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415cc9d640 1 --1- 172.21.15.70:0/288301816 >> v1:172.21.15.184:6789/0 conn(0x7f4158147300 0x7f41580ae870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify read banner and identify addresses failed 2024-05-06T06:55:58.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4157fff640 1 -- 172.21.15.70:0/288301816 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417407864 0 0) 0x7f4158144a30 con 0x7f41580b1280 2024-05-06T06:55:58.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4157fff640 1 -- 172.21.15.70:0/288301816 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4140003530 con 0x7f41580b1280 2024-05-06T06:55:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4157fff640 1 -- 172.21.15.70:0/288301816 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2962746641 0 0) 0x7f41580b0b40 con 0x7f4158146f20 2024-05-06T06:55:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4157fff640 1 -- 172.21.15.70:0/288301816 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4158144a30 con 0x7f4158146f20 2024-05-06T06:55:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4157fff640 1 -- 172.21.15.70:0/288301816 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2352828563 0 0) 0x7f4140003530 con 0x7f41580b1280 2024-05-06T06:55:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4157fff640 1 -- 172.21.15.70:0/288301816 >> v1:172.21.15.184:6789/0 conn(0x7f4158147300 legacy=0x7f41580ae870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-06T06:55:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4157fff640 1 -- 172.21.15.70:0/288301816 >> v1:172.21.15.70:6789/0 conn(0x7f4158146f20 legacy=0x7f4158143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4157fff640 1 -- 172.21.15.70:0/288301816 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4158147c00 con 0x7f41580b1280 2024-05-06T06:55:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4157fff640 1 -- 172.21.15.70:0/288301816 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f41480015d0 con 0x7f41580b1280 2024-05-06T06:55:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4157fff640 1 -- 172.21.15.70:0/288301816 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4148001770 con 0x7f41580b1280 2024-05-06T06:55:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4157fff640 1 -- 172.21.15.70:0/288301816 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f4148001c00 con 0x7f41580b1280 2024-05-06T06:55:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 -- 172.21.15.70:0/288301816 >> v1:172.21.15.70:6790/0 conn(0x7f41580b1280 legacy=0x7f415814f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 -- 172.21.15.70:0/288301816 shutdown_connections 2024-05-06T06:55:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 -- 172.21.15.70:0/288301816 >> 172.21.15.70:0/288301816 conn(0x7f41580b1d40 msgr2=0x7f41580b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 -- 172.21.15.70:0/288301816 shutdown_connections 2024-05-06T06:55:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 -- 172.21.15.70:0/288301816 wait complete. 2024-05-06T06:55:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 Processor -- start 2024-05-06T06:55:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 -- start start 2024-05-06T06:55:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415811e670 con 0x7f41580b1280 2024-05-06T06:55:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415811f000 con 0x7f4158146f20 2024-05-06T06:55:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415f702640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415811f1d0 con 0x7f4158147300 2024-05-06T06:55:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415d49e640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7f41580b1280 0x7f415811ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50162/0 (socket says 172.21.15.70:50162) 2024-05-06T06:55:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415d49e640 1 -- 172.21.15.70:0/3892288062 learned_addr learned my addr 172.21.15.70:0/3892288062 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f415dc9f640 1 --1- 172.21.15.70:0/3892288062 >> v1:172.21.15.70:6790/0 conn(0x7f4158147300 0x7f41581e3cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:44958/0 (socket says 172.21.15.70:44958) 2024-05-06T06:55:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802517454 0 0) 0x7f415811f1d0 con 0x7f4158147300 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4144003530 con 0x7f4158147300 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2169263384 0 0) 0x7f415811e670 con 0x7f41580b1280 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.126+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f415811f1d0 con 0x7f41580b1280 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1098972917 0 0) 0x7f4144003530 con 0x7f4158147300 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f415811e670 con 0x7f4158147300 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f4148001ac0 con 0x7f4158147300 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 780870199 0 0) 0x7f415811f1d0 con 0x7f41580b1280 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4144003530 con 0x7f41580b1280 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f4150001740 con 0x7f41580b1280 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699113797 0 0) 0x7f415811f000 con 0x7f4158146f20 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f415811f1d0 con 0x7f4158146f20 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.2 v1:172.21.15.70:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1007963391 0 0) 0x7f415811e670 con 0x7f4158147300 2024-05-06T06:55:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 >> v1:172.21.15.184:6789/0 conn(0x7f4158146f20 legacy=0x7f415813dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 >> v1:172.21.15.70:6789/0 conn(0x7f41580b1280 legacy=0x7f415811ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415811eb90 con 0x7f4158147300 2024-05-06T06:55:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f415f702640 1 -- 172.21.15.70:0/3892288062 --> v1:172.21.15.70:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f415811d530 con 0x7f4158147300 2024-05-06T06:55:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f415f702640 1 -- 172.21.15.70:0/3892288062 --> v1:172.21.15.70:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f415813e4d0 con 0x7f4158147300 2024-05-06T06:55:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.2 v1:172.21.15.70:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4148004aa0 con 0x7f4158147300 2024-05-06T06:55:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.2 v1:172.21.15.70:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7f4148004c50 con 0x7f4158147300 2024-05-06T06:55:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f415f702640 1 -- 172.21.15.70:0/3892288062 --> v1:172.21.15.70:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4138005090 con 0x7f4158147300 2024-05-06T06:55:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.2 v1:172.21.15.70:6790/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7f414801b9f0 con 0x7f4158147300 2024-05-06T06:55:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.130+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.2 v1:172.21.15.70:6790/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7f414808a870 con 0x7f4158147300 2024-05-06T06:55:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.134+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mon.2 v1:172.21.15.70:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7f4148057a00 con 0x7f4158147300 2024-05-06T06:55:58.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.290+0000 7f415f702640 1 -- 172.21.15.70:0/3892288062 --> v1:172.21.15.70:6816/2757942729 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4138000ba0 con 0x7f4144070110 2024-05-06T06:55:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.298+0000 7f4155ffb640 1 -- 172.21.15.70:0/3892288062 <== mgr.4110 v1:172.21.15.70:6816/2757942729 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+117930 (unknown 2965378022 0 2124318141) 0x7f4138000ba0 con 0x7f4144070110 2024-05-06T06:55:58.304 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-06T06:55:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-06T06:55:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.302+0000 7f415f702640 1 -- 172.21.15.70:0/3892288062 >> v1:172.21.15.70:6816/2757942729 conn(0x7f4144070110 legacy=0x7f41440725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.302+0000 7f415f702640 1 -- 172.21.15.70:0/3892288062 >> v1:172.21.15.70:6790/0 conn(0x7f4158147300 legacy=0x7f41581e3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.302+0000 7f415f702640 1 -- 172.21.15.70:0/3892288062 shutdown_connections 2024-05-06T06:55:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.302+0000 7f415f702640 1 -- 172.21.15.70:0/3892288062 >> 172.21.15.70:0/3892288062 conn(0x7f41580b1d40 msgr2=0x7f4158146630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.302+0000 7f415f702640 1 -- 172.21.15.70:0/3892288062 shutdown_connections 2024-05-06T06:55:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.302+0000 7f415f702640 1 -- 172.21.15.70:0/3892288062 wait complete. 2024-05-06T06:55:58.322 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-05-06T06:55:56.667844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3568743192,"num_objects":879,"num_object_clones":0,"num_object_copies":1758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":879,"num_whiteouts":0,"num_read":2626,"num_read_kb":2631,"num_write":157390,"num_write_kb":5628449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":803710944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159351,"ondisk_log_size":159351,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8592592,"kb_used_data":6682064,"kb_used_omap":12,"kb_used_meta":1910451,"kb_avail":746382128,"statfs":{"total":773094113280,"available":764295299072,"internally_reserved":0,"allocated":6842433536,"data_stored":6836444360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1956302386},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004315"},"pg_stats":[{"pgid":"3.1f","version":"33'2988","reported_seq":3037,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:37.513063+0000","last_change":"2024-05-06T06:55:37.513063+0000","last_active":"2024-05-06T06:55:37.513063+0000","last_peered":"2024-05-06T06:55:37.513063+0000","last_clean":"2024-05-06T06:55:37.513063+0000","last_became_active":"2024-05-06T06:51:26.752788+0000","last_became_peered":"2024-05-06T06:51:26.752788+0000","last_unstale":"2024-05-06T06:55:37.513063+0000","last_undegraded":"2024-05-06T06:55:37.513063+0000","last_fullsized":"2024-05-06T06:55:37.513063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2988","last_scrub_stamp":"2024-05-06T06:55:37.512866+0000","last_deep_scrub":"33'2988","last_deep_scrub_stamp":"2024-05-06T06:55:37.512866+0000","last_clean_scrub_stamp":"2024-05-06T06:55:37.512866+0000","objects_scrubbed":19,"log_size":2988,"log_dups_size":0,"ondisk_log_size":2988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:10:57.355234+0000","scrub_duration":259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":2975,"num_write_kb":148098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'6559","reported_seq":6639,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:39.304186+0000","last_change":"2024-05-06T06:55:39.304268+0000","last_active":"2024-05-06T06:55:39.304186+0000","last_peered":"2024-05-06T06:55:39.304186+0000","last_clean":"2024-05-06T06:55:39.304186+0000","last_became_active":"2024-05-06T06:51:26.752122+0000","last_became_peered":"2024-05-06T06:51:26.752122+0000","last_unstale":"2024-05-06T06:55:39.304186+0000","last_undegraded":"2024-05-06T06:55:39.304186+0000","last_fullsized":"2024-05-06T06:55:39.304186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6559","last_scrub_stamp":"2024-05-06T06:55:39.304009+0000","last_deep_scrub":"33'6559","last_deep_scrub_stamp":"2024-05-06T06:55:39.304009+0000","last_clean_scrub_stamp":"2024-05-06T06:55:39.304009+0000","objects_scrubbed":29,"log_size":6559,"log_dups_size":0,"ondisk_log_size":6559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:51:29.914102+0000","scrub_duration":427,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113386000,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":120,"num_read_kb":227,"num_write":6557,"num_write_kb":229051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"33'4563","reported_seq":4610,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:39.119955+0000","last_change":"2024-05-06T06:55:39.120041+0000","last_active":"2024-05-06T06:55:39.119955+0000","last_peered":"2024-05-06T06:55:39.119955+0000","last_clean":"2024-05-06T06:55:39.119955+0000","last_became_active":"2024-05-06T06:51:26.740563+0000","last_became_peered":"2024-05-06T06:51:26.740563+0000","last_unstale":"2024-05-06T06:55:39.119955+0000","last_undegraded":"2024-05-06T06:55:39.119955+0000","last_fullsized":"2024-05-06T06:55:39.119955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4563","last_scrub_stamp":"2024-05-06T06:55:39.119848+0000","last_deep_scrub":"33'4563","last_deep_scrub_stamp":"2024-05-06T06:55:39.119848+0000","last_clean_scrub_stamp":"2024-05-06T06:55:39.119848+0000","objects_scrubbed":24,"log_size":4563,"log_dups_size":0,"ondisk_log_size":4563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:58:08.694444+0000","scrub_duration":387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99223376,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4514,"num_write_kb":149245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"33'2987","reported_seq":3076,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:41.019739+0000","last_change":"2024-05-06T06:55:41.019832+0000","last_active":"2024-05-06T06:55:41.019739+0000","last_peered":"2024-05-06T06:55:41.019739+0000","last_clean":"2024-05-06T06:55:41.019739+0000","last_became_active":"2024-05-06T06:52:18.728975+0000","last_became_peered":"2024-05-06T06:52:18.728975+0000","last_unstale":"2024-05-06T06:55:41.019739+0000","last_undegraded":"2024-05-06T06:55:41.019739+0000","last_fullsized":"2024-05-06T06:55:41.019739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2987","last_scrub_stamp":"2024-05-06T06:55:41.019604+0000","last_deep_scrub":"33'2987","last_deep_scrub_stamp":"2024-05-06T06:55:41.019604+0000","last_clean_scrub_stamp":"2024-05-06T06:55:41.019604+0000","objects_scrubbed":22,"log_size":2987,"log_dups_size":0,"ondisk_log_size":2987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:29:32.051402+0000","scrub_duration":315,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2956,"num_write_kb":148097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71285744,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"33'3540","reported_seq":3588,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:34.645927+0000","last_change":"2024-05-06T06:55:34.645981+0000","last_active":"2024-05-06T06:55:34.645927+0000","last_peered":"2024-05-06T06:55:34.645927+0000","last_clean":"2024-05-06T06:55:34.645927+0000","last_became_active":"2024-05-06T06:51:26.739617+0000","last_became_peered":"2024-05-06T06:51:26.739617+0000","last_unstale":"2024-05-06T06:55:34.645927+0000","last_undegraded":"2024-05-06T06:55:34.645927+0000","last_fullsized":"2024-05-06T06:55:34.645927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3540","last_scrub_stamp":"2024-05-06T06:55:34.645783+0000","last_deep_scrub":"33'3540","last_deep_scrub_stamp":"2024-05-06T06:55:34.645783+0000","last_clean_scrub_stamp":"2024-05-06T06:55:34.645783+0000","objects_scrubbed":27,"log_size":3540,"log_dups_size":0,"ondisk_log_size":3540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:02:28.780203+0000","scrub_duration":323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109117960,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":3468,"num_write_kb":138775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"33'5855","reported_seq":5949,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:36.872938+0000","last_change":"2024-05-06T06:55:36.872983+0000","last_active":"2024-05-06T06:55:36.872938+0000","last_peered":"2024-05-06T06:55:36.872938+0000","last_clean":"2024-05-06T06:55:36.872938+0000","last_became_active":"2024-05-06T06:52:20.774523+0000","last_became_peered":"2024-05-06T06:52:20.774523+0000","last_unstale":"2024-05-06T06:55:36.872938+0000","last_undegraded":"2024-05-06T06:55:36.872938+0000","last_fullsized":"2024-05-06T06:55:36.872938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5855","last_scrub_stamp":"2024-05-06T06:55:36.872864+0000","last_deep_scrub":"33'5855","last_deep_scrub_stamp":"2024-05-06T06:55:36.872864+0000","last_clean_scrub_stamp":"2024-05-06T06:55:36.872864+0000","objects_scrubbed":29,"log_size":5855,"log_dups_size":0,"ondisk_log_size":5855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:32:41.822722+0000","scrub_duration":231,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":74,"num_read_kb":59,"num_write":5831,"num_write_kb":173444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":76111888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"33'4134","reported_seq":4184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:37.636489+0000","last_change":"2024-05-06T06:55:37.636533+0000","last_active":"2024-05-06T06:55:37.636489+0000","last_peered":"2024-05-06T06:55:37.636489+0000","last_clean":"2024-05-06T06:55:37.636489+0000","last_became_active":"2024-05-06T06:51:26.748230+0000","last_became_peered":"2024-05-06T06:51:26.748230+0000","last_unstale":"2024-05-06T06:55:37.636489+0000","last_undegraded":"2024-05-06T06:55:37.636489+0000","last_fullsized":"2024-05-06T06:55:37.636489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4134","last_scrub_stamp":"2024-05-06T06:55:37.636384+0000","last_deep_scrub":"33'4134","last_deep_scrub_stamp":"2024-05-06T06:55:37.636384+0000","last_clean_scrub_stamp":"2024-05-06T06:55:37.636384+0000","objects_scrubbed":26,"log_size":4134,"log_dups_size":0,"ondisk_log_size":4134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:26:36.331990+0000","scrub_duration":179,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104989200,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":4066,"num_write_kb":140299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"33'7218","reported_seq":7265,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:38.122566+0000","last_change":"2024-05-06T06:55:38.122601+0000","last_active":"2024-05-06T06:55:38.122566+0000","last_peered":"2024-05-06T06:55:38.122566+0000","last_clean":"2024-05-06T06:55:38.122566+0000","last_became_active":"2024-05-06T06:51:26.750654+0000","last_became_peered":"2024-05-06T06:51:26.750654+0000","last_unstale":"2024-05-06T06:55:38.122566+0000","last_undegraded":"2024-05-06T06:55:38.122566+0000","last_fullsized":"2024-05-06T06:55:38.122566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7218","last_scrub_stamp":"2024-05-06T06:55:38.122494+0000","last_deep_scrub":"33'7218","last_deep_scrub_stamp":"2024-05-06T06:55:38.122494+0000","last_clean_scrub_stamp":"2024-05-06T06:55:38.122494+0000","objects_scrubbed":31,"log_size":7218,"log_dups_size":0,"ondisk_log_size":7218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:58:53.283906+0000","scrub_duration":255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7185,"num_write_kb":217990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'7445","reported_seq":7504,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:36.859223+0000","last_change":"2024-05-06T06:55:36.859299+0000","last_active":"2024-05-06T06:55:36.859223+0000","last_peered":"2024-05-06T06:55:36.859223+0000","last_clean":"2024-05-06T06:55:36.859223+0000","last_became_active":"2024-05-06T06:51:26.748155+0000","last_became_peered":"2024-05-06T06:51:26.748155+0000","last_unstale":"2024-05-06T06:55:36.859223+0000","last_undegraded":"2024-05-06T06:55:36.859223+0000","last_fullsized":"2024-05-06T06:55:36.859223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7445","last_scrub_stamp":"2024-05-06T06:55:36.859108+0000","last_deep_scrub":"33'7445","last_deep_scrub_stamp":"2024-05-06T06:55:36.859108+0000","last_clean_scrub_stamp":"2024-05-06T06:55:36.859108+0000","objects_scrubbed":38,"log_size":7445,"log_dups_size":0,"ondisk_log_size":7445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:11:11.817841+0000","scrub_duration":563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153731072,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":7429,"num_write_kb":226728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'3712","reported_seq":3751,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:40.940259+0000","last_change":"2024-05-06T06:55:40.940333+0000","last_active":"2024-05-06T06:55:40.940259+0000","last_peered":"2024-05-06T06:55:40.940259+0000","last_clean":"2024-05-06T06:55:40.940259+0000","last_became_active":"2024-05-06T06:52:18.736778+0000","last_became_peered":"2024-05-06T06:52:18.736778+0000","last_unstale":"2024-05-06T06:55:40.940259+0000","last_undegraded":"2024-05-06T06:55:40.940259+0000","last_fullsized":"2024-05-06T06:55:40.940259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3712","last_scrub_stamp":"2024-05-06T06:55:40.940121+0000","last_deep_scrub":"33'3712","last_deep_scrub_stamp":"2024-05-06T06:55:40.940121+0000","last_clean_scrub_stamp":"2024-05-06T06:55:40.940121+0000","objects_scrubbed":30,"log_size":3712,"log_dups_size":0,"ondisk_log_size":3712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:55:25.123209+0000","scrub_duration":395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377808,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":3674,"num_write_kb":159628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":73965900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"33'7496","reported_seq":7549,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:40.636644+0000","last_change":"2024-05-06T06:55:40.636729+0000","last_active":"2024-05-06T06:55:40.636644+0000","last_peered":"2024-05-06T06:55:40.636644+0000","last_clean":"2024-05-06T06:55:40.636644+0000","last_became_active":"2024-05-06T06:51:26.746151+0000","last_became_peered":"2024-05-06T06:51:26.746151+0000","last_unstale":"2024-05-06T06:55:40.636644+0000","last_undegraded":"2024-05-06T06:55:40.636644+0000","last_fullsized":"2024-05-06T06:55:40.636644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7496","last_scrub_stamp":"2024-05-06T06:55:40.636441+0000","last_deep_scrub":"33'7496","last_deep_scrub_stamp":"2024-05-06T06:55:40.636441+0000","last_clean_scrub_stamp":"2024-05-06T06:55:40.636441+0000","objects_scrubbed":31,"log_size":7496,"log_dups_size":0,"ondisk_log_size":7496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:26:31.118587+0000","scrub_duration":471,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":7477,"num_write_kb":218253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"33'6702","reported_seq":6771,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:36.697591+0000","last_change":"2024-05-06T06:55:36.697641+0000","last_active":"2024-05-06T06:55:36.697591+0000","last_peered":"2024-05-06T06:55:36.697591+0000","last_clean":"2024-05-06T06:55:36.697591+0000","last_became_active":"2024-05-06T06:51:26.742366+0000","last_became_peered":"2024-05-06T06:51:26.742366+0000","last_unstale":"2024-05-06T06:55:36.697591+0000","last_undegraded":"2024-05-06T06:55:36.697591+0000","last_fullsized":"2024-05-06T06:55:36.697591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6702","last_scrub_stamp":"2024-05-06T06:55:36.697489+0000","last_deep_scrub":"33'6702","last_deep_scrub_stamp":"2024-05-06T06:55:36.697489+0000","last_clean_scrub_stamp":"2024-05-06T06:55:36.697489+0000","objects_scrubbed":29,"log_size":6702,"log_dups_size":0,"ondisk_log_size":6702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:23:27.992392+0000","scrub_duration":483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118949544,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":66,"num_read_kb":180,"num_write":6679,"num_write_kb":179976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:37.531411+0000","last_change":"2024-05-06T06:55:37.531411+0000","last_active":"2024-05-06T06:55:37.531411+0000","last_peered":"2024-05-06T06:55:37.531411+0000","last_clean":"2024-05-06T06:55:37.531411+0000","last_became_active":"2024-05-06T06:51:20.686210+0000","last_became_peered":"2024-05-06T06:51:20.686210+0000","last_unstale":"2024-05-06T06:55:37.531411+0000","last_undegraded":"2024-05-06T06:55:37.531411+0000","last_fullsized":"2024-05-06T06:55:37.531411+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:55:37.531144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:55:37.531144+0000","last_clean_scrub_stamp":"2024-05-06T06:55:37.531144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:01:47.970577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"33'5464","reported_seq":5516,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:35.467874+0000","last_change":"2024-05-06T06:55:35.467874+0000","last_active":"2024-05-06T06:55:35.467874+0000","last_peered":"2024-05-06T06:55:35.467874+0000","last_clean":"2024-05-06T06:55:35.467874+0000","last_became_active":"2024-05-06T06:51:26.742236+0000","last_became_peered":"2024-05-06T06:51:26.742236+0000","last_unstale":"2024-05-06T06:55:35.467874+0000","last_undegraded":"2024-05-06T06:55:35.467874+0000","last_fullsized":"2024-05-06T06:55:35.467874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5464","last_scrub_stamp":"2024-05-06T06:55:35.467735+0000","last_deep_scrub":"33'5464","last_deep_scrub_stamp":"2024-05-06T06:55:35.467735+0000","last_clean_scrub_stamp":"2024-05-06T06:55:35.467735+0000","objects_scrubbed":23,"log_size":5464,"log_dups_size":0,"ondisk_log_size":5464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:09:30.722770+0000","scrub_duration":151,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":5423,"num_write_kb":147572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:36.466588+0000","last_change":"2024-05-06T06:55:36.466588+0000","last_active":"2024-05-06T06:55:36.466588+0000","last_peered":"2024-05-06T06:55:36.466588+0000","last_clean":"2024-05-06T06:55:36.466588+0000","last_became_active":"2024-05-06T06:51:20.689362+0000","last_became_peered":"2024-05-06T06:51:20.689362+0000","last_unstale":"2024-05-06T06:55:36.466588+0000","last_undegraded":"2024-05-06T06:55:36.466588+0000","last_fullsized":"2024-05-06T06:55:36.466588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:55:36.466421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:55:36.466421+0000","last_clean_scrub_stamp":"2024-05-06T06:55:36.466421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:45:55.075155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"33'3367","reported_seq":3431,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:40.200201+0000","last_change":"2024-05-06T06:55:40.200201+0000","last_active":"2024-05-06T06:55:40.200201+0000","last_peered":"2024-05-06T06:55:40.200201+0000","last_clean":"2024-05-06T06:55:40.200201+0000","last_became_active":"2024-05-06T06:51:26.759151+0000","last_became_peered":"2024-05-06T06:51:26.759151+0000","last_unstale":"2024-05-06T06:55:40.200201+0000","last_undegraded":"2024-05-06T06:55:40.200201+0000","last_fullsized":"2024-05-06T06:55:40.200201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3367","last_scrub_stamp":"2024-05-06T06:55:40.199857+0000","last_deep_scrub":"33'3367","last_deep_scrub_stamp":"2024-05-06T06:55:40.199857+0000","last_clean_scrub_stamp":"2024-05-06T06:55:40.199857+0000","objects_scrubbed":21,"log_size":3367,"log_dups_size":0,"ondisk_log_size":3367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:14:55.645649+0000","scrub_duration":295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":62,"num_read_kb":52,"num_write":3319,"num_write_kb":144515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:39.175103+0000","last_change":"2024-05-06T06:55:39.175193+0000","last_active":"2024-05-06T06:55:39.175103+0000","last_peered":"2024-05-06T06:55:39.175103+0000","last_clean":"2024-05-06T06:55:39.175103+0000","last_became_active":"2024-05-06T06:51:20.680436+0000","last_became_peered":"2024-05-06T06:51:20.680436+0000","last_unstale":"2024-05-06T06:55:39.175103+0000","last_undegraded":"2024-05-06T06:55:39.175103+0000","last_fullsized":"2024-05-06T06:55:39.175103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:55:39.174901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:55:39.174901+0000","last_clean_scrub_stamp":"2024-05-06T06:55:39.174901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:54:16.122547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"33'6253","reported_seq":6301,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:39.792657+0000","last_change":"2024-05-06T06:55:39.792704+0000","last_active":"2024-05-06T06:55:39.792657+0000","last_peered":"2024-05-06T06:55:39.792657+0000","last_clean":"2024-05-06T06:55:39.792657+0000","last_became_active":"2024-05-06T06:51:26.749599+0000","last_became_peered":"2024-05-06T06:51:26.749599+0000","last_unstale":"2024-05-06T06:55:39.792657+0000","last_undegraded":"2024-05-06T06:55:39.792657+0000","last_fullsized":"2024-05-06T06:55:39.792657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6253","last_scrub_stamp":"2024-05-06T06:55:39.792546+0000","last_deep_scrub":"33'6253","last_deep_scrub_stamp":"2024-05-06T06:55:39.792546+0000","last_clean_scrub_stamp":"2024-05-06T06:55:39.792546+0000","objects_scrubbed":27,"log_size":6253,"log_dups_size":0,"ondisk_log_size":6253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T15:42:01.355942+0000","scrub_duration":355,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6220,"num_write_kb":148484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:35.439193+0000","last_change":"2024-05-06T06:55:35.439227+0000","last_active":"2024-05-06T06:55:35.439193+0000","last_peered":"2024-05-06T06:55:35.439193+0000","last_clean":"2024-05-06T06:55:35.439193+0000","last_became_active":"2024-05-06T06:51:20.686231+0000","last_became_peered":"2024-05-06T06:51:20.686231+0000","last_unstale":"2024-05-06T06:55:35.439193+0000","last_undegraded":"2024-05-06T06:55:35.439193+0000","last_fullsized":"2024-05-06T06:55:35.439193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:55:35.439122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:55:35.439122+0000","last_clean_scrub_stamp":"2024-05-06T06:55:35.439122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:30:54.910723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'3625","reported_seq":3673,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:40.031815+0000","last_change":"2024-05-06T06:55:40.031902+0000","last_active":"2024-05-06T06:55:40.031815+0000","last_peered":"2024-05-06T06:55:40.031815+0000","last_clean":"2024-05-06T06:55:40.031815+0000","last_became_active":"2024-05-06T06:51:26.744763+0000","last_became_peered":"2024-05-06T06:51:26.744763+0000","last_unstale":"2024-05-06T06:55:40.031815+0000","last_undegraded":"2024-05-06T06:55:40.031815+0000","last_fullsized":"2024-05-06T06:55:40.031815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3625","last_scrub_stamp":"2024-05-06T06:55:40.031660+0000","last_deep_scrub":"33'3625","last_deep_scrub_stamp":"2024-05-06T06:55:40.031660+0000","last_clean_scrub_stamp":"2024-05-06T06:55:40.031660+0000","objects_scrubbed":25,"log_size":3625,"log_dups_size":0,"ondisk_log_size":3625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T12:06:27.147464+0000","scrub_duration":343,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3599,"num_write_kb":189058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"33'2497","reported_seq":2572,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:38.729256+0000","last_change":"2024-05-06T06:55:38.729323+0000","last_active":"2024-05-06T06:55:38.729256+0000","last_peered":"2024-05-06T06:55:38.729256+0000","last_clean":"2024-05-06T06:55:38.729256+0000","last_became_active":"2024-05-06T06:52:22.735643+0000","last_became_peered":"2024-05-06T06:52:22.735643+0000","last_unstale":"2024-05-06T06:55:38.729256+0000","last_undegraded":"2024-05-06T06:55:38.729256+0000","last_fullsized":"2024-05-06T06:55:38.729256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2497","last_scrub_stamp":"2024-05-06T06:55:38.729158+0000","last_deep_scrub":"33'2497","last_deep_scrub_stamp":"2024-05-06T06:55:38.729158+0000","last_clean_scrub_stamp":"2024-05-06T06:55:38.729158+0000","objects_scrubbed":21,"log_size":2497,"log_dups_size":0,"ondisk_log_size":2497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:11:02.240605+0000","scrub_duration":103,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78252880,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":52,"num_read_kb":42,"num_write":2515,"num_write_kb":118108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":69827576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:36.730857+0000","last_change":"2024-05-06T06:55:36.730917+0000","last_active":"2024-05-06T06:55:36.730857+0000","last_peered":"2024-05-06T06:55:36.730857+0000","last_clean":"2024-05-06T06:55:36.730857+0000","last_became_active":"2024-05-06T06:51:20.688666+0000","last_became_peered":"2024-05-06T06:51:20.688666+0000","last_unstale":"2024-05-06T06:55:36.730857+0000","last_undegraded":"2024-05-06T06:55:36.730857+0000","last_fullsized":"2024-05-06T06:55:36.730857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:55:36.730737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:55:36.730737+0000","last_clean_scrub_stamp":"2024-05-06T06:55:36.730737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:49:02.974185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"33'3873","reported_seq":4231,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:38.622570+0000","last_change":"2024-05-06T06:55:38.622691+0000","last_active":"2024-05-06T06:55:38.622570+0000","last_peered":"2024-05-06T06:55:38.622570+0000","last_clean":"2024-05-06T06:55:38.622570+0000","last_became_active":"2024-05-06T06:51:26.750274+0000","last_became_peered":"2024-05-06T06:51:26.750274+0000","last_unstale":"2024-05-06T06:55:38.622570+0000","last_undegraded":"2024-05-06T06:55:38.622570+0000","last_fullsized":"2024-05-06T06:55:38.622570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3873","last_scrub_stamp":"2024-05-06T06:55:38.622419+0000","last_deep_scrub":"33'3873","last_deep_scrub_stamp":"2024-05-06T06:55:38.622419+0000","last_clean_scrub_stamp":"2024-05-06T06:55:38.622419+0000","objects_scrubbed":24,"log_size":3873,"log_dups_size":0,"ondisk_log_size":3873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T18:24:25.463981+0000","scrub_duration":191,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92405760,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1046,"num_read_kb":996,"num_write":4130,"num_write_kb":185537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:35.650082+0000","last_change":"2024-05-06T06:55:35.650139+0000","last_active":"2024-05-06T06:55:35.650082+0000","last_peered":"2024-05-06T06:55:35.650082+0000","last_clean":"2024-05-06T06:55:35.650082+0000","last_became_active":"2024-05-06T06:51:20.783638+0000","last_became_peered":"2024-05-06T06:51:20.783638+0000","last_unstale":"2024-05-06T06:55:35.650082+0000","last_undegraded":"2024-05-06T06:55:35.650082+0000","last_fullsized":"2024-05-06T06:55:35.650082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:55:35.649931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:55:35.649931+0000","last_clean_scrub_stamp":"2024-05-06T06:55:35.649931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T17:36:10.379719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"33'3997","reported_seq":4047,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:38.534242+0000","last_change":"2024-05-06T06:55:38.534242+0000","last_active":"2024-05-06T06:55:38.534242+0000","last_peered":"2024-05-06T06:55:38.534242+0000","last_clean":"2024-05-06T06:55:38.534242+0000","last_became_active":"2024-05-06T06:52:23.740914+0000","last_became_peered":"2024-05-06T06:52:23.740914+0000","last_unstale":"2024-05-06T06:55:38.534242+0000","last_undegraded":"2024-05-06T06:55:38.534242+0000","last_fullsized":"2024-05-06T06:55:38.534242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3997","last_scrub_stamp":"2024-05-06T06:55:38.534034+0000","last_deep_scrub":"33'3997","last_deep_scrub_stamp":"2024-05-06T06:55:38.534034+0000","last_clean_scrub_stamp":"2024-05-06T06:55:38.534034+0000","objects_scrubbed":23,"log_size":3997,"log_dups_size":0,"ondisk_log_size":3997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:14:42.117223+0000","scrub_duration":259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93716480,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3945,"num_write_kb":170630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":106208624,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:44.149883+0000","last_change":"2024-05-06T06:55:44.149939+0000","last_active":"2024-05-06T06:55:44.149883+0000","last_peered":"2024-05-06T06:55:44.149883+0000","last_clean":"2024-05-06T06:55:44.149883+0000","last_became_active":"2024-05-06T06:52:13.882153+0000","last_became_peered":"2024-05-06T06:52:13.882153+0000","last_unstale":"2024-05-06T06:55:44.149883+0000","last_undegraded":"2024-05-06T06:55:44.149883+0000","last_fullsized":"2024-05-06T06:55:44.149883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:55:44.149700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:55:44.149700+0000","last_clean_scrub_stamp":"2024-05-06T06:55:44.149700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:30:16.743046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"33'3419","reported_seq":3486,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:41.195348+0000","last_change":"2024-05-06T06:55:41.195468+0000","last_active":"2024-05-06T06:55:41.195348+0000","last_peered":"2024-05-06T06:55:41.195348+0000","last_clean":"2024-05-06T06:55:41.195348+0000","last_became_active":"2024-05-06T06:51:26.759766+0000","last_became_peered":"2024-05-06T06:51:26.759766+0000","last_unstale":"2024-05-06T06:55:41.195348+0000","last_undegraded":"2024-05-06T06:55:41.195348+0000","last_fullsized":"2024-05-06T06:55:41.195348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3419","last_scrub_stamp":"2024-05-06T06:55:41.195186+0000","last_deep_scrub":"33'3419","last_deep_scrub_stamp":"2024-05-06T06:55:41.195186+0000","last_clean_scrub_stamp":"2024-05-06T06:55:41.195186+0000","objects_scrubbed":23,"log_size":3419,"log_dups_size":0,"ondisk_log_size":3419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:31:18.259625+0000","scrub_duration":267,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92275200,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":83,"num_read_kb":68,"num_write":3435,"num_write_kb":120903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:37.737047+0000","last_change":"2024-05-06T06:55:37.737102+0000","last_active":"2024-05-06T06:55:37.737047+0000","last_peered":"2024-05-06T06:55:37.737047+0000","last_clean":"2024-05-06T06:55:37.737047+0000","last_became_active":"2024-05-06T06:51:20.690621+0000","last_became_peered":"2024-05-06T06:51:20.690621+0000","last_unstale":"2024-05-06T06:55:37.737047+0000","last_undegraded":"2024-05-06T06:55:37.737047+0000","last_fullsized":"2024-05-06T06:55:37.737047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-06T06:55:37.736866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-06T06:55:37.736866+0000","last_clean_scrub_stamp":"2024-05-06T06:55:37.736866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T16:07:26.024691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"33'74","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:38.205377+0000","last_change":"2024-05-06T06:55:38.205457+0000","last_active":"2024-05-06T06:55:38.205377+0000","last_peered":"2024-05-06T06:55:38.205377+0000","last_clean":"2024-05-06T06:55:38.205377+0000","last_became_active":"2024-05-06T06:51:19.659348+0000","last_became_peered":"2024-05-06T06:51:19.659348+0000","last_unstale":"2024-05-06T06:55:38.205377+0000","last_undegraded":"2024-05-06T06:55:38.205377+0000","last_fullsized":"2024-05-06T06:55:38.205377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-05-06T06:55:38.205205+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-05-06T06:55:38.205205+0000","last_clean_scrub_stamp":"2024-05-06T06:55:38.205205+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:24:31.405310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"33'4411","reported_seq":4459,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:36.137792+0000","last_change":"2024-05-06T06:55:36.137792+0000","last_active":"2024-05-06T06:55:36.137792+0000","last_peered":"2024-05-06T06:55:36.137792+0000","last_clean":"2024-05-06T06:55:36.137792+0000","last_became_active":"2024-05-06T06:51:26.745914+0000","last_became_peered":"2024-05-06T06:51:26.745914+0000","last_unstale":"2024-05-06T06:55:36.137792+0000","last_undegraded":"2024-05-06T06:55:36.137792+0000","last_fullsized":"2024-05-06T06:55:36.137792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4411","last_scrub_stamp":"2024-05-06T06:55:36.137618+0000","last_deep_scrub":"33'4411","last_deep_scrub_stamp":"2024-05-06T06:55:36.137618+0000","last_clean_scrub_stamp":"2024-05-06T06:55:36.137618+0000","objects_scrubbed":30,"log_size":4411,"log_dups_size":0,"ondisk_log_size":4411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:04:55.032178+0000","scrub_duration":187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4306,"num_write_kb":201861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"33'9698","reported_seq":9856,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:37.662014+0000","last_change":"2024-05-06T06:55:37.662014+0000","last_active":"2024-05-06T06:55:37.662014+0000","last_peered":"2024-05-06T06:55:37.662014+0000","last_clean":"2024-05-06T06:55:37.662014+0000","last_became_active":"2024-05-06T06:51:26.756313+0000","last_became_peered":"2024-05-06T06:51:26.756313+0000","last_unstale":"2024-05-06T06:55:37.662014+0000","last_undegraded":"2024-05-06T06:55:37.662014+0000","last_fullsized":"2024-05-06T06:55:37.662014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9698","last_scrub_stamp":"2024-05-06T06:55:37.661682+0000","last_deep_scrub":"33'9698","last_deep_scrub_stamp":"2024-05-06T06:55:37.661682+0000","last_clean_scrub_stamp":"2024-05-06T06:55:37.661682+0000","objects_scrubbed":28,"log_size":9698,"log_dups_size":0,"ondisk_log_size":9698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T14:00:07.880854+0000","scrub_duration":483,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116760576,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":373,"num_read_kb":339,"num_write":7846,"num_write_kb":190590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'4806","reported_seq":4853,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:39.869448+0000","last_change":"2024-05-06T06:55:39.869448+0000","last_active":"2024-05-06T06:55:39.869448+0000","last_peered":"2024-05-06T06:55:39.869448+0000","last_clean":"2024-05-06T06:55:39.869448+0000","last_became_active":"2024-05-06T06:51:26.733532+0000","last_became_peered":"2024-05-06T06:51:26.733532+0000","last_unstale":"2024-05-06T06:55:39.869448+0000","last_undegraded":"2024-05-06T06:55:39.869448+0000","last_fullsized":"2024-05-06T06:55:39.869448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4806","last_scrub_stamp":"2024-05-06T06:55:39.869226+0000","last_deep_scrub":"33'4806","last_deep_scrub_stamp":"2024-05-06T06:55:39.869226+0000","last_clean_scrub_stamp":"2024-05-06T06:55:39.869226+0000","objects_scrubbed":23,"log_size":4806,"log_dups_size":0,"ondisk_log_size":4806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T14:38:29.333603+0000","scrub_duration":351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4754,"num_write_kb":177154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"33'3438","reported_seq":3487,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:37.032098+0000","last_change":"2024-05-06T06:55:37.032184+0000","last_active":"2024-05-06T06:55:37.032098+0000","last_peered":"2024-05-06T06:55:37.032098+0000","last_clean":"2024-05-06T06:55:37.032098+0000","last_became_active":"2024-05-06T06:51:26.750141+0000","last_became_peered":"2024-05-06T06:51:26.750141+0000","last_unstale":"2024-05-06T06:55:37.032098+0000","last_undegraded":"2024-05-06T06:55:37.032098+0000","last_fullsized":"2024-05-06T06:55:37.032098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3438","last_scrub_stamp":"2024-05-06T06:55:37.031994+0000","last_deep_scrub":"33'3438","last_deep_scrub_stamp":"2024-05-06T06:55:37.031994+0000","last_clean_scrub_stamp":"2024-05-06T06:55:37.031994+0000","objects_scrubbed":20,"log_size":3438,"log_dups_size":0,"ondisk_log_size":3438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:18:12.056446+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":13,"num_read_kb":9,"num_write":3420,"num_write_kb":144515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"33'3836","reported_seq":4028,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:42.006303+0000","last_change":"2024-05-06T06:55:42.006361+0000","last_active":"2024-05-06T06:55:42.006303+0000","last_peered":"2024-05-06T06:55:42.006303+0000","last_clean":"2024-05-06T06:55:42.006303+0000","last_became_active":"2024-05-06T06:52:19.741673+0000","last_became_peered":"2024-05-06T06:52:19.741673+0000","last_unstale":"2024-05-06T06:55:42.006303+0000","last_undegraded":"2024-05-06T06:55:42.006303+0000","last_fullsized":"2024-05-06T06:55:42.006303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3836","last_scrub_stamp":"2024-05-06T06:55:42.006196+0000","last_deep_scrub":"33'3836","last_deep_scrub_stamp":"2024-05-06T06:55:42.006196+0000","last_clean_scrub_stamp":"2024-05-06T06:55:42.006196+0000","objects_scrubbed":25,"log_size":3836,"log_dups_size":0,"ondisk_log_size":3836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:36:54.243349+0000","scrub_duration":331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96076832,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":110,"num_read_kb":108,"num_write":3780,"num_write_kb":136805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":58106356,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"33'5229","reported_seq":5285,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:43.640594+0000","last_change":"2024-05-06T06:55:43.640695+0000","last_active":"2024-05-06T06:55:43.640594+0000","last_peered":"2024-05-06T06:55:43.640594+0000","last_clean":"2024-05-06T06:55:43.640594+0000","last_became_active":"2024-05-06T06:51:26.752302+0000","last_became_peered":"2024-05-06T06:51:26.752302+0000","last_unstale":"2024-05-06T06:55:43.640594+0000","last_undegraded":"2024-05-06T06:55:43.640594+0000","last_fullsized":"2024-05-06T06:55:43.640594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5229","last_scrub_stamp":"2024-05-06T06:55:43.640414+0000","last_deep_scrub":"33'5229","last_deep_scrub_stamp":"2024-05-06T06:55:43.640414+0000","last_clean_scrub_stamp":"2024-05-06T06:55:43.640414+0000","objects_scrubbed":34,"log_size":5229,"log_dups_size":0,"ondisk_log_size":5229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:28:31.476744+0000","scrub_duration":523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134414856,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":5188,"num_write_kb":206925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"33'5679","reported_seq":5885,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:38.068717+0000","last_change":"2024-05-06T06:55:38.068760+0000","last_active":"2024-05-06T06:55:38.068717+0000","last_peered":"2024-05-06T06:55:38.068717+0000","last_clean":"2024-05-06T06:55:38.068717+0000","last_became_active":"2024-05-06T06:52:21.771225+0000","last_became_peered":"2024-05-06T06:52:21.771225+0000","last_unstale":"2024-05-06T06:55:38.068717+0000","last_undegraded":"2024-05-06T06:55:38.068717+0000","last_fullsized":"2024-05-06T06:55:38.068717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5679","last_scrub_stamp":"2024-05-06T06:55:38.068646+0000","last_deep_scrub":"33'5679","last_deep_scrub_stamp":"2024-05-06T06:55:38.068646+0000","last_clean_scrub_stamp":"2024-05-06T06:55:38.068646+0000","objects_scrubbed":32,"log_size":5679,"log_dups_size":0,"ondisk_log_size":5679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T13:26:07.441595+0000","scrub_duration":447,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132775936,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":300,"num_read_kb":235,"num_write":5895,"num_write_kb":245104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":117780368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"33'4186","reported_seq":4237,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:42.506708+0000","last_change":"2024-05-06T06:55:42.506795+0000","last_active":"2024-05-06T06:55:42.506708+0000","last_peered":"2024-05-06T06:55:42.506708+0000","last_clean":"2024-05-06T06:55:42.506708+0000","last_became_active":"2024-05-06T06:51:26.748874+0000","last_became_peered":"2024-05-06T06:51:26.748874+0000","last_unstale":"2024-05-06T06:55:42.506708+0000","last_undegraded":"2024-05-06T06:55:42.506708+0000","last_fullsized":"2024-05-06T06:55:42.506708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4186","last_scrub_stamp":"2024-05-06T06:55:42.506600+0000","last_deep_scrub":"33'4186","last_deep_scrub_stamp":"2024-05-06T06:55:42.506600+0000","last_clean_scrub_stamp":"2024-05-06T06:55:42.506600+0000","objects_scrubbed":23,"log_size":4186,"log_dups_size":0,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T11:16:50.803456+0000","scrub_duration":355,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90965840,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":4127,"num_write_kb":138968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"33'3955","reported_seq":4003,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:38.952431+0000","last_change":"2024-05-06T06:55:38.952505+0000","last_active":"2024-05-06T06:55:38.952431+0000","last_peered":"2024-05-06T06:55:38.952431+0000","last_clean":"2024-05-06T06:55:38.952431+0000","last_became_active":"2024-05-06T06:51:26.725309+0000","last_became_peered":"2024-05-06T06:51:26.725309+0000","last_unstale":"2024-05-06T06:55:38.952431+0000","last_undegraded":"2024-05-06T06:55:38.952431+0000","last_fullsized":"2024-05-06T06:55:38.952431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3955","last_scrub_stamp":"2024-05-06T06:55:38.952260+0000","last_deep_scrub":"33'3955","last_deep_scrub_stamp":"2024-05-06T06:55:38.952260+0000","last_clean_scrub_stamp":"2024-05-06T06:55:38.952260+0000","objects_scrubbed":30,"log_size":3955,"log_dups_size":0,"ondisk_log_size":3955,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T08:00:45.498785+0000","scrub_duration":435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124452864,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3876,"num_write_kb":158405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"33'4239","reported_seq":4316,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:42.035840+0000","last_change":"2024-05-06T06:55:42.035885+0000","last_active":"2024-05-06T06:55:42.035840+0000","last_peered":"2024-05-06T06:55:42.035840+0000","last_clean":"2024-05-06T06:55:42.035840+0000","last_became_active":"2024-05-06T06:52:22.744107+0000","last_became_peered":"2024-05-06T06:52:22.744107+0000","last_unstale":"2024-05-06T06:55:42.035840+0000","last_undegraded":"2024-05-06T06:55:42.035840+0000","last_fullsized":"2024-05-06T06:55:42.035840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4239","last_scrub_stamp":"2024-05-06T06:55:42.035770+0000","last_deep_scrub":"33'4239","last_deep_scrub_stamp":"2024-05-06T06:55:42.035770+0000","last_clean_scrub_stamp":"2024-05-06T06:55:42.035770+0000","objects_scrubbed":34,"log_size":4239,"log_dups_size":0,"ondisk_log_size":4239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T10:48:14.856616+0000","scrub_duration":511,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134479872,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":45,"num_read_kb":96,"num_write":4222,"num_write_kb":185991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":117274564,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"33'4062","reported_seq":4111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:40.887355+0000","last_change":"2024-05-06T06:55:40.887435+0000","last_active":"2024-05-06T06:55:40.887355+0000","last_peered":"2024-05-06T06:55:40.887355+0000","last_clean":"2024-05-06T06:55:40.887355+0000","last_became_active":"2024-05-06T06:52:18.751926+0000","last_became_peered":"2024-05-06T06:52:18.751926+0000","last_unstale":"2024-05-06T06:55:40.887355+0000","last_undegraded":"2024-05-06T06:55:40.887355+0000","last_fullsized":"2024-05-06T06:55:40.887355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4062","last_scrub_stamp":"2024-05-06T06:55:40.887191+0000","last_deep_scrub":"33'4062","last_deep_scrub_stamp":"2024-05-06T06:55:40.887191+0000","last_clean_scrub_stamp":"2024-05-06T06:55:40.887191+0000","objects_scrubbed":30,"log_size":4062,"log_dups_size":0,"ondisk_log_size":4062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T07:46:41.825106+0000","scrub_duration":487,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3984,"num_write_kb":181381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":113149924,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"33'10544","reported_seq":10604,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-06T06:55:42.016280+0000","last_change":"2024-05-06T06:55:42.016342+0000","last_active":"2024-05-06T06:55:42.016280+0000","last_peered":"2024-05-06T06:55:42.016280+0000","last_clean":"2024-05-06T06:55:42.016280+0000","last_became_active":"2024-05-06T06:51:26.749358+0000","last_became_peered":"2024-05-06T06:51:26.749358+0000","last_unstale":"2024-05-06T06:55:42.016280+0000","last_undegraded":"2024-05-06T06:55:42.016280+0000","last_fullsized":"2024-05-06T06:55:42.016280+0000","mapping_epoch":19,"log_start":"21'500","ondisk_log_start":"21'500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10544","last_scrub_stamp":"2024-05-06T06:55:42.016206+0000","last_deep_scrub":"33'10544","last_deep_scrub_stamp":"2024-05-06T06:55:42.016206+0000","last_clean_scrub_stamp":"2024-05-06T06:55:42.016206+0000","objects_scrubbed":46,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-07T09:33:03.496703+0000","scrub_duration":815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188874752,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":54,"num_read_kb":41,"num_write":10494,"num_write_kb":304731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3568152824,"num_objects":877,"num_object_clones":0,"num_object_copies":1754,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":877,"num_whiteouts":0,"num_read":2560,"num_read_kb":2576,"num_write":157289,"num_write_kb":5626821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":803710944,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6838648832,"data_stored":6834389112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159277,"ondisk_log_size":159277,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1242400,"kb_used_data":926744,"kb_used_omap":1,"kb_used_meta":315646,"kb_avail":93129440,"statfs":{"total":96636764160,"available":95364546560,"internally_reserved":0,"allocated":948985856,"data_stored":948138510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":323221962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1380420,"kb_used_data":1006460,"kb_used_omap":1,"kb_used_meta":373950,"kb_avail":92991420,"statfs":{"total":96636764160,"available":95223214080,"internally_reserved":0,"allocated":1030615040,"data_stored":1029728434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":382925253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":840984,"kb_used_data":729360,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":93530856,"statfs":{"total":96636764160,"available":95775596544,"internally_reserved":0,"allocated":746864640,"data_stored":746093138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114293190},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542202,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048204,"kb_used_data":796356,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93323636,"statfs":{"total":96636764160,"available":95563403264,"internally_reserved":0,"allocated":815468544,"data_stored":814794234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257882567},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542205,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1155428,"kb_used_data":903580,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":93216412,"statfs":{"total":96636764160,"available":95453605888,"internally_reserved":0,"allocated":925265920,"data_stored":924512030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257882567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":830984,"kb_used_data":687424,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":93540856,"statfs":{"total":96636764160,"available":95785836544,"internally_reserved":0,"allocated":703922176,"data_stored":703329314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542201,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":926164,"kb_used_data":742348,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":93445676,"statfs":{"total":96636764160,"available":95688372224,"internally_reserved":0,"allocated":760164352,"data_stored":759561582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1168008,"kb_used_data":889792,"kb_used_omap":1,"kb_used_meta":278206,"kb_avail":93203832,"statfs":{"total":96636764160,"available":95440723968,"internally_reserved":0,"allocated":911147008,"data_stored":910287118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":284883397},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":910274560,"data_stored":909633516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":759824384,"data_stored":759436908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":703582208,"data_stored":703204640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":924925952,"data_stored":924387356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1030275072,"data_stored":1029603760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":815128576,"data_stored":814669560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":746524672,"data_stored":745968464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":948113408,"data_stored":947484908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-06T06:55:58.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-06T06:55:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb4823e640 1 Processor -- start 2024-05-06T06:55:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb4823e640 1 -- start start 2024-05-06T06:55:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb4823e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb40142310 con 0x7fdb40141d30 2024-05-06T06:55:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb4823e640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb40138650 con 0x7fdb400aaf90 2024-05-06T06:55:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb4823e640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb400ab500 con 0x7fdb40138270 2024-05-06T06:55:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb45fda640 1 --1- >> v1:172.21.15.70:6790/0 conn(0x7fdb40138270 0x7fdb400aa880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.70:6790/0 says I am v1:172.21.15.70:44964/0 (socket says 172.21.15.70:44964) 2024-05-06T06:55:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb45fda640 1 -- 172.21.15.70:0/4269188584 learned_addr learned my addr 172.21.15.70:0/4269188584 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb44fd8640 1 -- 172.21.15.70:0/4269188584 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4205242690 0 0) 0x7fdb400ab500 con 0x7fdb40138270 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb44fd8640 1 -- 172.21.15.70:0/4269188584 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb2c003530 con 0x7fdb40138270 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb44fd8640 1 -- 172.21.15.70:0/4269188584 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258201520 0 0) 0x7fdb40142310 con 0x7fdb40141d30 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb44fd8640 1 -- 172.21.15.70:0/4269188584 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb400ab500 con 0x7fdb40141d30 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb44fd8640 1 -- 172.21.15.70:0/4269188584 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 143374147 0 0) 0x7fdb2c003530 con 0x7fdb40138270 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb44fd8640 1 -- 172.21.15.70:0/4269188584 >> v1:172.21.15.184:6789/0 conn(0x7fdb400aaf90 legacy=0x7fdb40070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb44fd8640 1 -- 172.21.15.70:0/4269188584 >> v1:172.21.15.70:6789/0 conn(0x7fdb40141d30 legacy=0x7fdb40070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb44fd8640 1 -- 172.21.15.70:0/4269188584 --> v1:172.21.15.70:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb401511b0 con 0x7fdb40138270 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb44fd8640 1 -- 172.21.15.70:0/4269188584 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdb3c0016a0 con 0x7fdb40138270 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb44fd8640 1 -- 172.21.15.70:0/4269188584 <== mon.2 v1:172.21.15.70:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb3c0018c0 con 0x7fdb40138270 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb44fd8640 1 -- 172.21.15.70:0/4269188584 <== mon.2 v1:172.21.15.70:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdb3c001d10 con 0x7fdb40138270 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb4823e640 1 -- 172.21.15.70:0/4269188584 >> v1:172.21.15.70:6790/0 conn(0x7fdb40138270 legacy=0x7fdb400aa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb4823e640 1 -- 172.21.15.70:0/4269188584 shutdown_connections 2024-05-06T06:55:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb4823e640 1 -- 172.21.15.70:0/4269188584 >> 172.21.15.70:0/4269188584 conn(0x7fdb400b1db0 msgr2=0x7fdb400b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb4823e640 1 -- 172.21.15.70:0/4269188584 shutdown_connections 2024-05-06T06:55:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb4823e640 1 -- 172.21.15.70:0/4269188584 wait complete. 2024-05-06T06:55:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.434+0000 7fdb4823e640 1 Processor -- start 2024-05-06T06:55:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb4823e640 1 -- start start 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb4823e640 1 -- --> v1:172.21.15.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb40129d70 con 0x7fdb40141d30 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb4823e640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb4013cfe0 con 0x7fdb400aaf90 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb4823e640 1 -- --> v1:172.21.15.70:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb4013db70 con 0x7fdb40138270 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb467db640 1 --1- >> v1:172.21.15.70:6789/0 conn(0x7fdb40141d30 0x7fdb40129660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.70:6789/0 says I am v1:172.21.15.70:50180/0 (socket says 172.21.15.70:50180) 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb467db640 1 -- 172.21.15.70:0/3081622976 learned_addr learned my addr 172.21.15.70:0/3081622976 (peer_addr_for_me v1:172.21.15.70:0/0) 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.0 v1:172.21.15.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880405418 0 0) 0x7fdb40129d70 con 0x7fdb40141d30 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 --> v1:172.21.15.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb24003530 con 0x7fdb40141d30 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.2 v1:172.21.15.70:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3425752815 0 0) 0x7fdb4013db70 con 0x7fdb40138270 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 --> v1:172.21.15.70:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb40129d70 con 0x7fdb40138270 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.0 v1:172.21.15.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 341480578 0 0) 0x7fdb24003530 con 0x7fdb40141d30 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 --> v1:172.21.15.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb4013db70 con 0x7fdb40141d30 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.0 v1:172.21.15.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdb38001d20 con 0x7fdb40141d30 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.2 v1:172.21.15.70:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1518204735 0 0) 0x7fdb40129d70 con 0x7fdb40138270 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 --> v1:172.21.15.70:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb24003530 con 0x7fdb40138270 2024-05-06T06:55:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.2 v1:172.21.15.70:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdb30001810 con 0x7fdb40138270 2024-05-06T06:55:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738284787 0 0) 0x7fdb4013cfe0 con 0x7fdb400aaf90 2024-05-06T06:55:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb40129d70 con 0x7fdb400aaf90 2024-05-06T06:55:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.0 v1:172.21.15.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4139351156 0 0) 0x7fdb4013db70 con 0x7fdb40141d30 2024-05-06T06:55:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 >> v1:172.21.15.70:6790/0 conn(0x7fdb40138270 legacy=0x7fdb40128f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 >> v1:172.21.15.184:6789/0 conn(0x7fdb400aaf90 legacy=0x7fdb4013bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 --> v1:172.21.15.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4013de50 con 0x7fdb40141d30 2024-05-06T06:55:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb4823e640 1 -- 172.21.15.70:0/3081622976 --> v1:172.21.15.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdb4013b7c0 con 0x7fdb40141d30 2024-05-06T06:55:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb4823e640 1 -- 172.21.15.70:0/3081622976 --> v1:172.21.15.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdb4012c260 con 0x7fdb40141d30 2024-05-06T06:55:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb4823e640 1 -- 172.21.15.70:0/3081622976 --> v1:172.21.15.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb400640c0 con 0x7fdb40141d30 2024-05-06T06:55:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.0 v1:172.21.15.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb38002020 con 0x7fdb40141d30 2024-05-06T06:55:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.0 v1:172.21.15.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3983474197 0 0) 0x7fdb38003df0 con 0x7fdb40141d30 2024-05-06T06:55:58.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.0 v1:172.21.15.70:6789/0 7 ==== mgrmap(e 5) ==== 93172+0+0 (unknown 3641477176 0 0) 0x7fdb38004050 con 0x7fdb40141d30 2024-05-06T06:55:58.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.438+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.0 v1:172.21.15.70:6789/0 8 ==== osd_map(33..33 src has 1..33) ==== 4815+0+0 (unknown 2547244053 0 0) 0x7fdb3808ac70 con 0x7fdb40141d30 2024-05-06T06:55:58.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.442+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.0 v1:172.21.15.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (unknown 1092875540 0 3237491991) 0x7fdb38057e00 con 0x7fdb40141d30 2024-05-06T06:55:58.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.594+0000 7fdb4823e640 1 -- 172.21.15.70:0/3081622976 --> v1:172.21.15.70:6789/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fdb40142980 con 0x7fdb40141d30 2024-05-06T06:55:58.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.598+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.0 v1:172.21.15.70:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v5)=0 v5) ==== 123+0+0 (unknown 4099060384 0 0) 0x7fdb38057700 con 0x7fdb40141d30 2024-05-06T06:55:58.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.598+0000 7fdb367fc640 1 -- 172.21.15.70:0/3081622976 <== mon.0 v1:172.21.15.70:6789/0 11 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7fdb38057210 con 0x7fdb40141d30 2024-05-06T06:55:58.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.598+0000 7fdb4823e640 1 -- 172.21.15.70:0/3081622976 >> v1:172.21.15.70:6816/2757942729 conn(0x7fdb24070100 legacy=0x7fdb240725c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.598+0000 7fdb4823e640 1 -- 172.21.15.70:0/3081622976 >> v1:172.21.15.70:6789/0 conn(0x7fdb40141d30 legacy=0x7fdb40129660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-06T06:55:58.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.598+0000 7fdb4823e640 1 -- 172.21.15.70:0/3081622976 shutdown_connections 2024-05-06T06:55:58.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.598+0000 7fdb4823e640 1 -- 172.21.15.70:0/3081622976 >> 172.21.15.70:0/3081622976 conn(0x7fdb400b1db0 msgr2=0x7fdb40140250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-06T06:55:58.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.598+0000 7fdb4823e640 1 -- 172.21.15.70:0/3081622976 shutdown_connections 2024-05-06T06:55:58.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-06T06:55:58.598+0000 7fdb4823e640 1 -- 172.21.15.70:0/3081622976 wait complete. 2024-05-06T06:55:58.620 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-06T06:55:58.620 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-06T06:55:58.620 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-06T06:55:58.621 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:55:58.702 INFO:tasks.ceph.osd.0:Stopped 2024-05-06T06:55:58.702 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-06T06:55:58.702 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:55:58.798 INFO:tasks.ceph.osd.1:Stopped 2024-05-06T06:55:58.798 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-06T06:55:58.798 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:56:04.900 INFO:tasks.ceph.osd.2:Stopped 2024-05-06T06:56:04.900 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-06T06:56:04.900 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:56:04.990 INFO:tasks.ceph.osd.3:Stopped 2024-05-06T06:56:04.990 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-06T06:56:04.991 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:56:05.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-06T06:56:11.093 INFO:tasks.ceph.osd.4:Stopped 2024-05-06T06:56:11.093 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-06T06:56:11.093 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:56:11.167 INFO:tasks.ceph.osd.5:Stopped 2024-05-06T06:56:11.167 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-06T06:56:11.167 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:56:11.258 INFO:tasks.ceph.osd.6:Stopped 2024-05-06T06:56:11.258 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-06T06:56:11.259 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:56:11.358 INFO:tasks.ceph.osd.7:Stopped 2024-05-06T06:56:11.358 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-06T06:56:11.359 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-06T06:56:11.359 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:56:11.403 INFO:tasks.ceph.mgr.y:Stopped 2024-05-06T06:56:11.404 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-06T06:56:11.404 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:56:11.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-06T06:56:11.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-05-06T06:56:11.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-06T06:56:11.432 INFO:tasks.ceph.mgr.x:Stopped 2024-05-06T06:56:11.432 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-06T06:56:11.433 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-06T06:56:11.433 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:56:11.446 INFO:tasks.ceph.mon.a:Stopped 2024-05-06T06:56:11.446 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-06T06:56:11.446 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:56:11.501 INFO:tasks.ceph.mon.c:Stopped 2024-05-06T06:56:11.502 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-06T06:56:11.502 INFO:teuthology.orchestra.run:waiting for 300 2024-05-06T06:56:11.520 INFO:tasks.ceph.mon.b:Stopped 2024-05-06T06:56:11.520 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-06T06:56:11.520 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | head -n 1 2024-05-06T06:56:11.558 INFO:teuthology.orchestra.run.smithi070.stdout:2024-05-06T06:52:16.855925+0000 mon.a (mon.0) 251 : cluster [WRN] Health check failed: Degraded data redundancy: 1/1332 objects degraded (0.075%), 1 pg degraded (PG_DEGRADED) 2024-05-06T06:56:11.558 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-05-06T06:56:11.558 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | head -n 1 2024-05-06T06:56:11.613 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | head -n 1 2024-05-06T06:56:11.668 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | head -n 1 2024-05-06T06:56:11.724 INFO:teuthology.orchestra.run.smithi070.stdout:2024-05-06T06:52:16.855925+0000 mon.a (mon.0) 251 : cluster [WRN] Health check failed: Degraded data redundancy: 1/1332 objects degraded (0.075%), 1 pg degraded (PG_DEGRADED) 2024-05-06T06:56:11.724 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:56:11.724 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-06T06:56:12.059 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:56:12.059 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-06T06:56:12.288 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:56:12.288 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-06T06:56:12.473 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:56:12.473 DEBUG:teuthology.orchestra.run.smithi070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-06T06:56:12.654 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi184.front.sepia.ceph.com 2024-05-06T06:56:12.654 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-06T06:56:13.033 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi184.front.sepia.ceph.com 2024-05-06T06:56:13.034 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-06T06:56:13.237 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi184.front.sepia.ceph.com 2024-05-06T06:56:13.237 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-06T06:56:13.425 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi184.front.sepia.ceph.com 2024-05-06T06:56:13.425 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-06T06:56:13.611 INFO:tasks.ceph:Archiving mon data... 2024-05-06T06:56:13.612 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280/data/mon.a.tgz 2024-05-06T06:56:13.613 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-05-06T06:56:13.619 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.SgekvCGLQ3 2024-05-06T06:56:13.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SgekvCGLQ3 2024-05-06T06:56:13.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.SgekvCGLQ3 2024-05-06T06:56:13.792 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.SgekvCGLQ3 is 309KB 2024-05-06T06:56:13.854 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.SgekvCGLQ3 2024-05-06T06:56:13.859 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280/data/mon.c.tgz 2024-05-06T06:56:13.859 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-05-06T06:56:13.905 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.JAWTTScnSf 2024-05-06T06:56:13.905 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.JAWTTScnSf 2024-05-06T06:56:14.019 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.JAWTTScnSf 2024-05-06T06:56:14.081 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.JAWTTScnSf is 312KB 2024-05-06T06:56:14.138 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.JAWTTScnSf 2024-05-06T06:56:14.143 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280/data/mon.b.tgz 2024-05-06T06:56:14.143 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-05-06T06:56:14.149 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.hktgpXuiFA 2024-05-06T06:56:14.149 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hktgpXuiFA 2024-05-06T06:56:14.262 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.hktgpXuiFA 2024-05-06T06:56:14.325 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.hktgpXuiFA is 312KB 2024-05-06T06:56:14.387 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.hktgpXuiFA 2024-05-06T06:56:14.392 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-06T06:56:14.392 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-06T06:56:14.395 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-06T06:56:14.455 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-06T06:56:14.497 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-06T06:56:14.498 INFO:tasks.ceph:Archiving crash dumps... 2024-05-06T06:56:14.499 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280/remote/smithi070/crash 2024-05-06T06:56:14.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-06T06:56:14.514 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280/remote/smithi184/crash 2024-05-06T06:56:14.515 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-06T06:56:14.552 INFO:tasks.ceph:Compressing logs... 2024-05-06T06:56:14.553 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-06T06:56:14.562 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-06T06:56:14.591 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.30163.log 2024-05-06T06:56:14.591 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-06T06:56:14.592 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.libcephsqlite.30163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28991.log 2024-05-06T06:56:14.592 INFO:teuthology.orchestra.run.smithi070.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.30163.log.gz 2024-05-06T06:56:14.593 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30558.log 2024-05-06T06:56:14.593 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30766.log 2024-05-06T06:56:14.594 INFO:teuthology.orchestra.run.smithi070.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28991.log.gz 2024-05-06T06:56:14.594 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30558.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-06T06:56:14.594 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29413.log 2024-05-06T06:56:14.594 INFO:teuthology.orchestra.run.smithi070.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30558.log.gz 2024-05-06T06:56:14.594 INFO:teuthology.orchestra.run.smithi070.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30766.log.gz 2024-05-06T06:56:14.594 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30972.log 2024-05-06T06:56:14.595 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.30121.log 2024-05-06T06:56:14.595 INFO:teuthology.orchestra.run.smithi070.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.29413.log.gz 2024-05-06T06:56:14.595 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29416.log 2024-05-06T06:56:14.595 INFO:teuthology.orchestra.run.smithi070.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30972.log.gz 2024-05-06T06:56:14.595 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29630.log 2024-05-06T06:56:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.libcephsqlite.30121.log: /var/log/ceph/ceph-client.admin.29416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.30287.log 2024-05-06T06:56:14.598 INFO:teuthology.orchestra.run.smithi070.stderr: 86.6%/var/log/ceph/ceph-client.admin.29630.log: -- replaced with /var/log/ceph/ceph-client.admin.29416.log.gz 2024-05-06T06:56:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.30307.log 2024-05-06T06:56:14.598 INFO:teuthology.orchestra.run.smithi070.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29630.log.gz 2024-05-06T06:56:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.30261.log 2024-05-06T06:56:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.libcephsqlite.30287.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-06T06:56:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.libcephsqlite.30307.log: /var/log/ceph/ceph-client.libcephsqlite.30261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30688.log 2024-05-06T06:56:14.598 INFO:teuthology.orchestra.run.smithi070.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.30307.log.gz 2024-05-06T06:56:14.599 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28776.log 2024-05-06T06:56:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.30688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29203.log 2024-05-06T06:56:14.602 INFO:teuthology.orchestra.run.smithi070.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30688.log.gz/var/log/ceph/ceph-client.admin.28776.log: 2024-05-06T06:56:14.602 INFO:teuthology.orchestra.run.smithi070.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.28776.log.gz 2024-05-06T06:56:14.602 INFO:teuthology.orchestra.run.smithi070.stderr: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-06T06:56:14.602 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.libcephsqlite.30121.log.gz 2024-05-06T06:56:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29006.log 2024-05-06T06:56:14.602 INFO:teuthology.orchestra.run.smithi070.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29203.log.gz 2024-05-06T06:56:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28803.log 2024-05-06T06:56:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29426.log 2024-05-06T06:56:14.602 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28803.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29006.log.gz 2024-05-06T06:56:14.602 INFO:teuthology.orchestra.run.smithi070.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.28803.log.gz 2024-05-06T06:56:14.605 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30610.log 2024-05-06T06:56:14.605 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25379.log 2024-05-06T06:56:14.606 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30610.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29426.log.gz 2024-05-06T06:56:14.606 INFO:teuthology.orchestra.run.smithi070.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30610.log.gz 2024-05-06T06:56:14.606 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29007.log 2024-05-06T06:56:14.606 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28997.log 2024-05-06T06:56:14.606 INFO:teuthology.orchestra.run.smithi070.stderr: 87.0%/var/log/ceph/ceph-client.admin.29007.log: -- replaced with /var/log/ceph/ceph-client.admin.25379.log.gz 2024-05-06T06:56:14.606 INFO:teuthology.orchestra.run.smithi070.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29007.log.gz 2024-05-06T06:56:14.608 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30532.log 2024-05-06T06:56:14.608 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30740.log 2024-05-06T06:56:14.608 INFO:teuthology.orchestra.run.smithi070.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28997.log.gz 2024-05-06T06:56:14.608 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30532.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30532.log.gz 2024-05-06T06:56:14.608 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30870.log 2024-05-06T06:56:14.608 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28954.log 2024-05-06T06:56:14.609 INFO:teuthology.orchestra.run.smithi070.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30740.log.gz 2024-05-06T06:56:14.609 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30870.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30870.log.gz 2024-05-06T06:56:14.609 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30948.log 2024-05-06T06:56:14.609 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.30373.log 2024-05-06T06:56:14.610 INFO:teuthology.orchestra.run.smithi070.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.28954.log.gz 2024-05-06T06:56:14.611 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29197.log 2024-05-06T06:56:14.611 INFO:teuthology.orchestra.run.smithi070.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30948.log.gz/var/log/ceph/ceph-client.libcephsqlite.30373.log: 2024-05-06T06:56:14.611 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.29731.log 2024-05-06T06:56:14.612 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29197.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29197.log.gz 2024-05-06T06:56:14.612 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-06T06:56:14.613 INFO:teuthology.orchestra.run.smithi070.stderr: 90.5%/var/log/ceph/ceph-client.libcephsqlite.29731.log: -- replaced with /var/log/ceph/ceph-client.libcephsqlite.30373.log.gz 2024-05-06T06:56:14.613 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29216.log 2024-05-06T06:56:14.615 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25336.log 2024-05-06T06:56:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.3.log: 95.2% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.30287.log.gz 2024-05-06T06:56:14.617 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30922.log 2024-05-06T06:56:14.618 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25240.log 2024-05-06T06:56:14.619 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25336.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-06T06:56:14.619 INFO:teuthology.orchestra.run.smithi184.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25336.log.gz 2024-05-06T06:56:14.619 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25240.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.25240.log.gz 2024-05-06T06:56:14.619 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-06T06:56:14.619 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25312.log 2024-05-06T06:56:14.619 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25264.log 2024-05-06T06:56:14.619 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.25312.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-06T06:56:14.619 INFO:teuthology.orchestra.run.smithi184.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.25312.log.gz 2024-05-06T06:56:14.619 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25288.log 2024-05-06T06:56:14.619 INFO:teuthology.orchestra.run.smithi184.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.25264.log.gz 2024-05-06T06:56:14.619 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-06T06:56:14.627 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25288.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-06T06:56:14.627 INFO:teuthology.orchestra.run.smithi184.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.25288.log.gz 2024-05-06T06:56:14.627 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25192.log 2024-05-06T06:56:14.627 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-06T06:56:14.627 INFO:teuthology.orchestra.run.smithi184.stderr:gzip/var/log/ceph/ceph-client.admin.25192.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.25168.log 2024-05-06T06:56:14.627 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.audit.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.25192.log.gz 2024-05-06T06:56:14.627 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-06T06:56:14.627 INFO:teuthology.orchestra.run.smithi184.stderr: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-06T06:56:14.627 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.25168.log: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-06T06:56:14.627 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-06T06:56:14.627 INFO:teuthology.orchestra.run.smithi184.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25168.log.gz/var/log/ceph/ceph-mon.b.log: 2024-05-06T06:56:14.628 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25216.log 2024-05-06T06:56:14.628 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.25216.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25216.log.gz 2024-05-06T06:56:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29216.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29216.log.gz 2024-05-06T06:56:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29425.log 2024-05-06T06:56:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30922.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30922.log.gz 2024-05-06T06:56:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29404.log 2024-05-06T06:56:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29425.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29425.log.gz 2024-05-06T06:56:14.629 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29198.log 2024-05-06T06:56:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29404.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29404.log.gz 2024-05-06T06:56:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29604.log 2024-05-06T06:56:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29198.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29198.log.gz 2024-05-06T06:56:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25118.log 2024-05-06T06:56:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29604.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29604.log.gz 2024-05-06T06:56:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28830.log 2024-05-06T06:56:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25118.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25118.log.gz 2024-05-06T06:56:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28928.log 2024-05-06T06:56:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28830.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.28830.log.gz 2024-05-06T06:56:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-06T06:56:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28928.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28928.log.gz 2024-05-06T06:56:14.630 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30402.log 2024-05-06T06:56:14.631 INFO:teuthology.orchestra.run.smithi184.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-06T06:56:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.30330.log 2024-05-06T06:56:14.637 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30402.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30402.log.gz 2024-05-06T06:56:14.644 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.30186.log 2024-05-06T06:56:14.664 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.libcephsqlite.30330.log: 90.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-06T06:56:14.665 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.30238.log 2024-05-06T06:56:14.680 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.libcephsqlite.30186.log: 91.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29003.log 2024-05-06T06:56:14.682 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.libcephsqlite.30238.log: 87.8% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.30238.log.gz 2024-05-06T06:56:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25297.log 2024-05-06T06:56:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29003.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29003.log.gz 2024-05-06T06:56:14.697 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.libcephsqlite.30186.log.gz 2024-05-06T06:56:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29680.log 2024-05-06T06:56:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.25297.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.25297.log.gz 2024-05-06T06:56:14.705 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30636.log 2024-05-06T06:56:14.705 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29680.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29680.log.gz 2024-05-06T06:56:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.30218.log 2024-05-06T06:56:14.721 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30636.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30636.log.gz 2024-05-06T06:56:14.723 INFO:teuthology.orchestra.run.smithi184.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-06T06:56:14.737 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-06T06:56:14.749 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.libcephsqlite.30218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30844.log 2024-05-06T06:56:14.751 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.log: 94.6% 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-06T06:56:14.757 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.30142.log 2024-05-06T06:56:14.757 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30844.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30844.log.gz 2024-05-06T06:56:14.764 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/ceph-client.libcephsqlite.30218.log.gz 2024-05-06T06:56:14.772 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29707.log 2024-05-06T06:56:14.773 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.libcephsqlite.30142.log: 87.8% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.30142.log.gz 2024-05-06T06:56:14.784 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30662.log 2024-05-06T06:56:14.785 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29707.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29707.log.gz 2024-05-06T06:56:14.796 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30818.log 2024-05-06T06:56:14.797 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30662.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30662.log.gz 2024-05-06T06:56:14.820 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-06T06:56:14.821 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30818.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30818.log.gz 2024-05-06T06:56:14.832 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29403.log 2024-05-06T06:56:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30714.log 2024-05-06T06:56:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29403.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29403.log.gz 2024-05-06T06:56:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30506.log 2024-05-06T06:56:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30714.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30714.log.gz 2024-05-06T06:56:14.881 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29208.log 2024-05-06T06:56:14.881 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30506.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30506.log.gz 2024-05-06T06:56:14.892 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29415.log 2024-05-06T06:56:14.893 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29208.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29208.log.gz 2024-05-06T06:56:14.912 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-06T06:56:14.913 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29415.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29415.log.gz 2024-05-06T06:56:14.924 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30896.log 2024-05-06T06:56:14.926 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.audit.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-06T06:56:14.930 INFO:teuthology.orchestra.run.smithi070.stderr: 89.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-06T06:56:14.936 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29396.log 2024-05-06T06:56:14.937 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30896.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30896.log.gz 2024-05-06T06:56:14.938 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30454.log 2024-05-06T06:56:14.939 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29396.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29396.log.gz 2024-05-06T06:56:14.939 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20342.log 2024-05-06T06:56:14.940 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30454.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30454.log.gz 2024-05-06T06:56:14.940 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28902.log 2024-05-06T06:56:14.942 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph.tmp-client.admin.20342.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20342.log.gz 2024-05-06T06:56:14.944 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29656.log 2024-05-06T06:56:14.945 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.28902.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28902.log.gz 2024-05-06T06:56:14.945 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29204.log 2024-05-06T06:56:14.945 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29656.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29656.log.gz 2024-05-06T06:56:14.945 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30428.log 2024-05-06T06:56:14.945 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29204.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29204.log.gz 2024-05-06T06:56:14.945 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29192.log 2024-05-06T06:56:14.946 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30428.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30428.log.gz 2024-05-06T06:56:14.946 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29008.log 2024-05-06T06:56:14.947 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29192.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29192.log.gz 2024-05-06T06:56:14.947 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30792.log 2024-05-06T06:56:14.948 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29008.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29008.log.gz 2024-05-06T06:56:14.948 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29215.log 2024-05-06T06:56:14.949 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30792.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30792.log.gz 2024-05-06T06:56:14.949 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.libcephsqlite.30099.log 2024-05-06T06:56:14.950 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29215.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.29215.log.gz 2024-05-06T06:56:14.950 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30480.log 2024-05-06T06:56:14.951 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.libcephsqlite.30099.log: 87.8% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.30099.log.gz 2024-05-06T06:56:14.952 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29002.log 2024-05-06T06:56:14.953 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30480.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30480.log.gz 2024-05-06T06:56:14.953 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29005.log 2024-05-06T06:56:14.954 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29002.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29002.log.gz 2024-05-06T06:56:14.954 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30584.log 2024-05-06T06:56:14.955 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.29005.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.29005.log.gz 2024-05-06T06:56:14.957 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.admin.30584.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30584.log.gz 2024-05-06T06:56:15.048 INFO:teuthology.orchestra.run.smithi070.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-06T06:56:15.309 INFO:teuthology.orchestra.run.smithi070.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.30261.log.gz 2024-05-06T06:56:15.857 INFO:teuthology.orchestra.run.smithi070.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.30330.log.gz 2024-05-06T06:56:16.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-06T06:56:16.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-05-06T06:56:17.409 INFO:teuthology.orchestra.run.smithi070.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.libcephsqlite.29731.log.gz 2024-05-06T06:56:21.747 INFO:teuthology.orchestra.run.smithi184.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-06T06:56:22.170 INFO:teuthology.orchestra.run.smithi070.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-06T06:56:25.443 INFO:teuthology.orchestra.run.smithi070.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-06T06:56:25.623 INFO:teuthology.orchestra.run.smithi184.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-06T06:56:31.229 INFO:teuthology.orchestra.run.smithi070.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-06T06:56:31.383 INFO:teuthology.orchestra.run.smithi184.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-06T06:56:32.073 INFO:teuthology.orchestra.run.smithi070.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-06T06:56:32.074 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-05-06T06:56:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m17.510s 2024-05-06T06:56:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m55.805s 2024-05-06T06:56:32.074 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m1.978s 2024-05-06T06:56:34.308 INFO:teuthology.orchestra.run.smithi184.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-06T06:56:34.308 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-05-06T06:56:34.308 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m19.706s 2024-05-06T06:56:34.308 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m52.830s 2024-05-06T06:56:34.308 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m1.890s 2024-05-06T06:56:34.310 INFO:tasks.ceph:Archiving logs... 2024-05-06T06:56:34.310 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280/remote/smithi070/log 2024-05-06T06:56:34.311 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-06T06:56:41.695 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280/remote/smithi184/log 2024-05-06T06:56:41.696 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-06T06:56:49.198 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-06T06:56:49.208 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-06T06:56:49.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-06T06:56:49.210 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-06T06:56:49.282 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-06T06:56:49.292 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-06T06:56:49.292 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T06:56:49.294 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-06T06:56:49.305 INFO:teuthology.orchestra.run.smithi070.stdout: remote refid st t when poll reach delay offset jitter 2024-05-06T06:56:49.306 INFO:teuthology.orchestra.run.smithi070.stdout:============================================================================== 2024-05-06T06:56:49.306 INFO:teuthology.orchestra.run.smithi070.stdout:*hv01.front.sepi 67.205.162.81 3 u 32 64 377 0.097 -2.464 1.932 2024-05-06T06:56:49.306 INFO:teuthology.orchestra.run.smithi070.stdout:+hv02.front.sepi 63.231.80.2 3 u 31 64 377 0.078 -0.093 1.972 2024-05-06T06:56:49.306 INFO:teuthology.orchestra.run.smithi070.stdout:+hv03.front.sepi 74.6.168.72 3 u 36 64 377 0.069 -3.689 2.105 2024-05-06T06:56:49.306 INFO:teuthology.orchestra.run.smithi070.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-06T06:56:49.307 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2024-05-06T06:56:49.307 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2024-05-06T06:56:49.307 INFO:teuthology.orchestra.run.smithi184.stdout:+hv01.front.sepi 67.205.162.81 3 u 40 64 377 0.075 +0.056 1.498 2024-05-06T06:56:49.308 INFO:teuthology.orchestra.run.smithi184.stdout:+hv02.front.sepi 63.231.80.2 3 u 31 64 377 0.092 -0.061 1.337 2024-05-06T06:56:49.308 INFO:teuthology.orchestra.run.smithi184.stdout:*hv03.front.sepi 74.6.168.72 3 u 42 64 377 0.092 -2.221 1.142 2024-05-06T06:56:49.308 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-06T06:56:49.308 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-06T06:56:49.320 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-06T06:56:49.321 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-06T06:56:49.331 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-06T06:56:49.341 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-06T06:56:49.359 INFO:teuthology.task.internal:Duration was 928.450255 seconds 2024-05-06T06:56:49.360 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-06T06:56:49.369 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-06T06:56:49.369 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-06T06:56:49.371 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-06T06:56:49.407 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-06T06:56:49.408 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-05-06T06:56:49.408 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-06T06:56:49.457 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-05-06T06:56:49.457 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-06T06:56:49.467 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-06T06:56:49.467 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-06T06:56:49.501 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-06T06:56:49.533 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-06T06:56:49.533 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-06T06:56:49.569 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-06T06:56:49.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-06T06:56:49.641 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-06T06:56:49.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-06T06:56:49.654 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-06T06:56:49.666 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-06T06:56:49.676 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-06T06:56:49.697 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-06T06:56:49.707 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-05-06T06:56:49.722 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-05-06T06:56:49.742 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-06T06:56:49.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:56:49.764 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-06T06:56:49.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-06T06:56:49.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-06T06:56:49.800 INFO:teuthology.task.internal:Transferring archived files... 2024-05-06T06:56:49.801 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280/remote/smithi070 2024-05-06T06:56:49.801 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-06T06:56:49.828 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280/remote/smithi184 2024-05-06T06:56:49.828 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-06T06:56:49.857 INFO:teuthology.task.internal:Removing archive directory... 2024-05-06T06:56:49.857 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-06T06:56:49.865 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-06T06:56:49.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-06T06:56:49.916 INFO:teuthology.task.internal:Not uploading archives. 2024-05-06T06:56:49.916 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-06T06:56:49.926 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-06T06:56:49.926 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-06T06:56:49.928 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-06T06:56:49.932 INFO:teuthology.orchestra.run.smithi070.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 6 06:56 /home/ubuntu/cephtest 2024-05-06T06:56:49.952 INFO:teuthology.orchestra.run.smithi184.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 6 06:56 /home/ubuntu/cephtest 2024-05-06T06:56:49.954 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-06T06:56:49.964 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-06T06:56:49.985 INFO:teuthology.nuke:Checking targets against current locks 2024-05-06T06:56:50.011 DEBUG:teuthology.nuke:shortname: smithi070 2024-05-06T06:56:50.012 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-06T06:56:50.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 06:31:24.624315', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGkfn7vJilnM+S81nkjLHMYbT/ARmls76OTwboKCkmJxlbMIcBXjEy1pCoG13D2VeDFilEWOiLKMsyxD/9+Rj00='} 2024-05-06T06:56:50.039 DEBUG:teuthology.nuke:shortname: smithi184 2024-05-06T06:56:50.040 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-06T06:56:50.060 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-05-03_23:44:50-rados-wip-yuriw-testing-20240503.181540-main-distro-default-smithi/7690280', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-06 06:31:24.625831', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4WQTeKmFsHN61WMC/8XA/CWDJ725jbHKnDlMEoJoTeZMf/e/HfxuM+Cu4ZrqXMwc1JAGYQ8J1uhWkPuu2TfeI='} 2024-05-06T06:56:50.093 INFO:teuthology.orchestra.console.smithi070:Power off 2024-05-06T06:56:50.093 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-06T06:56:50.120 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2024-05-06T06:56:50.120 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T06:56:50.136 INFO:teuthology.orchestra.console.smithi184:Power off 2024-05-06T06:56:50.136 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-06T06:56:50.146 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-05-06T06:56:50.160 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2024-05-06T06:56:50.160 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T06:56:50.185 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-05-06T06:56:54.147 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T06:56:54.186 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T06:56:54.257 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-05-06T06:56:54.296 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-05-06T06:56:58.258 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T06:56:58.297 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T06:56:58.368 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-05-06T06:56:58.407 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-05-06T06:56:58.469 INFO:teuthology.orchestra.console.smithi070:Power off completed 2024-05-06T06:57:02.409 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-06T06:57:02.519 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-05-06T06:57:02.620 INFO:teuthology.orchestra.console.smithi184:Power off completed 2024-05-06T06:57:02.724 INFO:teuthology.run:Summary data: description: rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} duration: 928.4502549171448 failure_reason: '"2024-05-06T06:52:16.855925+0000 mon.a (mon.0) 251 : cluster [WRN] Health check failed: Degraded data redundancy: 1/1332 objects degraded (0.075%), 1 pg degraded (PG_DEGRADED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2024-05-06T06:57:02.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-06T06:57:02.806 INFO:teuthology.run:FAIL